-- Logs begin at Tue 2022-09-27 16:41:39 UTC, end at Tue 2022-09-27 17:39:27 UTC. -- Sep 27 17:08:57.014876 dv-cinder-849143-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 27 17:08:57.023884 dv-cinder-849143-8-smb devstack@keystone.service[81367]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 27 17:08:57.025981 dv-cinder-849143-8-smb devstack@keystone.service[81367]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 27 17:08:57 2022] *** Sep 27 17:08:57.025981 dv-cinder-849143-8-smb devstack@keystone.service[81367]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 27 17:08:57.025981 dv-cinder-849143-8-smb devstack@keystone.service[81367]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 27 17:08:57.025981 dv-cinder-849143-8-smb devstack@keystone.service[81367]: nodename: dv-cinder-849143-8-smb Sep 27 17:08:57.025981 dv-cinder-849143-8-smb devstack@keystone.service[81367]: machine: x86_64 Sep 27 17:08:57.025981 dv-cinder-849143-8-smb devstack@keystone.service[81367]: clock source: unix Sep 27 17:08:57.025981 dv-cinder-849143-8-smb devstack@keystone.service[81367]: pcre jit disabled Sep 27 17:08:57.025981 dv-cinder-849143-8-smb devstack@keystone.service[81367]: detected number of CPU cores: 4 Sep 27 17:08:57.025981 dv-cinder-849143-8-smb devstack@keystone.service[81367]: current working directory: / Sep 27 17:08:57.025981 dv-cinder-849143-8-smb devstack@keystone.service[81367]: detected binary path: /usr/bin/uwsgi-core Sep 27 17:08:57.025981 dv-cinder-849143-8-smb devstack@keystone.service[81367]: your processes number limit is 47680 Sep 27 17:08:57.025981 dv-cinder-849143-8-smb devstack@keystone.service[81367]: your memory page size is 4096 bytes Sep 27 17:08:57.026598 dv-cinder-849143-8-smb devstack@keystone.service[81367]: detected max file descriptor number: 2048 Sep 27 17:08:57.026598 dv-cinder-849143-8-smb devstack@keystone.service[81367]: lock engine: pthread robust mutexes Sep 27 17:08:57.026598 dv-cinder-849143-8-smb devstack@keystone.service[81367]: thunder lock: enabled Sep 27 17:08:57.026598 dv-cinder-849143-8-smb devstack@keystone.service[81367]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 27 17:08:57.026598 dv-cinder-849143-8-smb devstack@keystone.service[81367]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 27 17:08:57.065612 dv-cinder-849143-8-smb devstack@keystone.service[81367]: Python main interpreter initialized at 0x559a20f719c0 Sep 27 17:08:57.065612 dv-cinder-849143-8-smb devstack@keystone.service[81367]: python threads support enabled Sep 27 17:08:57.065612 dv-cinder-849143-8-smb devstack@keystone.service[81367]: your server socket listen backlog is limited to 100 connections Sep 27 17:08:57.065612 dv-cinder-849143-8-smb devstack@keystone.service[81367]: your mercy for graceful operations on workers is 90 seconds Sep 27 17:08:57.065986 dv-cinder-849143-8-smb devstack@keystone.service[81367]: mapped 403077 bytes (393 KB) for 2 cores Sep 27 17:08:57.066064 dv-cinder-849143-8-smb devstack@keystone.service[81367]: *** Operational MODE: preforking *** Sep 27 17:08:57.066323 dv-cinder-849143-8-smb devstack@keystone.service[81367]: *** uWSGI is running in multiple interpreter mode *** Sep 27 17:08:57.066323 dv-cinder-849143-8-smb devstack@keystone.service[81367]: spawned uWSGI master process (pid: 81367) Sep 27 17:08:57.066524 dv-cinder-849143-8-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 27 17:08:57.067470 dv-cinder-849143-8-smb devstack@keystone.service[81367]: spawned uWSGI worker 1 (pid: 81378, cores: 1) Sep 27 17:08:57.067470 dv-cinder-849143-8-smb devstack@keystone.service[81367]: spawned uWSGI worker 2 (pid: 81379, cores: 1) Sep 27 17:08:57.067612 dv-cinder-849143-8-smb devstack@keystone.service[81367]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 27 17:09:01.351086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 17:09:01.351086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: from cryptography.utils import int_from_bytes Sep 27 17:09:01.351894 dv-cinder-849143-8-smb devstack@keystone.service[81379]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 17:09:01.351894 dv-cinder-849143-8-smb devstack@keystone.service[81379]: from cryptography.utils import int_from_bytes Sep 27 17:09:01.352015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 17:09:01.352015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: from cryptography.utils import int_from_bytes Sep 27 17:09:01.352015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 17:09:01.352015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: from cryptography.utils import int_from_bytes Sep 27 17:09:01.402480 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 17:09:01.402674 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 17:09:01.402820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 17:09:01.402920 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] command line args: [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 17:09:01.403022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 17:09:01.403110 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 17:09:01.403216 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] command line args: [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 17:09:01.403300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ================================================================================ {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 17:09:01.403487 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 17:09:01.403566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] admin_token = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.403668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ================================================================================ {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 17:09:01.403773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] config_dir = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.403921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] admin_token = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.403999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.404139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] config_source = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.404220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] config_dir = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.404325 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] debug = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.404402 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.404518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] config_source = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.404595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.404825 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] debug = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.404926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.405033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.405154 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.405255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.405349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.405442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.405541 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.405644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.405822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.405928 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.406055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_config_append = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.406151 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] list_limit = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.406250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.406354 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] log_config_append = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.406484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_dir = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.406579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.406672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_file = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.406771 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] log_dir = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.406771 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] log_file = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.406964 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.407043 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.407158 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.407238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.407352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.407432 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.407553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.407630 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.407744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.407744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.407928 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.408014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.408086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.408200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.408274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.408387 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.408469 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.408592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.408670 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.408827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.408951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.409071 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.409189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.409312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.409425 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.409541 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.409653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.409804 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.409919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.410041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.410367 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.410507 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.410633 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] publish_errors = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.410747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] publish_errors = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.410864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.410977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.411089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.411208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.411329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.411492 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.411678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.411906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.412061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.412183 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.412302 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] standard_threads = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.412421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] standard_threads = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.412541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.412665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.413265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.413265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.413466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.413561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] use_journal = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.413660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.413844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] use_json = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.413952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] use_journal = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.414049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] use_stderr = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.414144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] use_json = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.414144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] use_stderr = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.414335 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] use_syslog = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.414437 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] use_syslog = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.414532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.414631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:09:01.414750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.414863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.414958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.415063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.415159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.415259 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.415353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.415446 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.415539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.417717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.417858 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.417981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.418100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.418216 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.418332 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.418460 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.418578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.418691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.418803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.418916 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.419028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.419148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.419263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.419383 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.419497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.419639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.419762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.419889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.420004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.420152 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.420268 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.420382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.420501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.420625 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.420744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.420863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.420975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.421086 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.421276 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.421397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.421511 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.421628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.421795 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.421908 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.422032 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.422152 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.422265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.422378 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.422497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.422610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.422738 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.422853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.422965 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.423077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.423188 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.423306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.423430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.423544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.423656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.423774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.423774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.423985 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.424105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.424217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.424329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.424447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.424565 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.424678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.424798 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.424917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.425035 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.425148 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.425259 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.425370 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.425489 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.425602 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.425728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.425842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.425964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.426077 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.426198 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.426311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.426419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.426514 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.426609 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.426704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.427399 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.427564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.427733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.427906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.428090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.428225 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.428331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.428433 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.428529 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.428623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.428717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.428811 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.428913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.429009 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.429103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.429217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.429331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.429442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.429563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.429676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.429825 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.429938 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.430051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.430163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.430288 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.430403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.430522 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.430657 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.430763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.430871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.430968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.431063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.431157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.431252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.431347 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.431450 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.431553 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.431655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.431769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.431894 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.432019 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.432141 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.432256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.432380 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.432498 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.432613 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.432726 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.432838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.432950 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.433071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.433185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.433298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.433410 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.433522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.433634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.433774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.433891 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.434012 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.434133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.434772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.434888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.435002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.435117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.435242 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.435357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.435475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.435597 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.435711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.435824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.435942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.436050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.436162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.436282 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.436387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.436499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.436612 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.436731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.436845 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.437061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.437182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.437297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.437415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.437529 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.437642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.437795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.437912 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.438026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.438130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.438244 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.438357 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.438482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.438604 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.438718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.438837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.438951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.439065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.439253 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.439371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.439475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.439588 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.439701 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.439823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.439945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.440067 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.440183 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.440297 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.440411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.440411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.440624 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.440745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.440860 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.440973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.441087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.441206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.441321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.441443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.441557 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.441671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.441802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.441915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.442029 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.442157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.442273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.442400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.442577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.443277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.443462 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.443714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] auth.external = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.443918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.444055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.444173 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.external = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.444173 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.444390 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.444390 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.444608 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.444742 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] auth.password = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.444865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.444986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] auth.token = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.445102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.password = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.445223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.445338 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.token = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.445461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.445579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.445758 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.445878 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.445993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.446108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.446235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.446358 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.446473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.446595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.446711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.446825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.446947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] credential.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.447062 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.447177 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.447291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.447405 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.447525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.447652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.447769 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.447883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.447997 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.448111 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.448111 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.448332 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.448447 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.448567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.448682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.448797 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.448910 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.449032 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.449148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.449262 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.449376 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.449496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.449612 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.449752 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.449871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.449986 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.450100 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.450214 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.450328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.450450 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.450572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.450687 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.450802 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.450802 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.451023 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.451146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.451261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.451381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.451496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.451611 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.451726 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.451850 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.451966 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.452070 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.452184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.452298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.452420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.452536 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.452654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.452770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.452885 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.452999 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.453122 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.453238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.453238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.453452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.453574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.453736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.453930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.453930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.454156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.454156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.454372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.454372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.454593 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.454710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.454830 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.454951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.455067 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.455182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.455303 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.455419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.455541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.455657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.455777 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.455892 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.456014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.456132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.456246 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.456361 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.456475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.456588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.456710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.456825 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.456939 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.457053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.457169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.457283 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.457405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.457520 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.457635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.457763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.457878 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.457993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.458170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.458357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.458551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.458747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.458884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.459002 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.459126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.459243 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.459358 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.459473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.459587 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.459702 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.459825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.459941 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.460062 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.460178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.460294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.460409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.460533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.460649 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.460764 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.460878 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.460994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.461109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.461232 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.461354 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.461477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.461593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.461726 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.461844 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.461972 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.462088 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.462204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.462320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.462434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.462562 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.462562 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.462779 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.462779 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.462992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.463356 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.463482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.463598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.463712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.463826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.463940 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.464054 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.464176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.464291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.464405 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.464519 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.464633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.464747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.464869 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.464984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.465099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.465212 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.465326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.465441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.465563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.465679 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.465824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.465938 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.466052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.466176 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.466300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.466415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.466531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.466644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.466758 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.466871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.466993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.467108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.467222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.467222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.467436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.467550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.467677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.467792 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.467906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.468020 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.468133 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.468254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.468377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.468492 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.468607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.468720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.468835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.468948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.469070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.469185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.469298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.469412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.469525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.469639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.469788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.469905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.470025 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.470140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.470253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.470367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.470488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.470604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.470720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.470834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.470948 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.471061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.471182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.471297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.471411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.471525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.471639 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.471753 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.471875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.471990 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.472104 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.472218 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.472331 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.472449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.472572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.472687 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.472801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.472916 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.473030 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.473150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.473273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.473389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.473503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.473617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.473811 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.473961 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.474134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.474313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.474507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.474686 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.474821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.474938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.475062 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.475179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.475293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.475408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.475522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.475635 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.475758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.475873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.475989 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.476103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.476217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.476331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.476453 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.476576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.476692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.476806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] role.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.476921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.477036 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] role.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.477224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.477341 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.477456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.477571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.477700 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.477830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.477948 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.478063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.478063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.478279 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.478279 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] role.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.478500 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.478617 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] role.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.478731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.478845 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.478958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.479073 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.479195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.479311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.479425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.479538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.479652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.479766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.479888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.480004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.480118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.480234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.480348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.480462 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.480583 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.480699 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.480813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.480926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.481040 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.481155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.481278 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.481394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.481508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.481622 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.481752 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.481870 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.481996 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.482113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.482227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.482343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.482460 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.482575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.482698 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.482698 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.482915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.483029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.483144 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.483266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.483383 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.483498 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.483612 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.483726 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.483840 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.483963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.484079 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.484193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.484308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.484424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.484545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.484669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.484789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.484904 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.485018 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.485133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.485246 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.485369 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.485486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.485600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.485778 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.485895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.486010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.486136 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.486253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.486368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.486483 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.486597 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.486711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.486833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.486949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.487063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.487178 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.487292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.487407 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.487529 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.487645 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.487760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.487874 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.487988 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.488102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.488225 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.488341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.488455 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.488579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.488703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.488819 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.488933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.489055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.489171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.connection = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.489285 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.490071 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.490243 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.490422 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.490654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.490739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.490812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.490884 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.490955 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.491036 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.491116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.491189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.491268 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.491341 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.491420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.connection = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.491495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.491566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.491637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.491715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.491789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.491860 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.491932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.491932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.492061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.492140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.492213 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.492284 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.492354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.492425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.492495 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.492574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.492647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.492718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.492789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.492861 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.492932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.493015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 17:09:01.493088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.493088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.493088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.493088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.493088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.493088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.493088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.493088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:09:01.493088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 17:09:01.519738 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.519970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.520194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.520316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.520555 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.520823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.528497 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.529135 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.557254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.557382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.557517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.557598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.611254 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.611403 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.659781 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.660011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.660346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.660588 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.816387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.816573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.816654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.816787 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.816888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.817015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.817100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.817237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.817320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.818028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.818183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.818323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.841465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.841705 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.841963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.842067 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.842196 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.842281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.842422 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.842505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.842645 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.842729 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.842865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.842947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.843147 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.843366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.854523 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.855175 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.867321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.867515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.867744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.867973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.868195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.868279 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.868413 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.868495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.868635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.868719 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.868855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.869076 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.869300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.869518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 17:09:01.886347 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.886468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.886551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 17:09:01.886628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 17:09:01.886891 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.886990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.887097 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 17:09:01.887178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 17:09:01.887367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.887448 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.887629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.887712 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.887890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.887970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.888149 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.888229 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.897873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.897972 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.898154 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.898237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.898429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.898523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.898718 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.898802 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.905753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.905838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.908666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.908757 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.908957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.909040 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.909247 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.909329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.909538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.909619 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.909849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.909930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.910111 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.910204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.910382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.910464 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.910656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.910736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.910927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.911010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.911722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.911809 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.911996 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.912139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.935640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.935740 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.937101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.937184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.937388 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.937484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.942091 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.942177 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.942379 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.942461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.942716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.942861 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.949036 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.949132 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.949326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.949409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.954940 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.955035 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.955239 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.955325 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.955529 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.955624 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.955818 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.955901 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.956096 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.956178 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.956369 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.956453 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.956637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.956721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.956905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.956986 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.972745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.973032 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.973116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.973316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.977623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.977759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.980880 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.980969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.981180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.981262 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.985418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.985504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.988616 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.988700 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:01.992445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.992576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.992751 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.992839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.993044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.993128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.993334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.993417 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.993621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.993729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.993942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:01.994034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.009930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.010134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.010219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.010424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.010507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.010694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.010779 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.010956 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.017602 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.017807 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.019179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.019340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.021311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.021411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.021598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.021850 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.024329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.024601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.024684 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.024888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.024971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.025173 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.025256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.025456 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.025547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.025869 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.036789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.037077 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.037227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.037365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.037518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.037652 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.037834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.038066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.038148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.038360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.038496 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.038655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.038784 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.039065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.054604 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.055061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.057540 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.057998 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.060453 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.060877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.061979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.062446 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.063446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.063734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.064055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.064137 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.064339 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.064750 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.070835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.071235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.072301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.072683 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.075221 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.075600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.075685 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.075903 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.076065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.076186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.076271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.076530 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.084757 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.084981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.085081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.085273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.085356 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.085562 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.092501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.092704 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 17:09:02.092789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.092991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.093084 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.093274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.093357 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.093556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.093641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.093856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.093939 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.094139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.094233 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.094414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.094506 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.094700 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.094791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.094970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.095051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.095247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.095329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.095520 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.095603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.095790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.095870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.096055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.096136 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.096332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 17:09:02.131010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559a20f719c0 pid: 81379 (default app) Sep 27 17:09:02.131293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559a20f719c0 pid: 81378 (default app) Sep 27 17:09:02.134240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4740b2-4efc-4302-9d37-cc710745c297 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:02.134531 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4740b2-4efc-4302-9d37-cc710745c297 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:02.134808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4740b2-4efc-4302-9d37-cc710745c297 None None] PATH_INFO: `/v3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:02.139003 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Tue Sep 27 17:09:02 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:08.942894 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5f089-f2c9-49b2-86eb-12bb9c17d4f8 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:08.943436 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5f089-f2c9-49b2-86eb-12bb9c17d4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:08.943545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5f089-f2c9-49b2-86eb-12bb9c17d4f8 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:08.947875 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:09:08.953298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85067027-b20b-49f4-8abc-205d990e32a0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:08.953767 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85067027-b20b-49f4-8abc-205d990e32a0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:08.953903 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85067027-b20b-49f4-8abc-205d990e32a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:09.025134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: INFO dbcounter [None req-85067027-b20b-49f4-8abc-205d990e32a0 None None] Registered counter for database keystone Sep 27 17:09:09.044401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG oslo_db.sqlalchemy.engines [None req-85067027-b20b-49f4-8abc-205d990e32a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:09:09.050998 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writer thread running {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:09:09.231641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG passlib.handlers.bcrypt [None req-85067027-b20b-49f4-8abc-205d990e32a0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81379) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 27 17:09:09.231941 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG passlib.handlers.bcrypt [None req-85067027-b20b-49f4-8abc-205d990e32a0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81379) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 27 17:09:09.290693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-85067027-b20b-49f4-8abc-205d990e32a0 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:09.292302 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-85067027-b20b-49f4-8abc-205d990e32a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:09.419625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 27 17:09:09.891348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5f089-f2c9-49b2-86eb-12bb9c17d4f8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:09.960737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: INFO dbcounter [None req-4be5f089-f2c9-49b2-86eb-12bb9c17d4f8 None None] Registered counter for database keystone Sep 27 17:09:09.982132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG oslo_db.sqlalchemy.engines [None req-4be5f089-f2c9-49b2-86eb-12bb9c17d4f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81378) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:09:09.988158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writer thread running {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:09:10.106268 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5f089-f2c9-49b2-86eb-12bb9c17d4f8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:10.110466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482d4c8-4bc9-47b4-86cb-29aaada04e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:10.111097 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482d4c8-4bc9-47b4-86cb-29aaada04e6e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:10.111376 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482d4c8-4bc9-47b4-86cb-29aaada04e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:10.111647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482d4c8-4bc9-47b4-86cb-29aaada04e6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:10.119785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482d4c8-4bc9-47b4-86cb-29aaada04e6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:10.172869 dv-cinder-849143-8-smb devstack@keystone.service[81378]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8482d4c8-4bc9-47b4-86cb-29aaada04e6e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 27 17:09:10.173159 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482d4c8-4bc9-47b4-86cb-29aaada04e6e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:10.182717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1324 bytes} [Tue Sep 27 17:09:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 27 17:09:10.188574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85067027-b20b-49f4-8abc-205d990e32a0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:10.205878 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85067027-b20b-49f4-8abc-205d990e32a0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:10.211125 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e230502-d9e6-48b9-ab5e-ae94b982e659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:10.212211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e230502-d9e6-48b9-ab5e-ae94b982e659 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:10.212492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e230502-d9e6-48b9-ab5e-ae94b982e659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:10.213023 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e230502-d9e6-48b9-ab5e-ae94b982e659 admin admin] PATH_INFO: `/v3/projects/0f246d966d6f4376a724440b0dff9304` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:10.214636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e230502-d9e6-48b9-ab5e-ae94b982e659 admin admin] RBAC: Authorizing `identity:get_project(project_id=0f246d966d6f4376a724440b0dff9304)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:10.268549 dv-cinder-849143-8-smb devstack@keystone.service[81379]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0e230502-d9e6-48b9-ab5e-ae94b982e659 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 27 17:09:10.268900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e230502-d9e6-48b9-ab5e-ae94b982e659 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:10.274364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 3/5] 10.222.0.57 () {56 vars in 1207 bytes} [Tue Sep 27 17:09:10 2022] GET /identity/v3/projects/0f246d966d6f4376a724440b0dff9304 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:12.397779 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c55c24-a9a4-4940-b926-89fbff939fb3 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:12.398297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c55c24-a9a4-4940-b926-89fbff939fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:12.398297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c55c24-a9a4-4940-b926-89fbff939fb3 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:12.402435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 3/6] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:12.407902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fdf20-b7a9-4b1d-9b5b-fad499783ca5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:12.408285 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fdf20-b7a9-4b1d-9b5b-fad499783ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:12.408453 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fdf20-b7a9-4b1d-9b5b-fad499783ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:12.428502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-481fdf20-b7a9-4b1d-9b5b-fad499783ca5 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:12.430078 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-481fdf20-b7a9-4b1d-9b5b-fad499783ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:12.438069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 27 17:09:12.713270 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c55c24-a9a4-4940-b926-89fbff939fb3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:12.725545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c55c24-a9a4-4940-b926-89fbff939fb3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:12.729666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb2d7a-f10b-4269-a2dc-c310168cafc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:12.730284 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb2d7a-f10b-4269-a2dc-c310168cafc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:12.730560 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb2d7a-f10b-4269-a2dc-c310168cafc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:12.730830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb2d7a-f10b-4269-a2dc-c310168cafc1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:12.738333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb2d7a-f10b-4269-a2dc-c310168cafc1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:12.740956 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb2d7a-f10b-4269-a2dc-c310168cafc1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:12.749462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1324 bytes} [Tue Sep 27 17:09:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 17:09:12.755330 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fdf20-b7a9-4b1d-9b5b-fad499783ca5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:12.764285 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fdf20-b7a9-4b1d-9b5b-fad499783ca5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:12.768603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1b7db-9497-40c5-842e-89d58be2f333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:12.769220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1b7db-9497-40c5-842e-89d58be2f333 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:12.769502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1b7db-9497-40c5-842e-89d58be2f333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:12.769813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1b7db-9497-40c5-842e-89d58be2f333 admin admin] PATH_INFO: `/v3/users/100c1706b8bd4a93b5f2764550817d64` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:12.771131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1b7db-9497-40c5-842e-89d58be2f333 admin admin] RBAC: Authorizing `identity:get_user(user_id=100c1706b8bd4a93b5f2764550817d64)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:12.772949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1b7db-9497-40c5-842e-89d58be2f333 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:12.774496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 5/9] 10.222.0.57 () {56 vars in 1198 bytes} [Tue Sep 27 17:09:12 2022] GET /identity/v3/users/100c1706b8bd4a93b5f2764550817d64 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:14.982132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbaf12-c828-4ded-ba7c-36cace2ae67c None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:14.982671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbaf12-c828-4ded-ba7c-36cace2ae67c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:14.982671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbaf12-c828-4ded-ba7c-36cace2ae67c None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:14.983992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:14.989679 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528dd7b-8ca2-4961-bf92-64986f61ddf2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:14.990112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528dd7b-8ca2-4961-bf92-64986f61ddf2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:14.990217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528dd7b-8ca2-4961-bf92-64986f61ddf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:15.008454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1528dd7b-8ca2-4961-bf92-64986f61ddf2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:15.009626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1528dd7b-8ca2-4961-bf92-64986f61ddf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:15.013208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec073f57-9a90-4ffe-9cc3-cffa36b5a508 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:15.013593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec073f57-9a90-4ffe-9cc3-cffa36b5a508 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:15.013901 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec073f57-9a90-4ffe-9cc3-cffa36b5a508 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:15.015227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 6/11] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:09:15.020502 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678006e-0a1c-47d8-a727-ebb95bcd1419 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:15.020879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678006e-0a1c-47d8-a727-ebb95bcd1419 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:15.021250 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678006e-0a1c-47d8-a727-ebb95bcd1419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:15.063290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG passlib.handlers.bcrypt [None req-6678006e-0a1c-47d8-a727-ebb95bcd1419 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81378) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 27 17:09:15.063669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG passlib.handlers.bcrypt [None req-6678006e-0a1c-47d8-a727-ebb95bcd1419 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81378) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 27 17:09:15.091041 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:15.114662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6678006e-0a1c-47d8-a727-ebb95bcd1419 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:15.116261 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6678006e-0a1c-47d8-a727-ebb95bcd1419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:15.215248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:09:15.359453 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528dd7b-8ca2-4961-bf92-64986f61ddf2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:15.383481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:15.468990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528dd7b-8ca2-4961-bf92-64986f61ddf2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:15.488814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678006e-0a1c-47d8-a727-ebb95bcd1419 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:15.503488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7395db-872e-4c8f-ac13-e6a2a035b60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:15.504662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7395db-872e-4c8f-ac13-e6a2a035b60a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:15.504932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7395db-872e-4c8f-ac13-e6a2a035b60a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:15.505204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7395db-872e-4c8f-ac13-e6a2a035b60a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:15.516166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7395db-872e-4c8f-ac13-e6a2a035b60a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ea7395db-872e-4c8f-ac13-e6a2a035b60a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:15.525731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:15.526824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:15.527650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:15.527650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:15.527650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:15.527650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:15.527650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:15.527650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:15.527650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:15.527650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:15.527650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:15.527650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:15.527650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:15.527650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:15.527650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 7/14] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:09:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:15.532681 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7395db-872e-4c8f-ac13-e6a2a035b60a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:15.589979 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678006e-0a1c-47d8-a727-ebb95bcd1419 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:15.592251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:15.615551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:15.628862 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468fb9f-cba0-4e64-941d-c85030c06b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:15.629823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468fb9f-cba0-4e64-941d-c85030c06b3e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:15.630105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468fb9f-cba0-4e64-941d-c85030c06b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:15.630377 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468fb9f-cba0-4e64-941d-c85030c06b3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:15.634295 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7395db-872e-4c8f-ac13-e6a2a035b60a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:15.668246 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea658c-db06-4891-8015-f1a6273e5b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:15.668850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea658c-db06-4891-8015-f1a6273e5b98 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:15.669134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea658c-db06-4891-8015-f1a6273e5b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:15.669409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea658c-db06-4891-8015-f1a6273e5b98 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:15.670108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea658c-db06-4891-8015-f1a6273e5b98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:15.670413 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea658c-db06-4891-8015-f1a6273e5b98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:15.671813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea658c-db06-4891-8015-f1a6273e5b98 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:15.683416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 8/15] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:15.689093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea658c-db06-4891-8015-f1a6273e5b98 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:15.698915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468fb9f-cba0-4e64-941d-c85030c06b3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:15.700436 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468fb9f-cba0-4e64-941d-c85030c06b3e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:15.789295 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea658c-db06-4891-8015-f1a6273e5b98 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:15.796107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 8/16] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 17:09:15.802670 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468fb9f-cba0-4e64-941d-c85030c06b3e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:15.805921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:15.824442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f14cbf-2893-48ee-89be-8de2a9a8d419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:15.825077 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f14cbf-2893-48ee-89be-8de2a9a8d419 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:15.825356 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f14cbf-2893-48ee-89be-8de2a9a8d419 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:15.825630 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f14cbf-2893-48ee-89be-8de2a9a8d419 None admin] PATH_INFO: `/v3/users/100c1706b8bd4a93b5f2764550817d64` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:15.826794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f14cbf-2893-48ee-89be-8de2a9a8d419 None admin] RBAC: Authorizing `identity:get_user(user_id=100c1706b8bd4a93b5f2764550817d64)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:15.828241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f14cbf-2893-48ee-89be-8de2a9a8d419 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:15.829979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 9/17] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:15 2022] GET /identity/v3/users/100c1706b8bd4a93b5f2764550817d64 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:15.835348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f14cbf-2893-48ee-89be-8de2a9a8d419 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:15.849848 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:15.905323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468fb9f-cba0-4e64-941d-c85030c06b3e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:15.935578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f14cbf-2893-48ee-89be-8de2a9a8d419 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:15.943037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e5ef8-49a3-4073-b6f5-bbf82ce3f98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:15.943906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e5ef8-49a3-4073-b6f5-bbf82ce3f98a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:15.944185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e5ef8-49a3-4073-b6f5-bbf82ce3f98a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:15.944456 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e5ef8-49a3-4073-b6f5-bbf82ce3f98a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:15.963220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e5ef8-49a3-4073-b6f5-bbf82ce3f98a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:15.964681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e5ef8-49a3-4073-b6f5-bbf82ce3f98a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:15.971141 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74958bd4-aadf-4de1-9a3c-d16342d67d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:15.971765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74958bd4-aadf-4de1-9a3c-d16342d67d61 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:15.972049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74958bd4-aadf-4de1-9a3c-d16342d67d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:15.972322 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74958bd4-aadf-4de1-9a3c-d16342d67d61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:15.974186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74958bd4-aadf-4de1-9a3c-d16342d67d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:15.975626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74958bd4-aadf-4de1-9a3c-d16342d67d61 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:15.977173 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 10/18] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:09:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:15.982873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74958bd4-aadf-4de1-9a3c-d16342d67d61 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-5f0e5ef8-49a3-4073-b6f5-bbf82ce3f98a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:09:15.983326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:15.984508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:09:15.985304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:09:15.985304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:09:15.985304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:09:15.985304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 9/19] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:09:15.990793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e5ef8-49a3-4073-b6f5-bbf82ce3f98a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:16.048276 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:16.064595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:16.084030 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74958bd4-aadf-4de1-9a3c-d16342d67d61 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:16.092687 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e5ef8-49a3-4073-b6f5-bbf82ce3f98a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:16.117953 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a6aa0-57fa-41fd-9312-29db5af7fa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:16.118548 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a6aa0-57fa-41fd-9312-29db5af7fa76 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:16.118831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a6aa0-57fa-41fd-9312-29db5af7fa76 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:16.119099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a6aa0-57fa-41fd-9312-29db5af7fa76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:16.119814 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a6aa0-57fa-41fd-9312-29db5af7fa76 None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.domain.id=default, user.id=100c1706b8bd4a93b5f2764550817d64) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:16.120117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a6aa0-57fa-41fd-9312-29db5af7fa76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:16.121548 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a6aa0-57fa-41fd-9312-29db5af7fa76 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:16.127266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e8dca-ba01-426d-bc2d-7ceb4c2d2753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:16.127871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e8dca-ba01-426d-bc2d-7ceb4c2d2753 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:16.128157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e8dca-ba01-426d-bc2d-7ceb4c2d2753 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:16.128358 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 11/20] 10.222.0.57 () {56 vars in 1322 bytes} [Tue Sep 27 17:09:15 2022] GET /identity/v3/role_assignments?user.id=100c1706b8bd4a93b5f2764550817d64&scope.domain.id=default&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:16.128744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e8dca-ba01-426d-bc2d-7ceb4c2d2753 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:16.129644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e8dca-ba01-426d-bc2d-7ceb4c2d2753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:16.129978 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e8dca-ba01-426d-bc2d-7ceb4c2d2753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:16.131377 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e8dca-ba01-426d-bc2d-7ceb4c2d2753 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:16.151046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 10/21] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:18.744710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5211891-847c-4934-8861-4f50e248bd8f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:18.745755 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5211891-847c-4934-8861-4f50e248bd8f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:18.746249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5211891-847c-4934-8861-4f50e248bd8f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:18.747856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 12/22] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:18.753749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac227f-e6bf-4eb5-be94-f98d01f44fc0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:18.754942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac227f-e6bf-4eb5-be94-f98d01f44fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:18.754942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac227f-e6bf-4eb5-be94-f98d01f44fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:18.779447 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-73ac227f-e6bf-4eb5-be94-f98d01f44fc0 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:18.780668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-73ac227f-e6bf-4eb5-be94-f98d01f44fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:18.864476 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 11/23] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:18.885903 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f585e-d5f8-4f1b-9256-8a30d3ad07f7 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:18.886492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f585e-d5f8-4f1b-9256-8a30d3ad07f7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:18.886963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f585e-d5f8-4f1b-9256-8a30d3ad07f7 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:18.888781 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:18.899541 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e861035-708a-459d-94cc-243d7dc3f353 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:18.899832 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e861035-708a-459d-94cc-243d7dc3f353 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:18.900176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e861035-708a-459d-94cc-243d7dc3f353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:18.926906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2e861035-708a-459d-94cc-243d7dc3f353 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:18.928122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2e861035-708a-459d-94cc-243d7dc3f353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:18.995747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:19.026151 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 12/25] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:19.198823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df069b46-2187-4ea9-a275-02566b35f801 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:19.199488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df069b46-2187-4ea9-a275-02566b35f801 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:19.199965 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df069b46-2187-4ea9-a275-02566b35f801 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:19.201519 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 14/26] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:19.205868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12831d81-d60f-4222-95ad-c9ba70ccff20 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:19.206396 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12831d81-d60f-4222-95ad-c9ba70ccff20 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:19.207568 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12831d81-d60f-4222-95ad-c9ba70ccff20 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:19.209094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:19.214438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c6fdf-da25-4f31-bd2b-90992b3ab572 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:19.214971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c6fdf-da25-4f31-bd2b-90992b3ab572 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:19.215446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c6fdf-da25-4f31-bd2b-90992b3ab572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:19.227843 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52465378-88e5-4811-b7ba-3c73d8fde61d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:19.230082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52465378-88e5-4811-b7ba-3c73d8fde61d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:19.230575 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52465378-88e5-4811-b7ba-3c73d8fde61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:19.251013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6f1c6fdf-da25-4f31-bd2b-90992b3ab572 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:19.253471 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6f1c6fdf-da25-4f31-bd2b-90992b3ab572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:19.276562 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-52465378-88e5-4811-b7ba-3c73d8fde61d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:19.278088 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-52465378-88e5-4811-b7ba-3c73d8fde61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:19.375237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 14/28] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:09:19.376309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52465378-88e5-4811-b7ba-3c73d8fde61d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:19.392276 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 15/29] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:09:19.393400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c6fdf-da25-4f31-bd2b-90992b3ab572 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:19.544674 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:19.604488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c6fdf-da25-4f31-bd2b-90992b3ab572 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:19.616590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52465378-88e5-4811-b7ba-3c73d8fde61d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:19.627971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:19.674410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f202a6e-bfcb-4e99-83fd-eeb8c7ba8bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:19.675151 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202a6e-bfcb-4e99-83fd-eeb8c7ba8bdb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:19.675739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202a6e-bfcb-4e99-83fd-eeb8c7ba8bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:19.676029 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202a6e-bfcb-4e99-83fd-eeb8c7ba8bdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:19.698931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f202a6e-bfcb-4e99-83fd-eeb8c7ba8bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:19.703221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da865b07-addf-4e04-a69a-e0d973578348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9f202a6e-bfcb-4e99-83fd-eeb8c7ba8bdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:19.703849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:19.704677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:19.705879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:19.705879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:19.705879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:19.705879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:19.705879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:19.705879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:19.705879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:19.705879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:19.705879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:19.705879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:19.705879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:19.705879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:19.706470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da865b07-addf-4e04-a69a-e0d973578348 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:19.706470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da865b07-addf-4e04-a69a-e0d973578348 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:19.706470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da865b07-addf-4e04-a69a-e0d973578348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:19.706635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 16/30] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:09:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:19.706635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f202a6e-bfcb-4e99-83fd-eeb8c7ba8bdb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:19.732950 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da865b07-addf-4e04-a69a-e0d973578348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:19.736157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da865b07-addf-4e04-a69a-e0d973578348 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-da865b07-addf-4e04-a69a-e0d973578348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:09:19.766414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:19.767727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:09:19.768513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:09:19.768513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:09:19.768513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:09:19.771529 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 15/31] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:19.772571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da865b07-addf-4e04-a69a-e0d973578348 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:19.865221 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f202a6e-bfcb-4e99-83fd-eeb8c7ba8bdb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:19.901848 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7e960-ce6b-4d11-a7b7-0209d69805ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:19.902684 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7e960-ce6b-4d11-a7b7-0209d69805ec None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:19.903145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7e960-ce6b-4d11-a7b7-0209d69805ec None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:19.903561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7e960-ce6b-4d11-a7b7-0209d69805ec None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:19.904352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7e960-ce6b-4d11-a7b7-0209d69805ec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:19.905985 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7e960-ce6b-4d11-a7b7-0209d69805ec None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:19.907264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da865b07-addf-4e04-a69a-e0d973578348 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:19.914156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:19.949242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bb983-ad0b-4d53-abed-0d69eb06d5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:19.949904 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bb983-ad0b-4d53-abed-0d69eb06d5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:19.950189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bb983-ad0b-4d53-abed-0d69eb06d5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:19.950469 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bb983-ad0b-4d53-abed-0d69eb06d5f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:19.951146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bb983-ad0b-4d53-abed-0d69eb06d5f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:19.951452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bb983-ad0b-4d53-abed-0d69eb06d5f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:19.952828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bb983-ad0b-4d53-abed-0d69eb06d5f5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:19.967859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 16/32] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:19.973178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bb983-ad0b-4d53-abed-0d69eb06d5f5 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:19.995995 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:20.044565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 17/33] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Sep 27 17:09:19 2022] POST /identity/v3/roles => generated 219 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:09:20.046257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7e960-ce6b-4d11-a7b7-0209d69805ec None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:20.124700 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bb983-ad0b-4d53-abed-0d69eb06d5f5 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:20.183255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b50e8-2d3e-4d4c-9096-e38a1f948624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:20.184736 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b50e8-2d3e-4d4c-9096-e38a1f948624 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:20.186040 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b50e8-2d3e-4d4c-9096-e38a1f948624 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:20.186563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b50e8-2d3e-4d4c-9096-e38a1f948624 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:20.187902 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b50e8-2d3e-4d4c-9096-e38a1f948624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:20.189501 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b50e8-2d3e-4d4c-9096-e38a1f948624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:20.196131 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b50e8-2d3e-4d4c-9096-e38a1f948624 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:20.225881 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 17/34] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:20.228334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b50e8-2d3e-4d4c-9096-e38a1f948624 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:20.272728 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7e960-ce6b-4d11-a7b7-0209d69805ec None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:20.321217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c05cec-b379-4b74-bea5-71ce8eb8fabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:20.321896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c05cec-b379-4b74-bea5-71ce8eb8fabe None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:20.322182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c05cec-b379-4b74-bea5-71ce8eb8fabe None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:20.322465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c05cec-b379-4b74-bea5-71ce8eb8fabe None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:20.325392 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c05cec-b379-4b74-bea5-71ce8eb8fabe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:20.327142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c05cec-b379-4b74-bea5-71ce8eb8fabe None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:20.337125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:20.348933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 18/35] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Sep 27 17:09:20 2022] POST /identity/v3/roles => generated 225 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:09:20.350563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c05cec-b379-4b74-bea5-71ce8eb8fabe None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:20.366736 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b50e8-2d3e-4d4c-9096-e38a1f948624 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:20.432565 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03272930-ae0f-4931-a26b-1361f6d675d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:20.433520 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03272930-ae0f-4931-a26b-1361f6d675d0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:20.434022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03272930-ae0f-4931-a26b-1361f6d675d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:20.434511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03272930-ae0f-4931-a26b-1361f6d675d0 None admin] PATH_INFO: `/v3/users/100c1706b8bd4a93b5f2764550817d64` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:20.438299 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03272930-ae0f-4931-a26b-1361f6d675d0 None admin] RBAC: Authorizing `identity:get_user(user_id=100c1706b8bd4a93b5f2764550817d64)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:20.440097 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03272930-ae0f-4931-a26b-1361f6d675d0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:20.449563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 18/36] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:20 2022] GET /identity/v3/users/100c1706b8bd4a93b5f2764550817d64 => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:20.451653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0f9a8-1bbd-4c60-8182-a8ba050a29bb None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:20.452300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0f9a8-1bbd-4c60-8182-a8ba050a29bb None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:20.452914 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0f9a8-1bbd-4c60-8182-a8ba050a29bb None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:20.454905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 19/37] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:20.462251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0f9a8-1bbd-4c60-8182-a8ba050a29bb None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:20.466282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:20.539977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c05cec-b379-4b74-bea5-71ce8eb8fabe None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:20.588929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d542a-501e-489f-a341-070ebde07b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:20.590050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d542a-501e-489f-a341-070ebde07b1f None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:20.590514 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d542a-501e-489f-a341-070ebde07b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:20.591324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d542a-501e-489f-a341-070ebde07b1f None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:20.592195 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d542a-501e-489f-a341-070ebde07b1f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:20.594448 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d542a-501e-489f-a341-070ebde07b1f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:20.608603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0f9a8-1bbd-4c60-8182-a8ba050a29bb None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:20.635230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 19/38] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Sep 27 17:09:20 2022] POST /identity/v3/projects => generated 301 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:09:20.636903 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8daf2-7310-439b-963e-6a9a273942ac None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:20.637377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8daf2-7310-439b-963e-6a9a273942ac None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:20.637874 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8daf2-7310-439b-963e-6a9a273942ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:20.657621 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ac960-fe8b-4e5b-a601-f9269287d850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:20.658337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ac960-fe8b-4e5b-a601-f9269287d850 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:20.658670 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ac960-fe8b-4e5b-a601-f9269287d850 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:20.658960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ac960-fe8b-4e5b-a601-f9269287d850 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:20.660674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ac960-fe8b-4e5b-a601-f9269287d850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:20.661755 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-65d8daf2-7310-439b-963e-6a9a273942ac None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:20.662222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ac960-fe8b-4e5b-a601-f9269287d850 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:20.663855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-65d8daf2-7310-439b-963e-6a9a273942ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:20.664042 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 20/39] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:09:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:20.665281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e51328-c65b-4781-9d11-7ad904b0ad16 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:20.665836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e51328-c65b-4781-9d11-7ad904b0ad16 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:20.666127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e51328-c65b-4781-9d11-7ad904b0ad16 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:20.667677 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 21/40] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:20.671938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e51328-c65b-4781-9d11-7ad904b0ad16 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:20.693961 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:20.753027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 20/41] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:20.754583 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772741d-e7d4-40c2-9c0d-4be419a16d96 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:20.754872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772741d-e7d4-40c2-9c0d-4be419a16d96 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:20.755155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772741d-e7d4-40c2-9c0d-4be419a16d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:20.784059 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b772741d-e7d4-40c2-9c0d-4be419a16d96 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:20.787008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b772741d-e7d4-40c2-9c0d-4be419a16d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:20.812941 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e51328-c65b-4781-9d11-7ad904b0ad16 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:20.835375 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:20.870989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c4b6e-a51f-4c20-b430-f1c3cb93cf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:20.871665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c4b6e-a51f-4c20-b430-f1c3cb93cf28 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:20.871947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c4b6e-a51f-4c20-b430-f1c3cb93cf28 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:20.872251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c4b6e-a51f-4c20-b430-f1c3cb93cf28 None admin] PATH_INFO: `/v3/domains/default/users/100c1706b8bd4a93b5f2764550817d64/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:20.874173 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c4b6e-a51f-4c20-b430-f1c3cb93cf28 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=100c1706b8bd4a93b5f2764550817d64, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:20.876242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c4b6e-a51f-4c20-b430-f1c3cb93cf28 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:20.889715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 21/42] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:21.001789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 22/43] 10.222.0.57 () {58 vars in 1361 bytes} [Tue Sep 27 17:09:20 2022] PUT /identity/v3/domains/default/users/100c1706b8bd4a93b5f2764550817d64/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:09:21.050393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772741d-e7d4-40c2-9c0d-4be419a16d96 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:21.163627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772741d-e7d4-40c2-9c0d-4be419a16d96 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:21.171991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c4b6e-a51f-4c20-b430-f1c3cb93cf28 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:21.211694 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab925e6d-974f-4573-aab1-b9637e9324ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:21.212575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab925e6d-974f-4573-aab1-b9637e9324ac None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:21.212861 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab925e6d-974f-4573-aab1-b9637e9324ac None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:21.213373 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab925e6d-974f-4573-aab1-b9637e9324ac None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:21.213857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab925e6d-974f-4573-aab1-b9637e9324ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:21.215249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab925e6d-974f-4573-aab1-b9637e9324ac None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:21.230144 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 22/44] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Sep 27 17:09:21 2022] POST /identity/v3/roles => generated 223 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:09:21.272126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:21.300507 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c4b6e-a51f-4c20-b430-f1c3cb93cf28 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:21.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa96fca-019b-4bc7-b3ec-4c8f44f0aee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:21.340470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa96fca-019b-4bc7-b3ec-4c8f44f0aee6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:21.340751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa96fca-019b-4bc7-b3ec-4c8f44f0aee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:21.341086 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa96fca-019b-4bc7-b3ec-4c8f44f0aee6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:21.342348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa96fca-019b-4bc7-b3ec-4c8f44f0aee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:21.343999 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa96fca-019b-4bc7-b3ec-4c8f44f0aee6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:21.349170 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 23/45] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:09:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:21.354839 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab925e6d-974f-4573-aab1-b9637e9324ac None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:21.494171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:21.569759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab925e6d-974f-4573-aab1-b9637e9324ac None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:21.602255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03633fd-8f51-4a25-be57-4c7a4497473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:21.602871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03633fd-8f51-4a25-be57-4c7a4497473e None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:21.603152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03633fd-8f51-4a25-be57-4c7a4497473e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:21.603427 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03633fd-8f51-4a25-be57-4c7a4497473e None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:21.604071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03633fd-8f51-4a25-be57-4c7a4497473e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:21.605507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03633fd-8f51-4a25-be57-4c7a4497473e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:21.632171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 23/46] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Sep 27 17:09:21 2022] POST /identity/v3/projects => generated 312 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:09:23.203110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37a56b-bb55-40be-bbff-9482a9dc1b49 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:23.203665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37a56b-bb55-40be-bbff-9482a9dc1b49 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:23.203665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37a56b-bb55-40be-bbff-9482a9dc1b49 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:23.204992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 24/47] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:23.211038 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a785345-1113-459d-b364-635c0e18ea28 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:23.211468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a785345-1113-459d-b364-635c0e18ea28 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:23.211721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a785345-1113-459d-b364-635c0e18ea28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:23.230671 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4a785345-1113-459d-b364-635c0e18ea28 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:23.231952 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4a785345-1113-459d-b364-635c0e18ea28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:23.299076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 24/48] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:23.568664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37a56b-bb55-40be-bbff-9482a9dc1b49 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:23.776727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37a56b-bb55-40be-bbff-9482a9dc1b49 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:23.797940 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f94bc-89ac-4199-a2ac-13a0d2c5a84e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:23.798231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f94bc-89ac-4199-a2ac-13a0d2c5a84e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:23.798510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f94bc-89ac-4199-a2ac-13a0d2c5a84e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:23.799852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 25/49] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:09:23.805292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3ed69-8ac9-4af0-a235-4d502634c6e2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:23.805581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3ed69-8ac9-4af0-a235-4d502634c6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:23.805893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3ed69-8ac9-4af0-a235-4d502634c6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:23.811454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304edb2e-3fbc-411c-8cab-dc3905a163fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:23.812073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304edb2e-3fbc-411c-8cab-dc3905a163fc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:23.812355 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304edb2e-3fbc-411c-8cab-dc3905a163fc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:23.812627 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304edb2e-3fbc-411c-8cab-dc3905a163fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:23.824113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-68b3ed69-8ac9-4af0-a235-4d502634c6e2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:23.824809 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304edb2e-3fbc-411c-8cab-dc3905a163fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:23.825250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-68b3ed69-8ac9-4af0-a235-4d502634c6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:23.827237 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-304edb2e-3fbc-411c-8cab-dc3905a163fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:23.831289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:23.832165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:23.832934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:23.832934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:23.832934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:23.832934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:23.832934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:23.832934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:23.832934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:23.832934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:23.832934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:23.832934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:23.832934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:23.832934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:09:23.832934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 25/50] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:09:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:23.839647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304edb2e-3fbc-411c-8cab-dc3905a163fc None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:23.843426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:23.895957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 26/51] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:09:23.938589 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304edb2e-3fbc-411c-8cab-dc3905a163fc None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:23.971440 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384d126-ab31-4312-97a8-7bc48b8b0ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:23.972116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384d126-ab31-4312-97a8-7bc48b8b0ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:23.972631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384d126-ab31-4312-97a8-7bc48b8b0ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:23.972959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384d126-ab31-4312-97a8-7bc48b8b0ca1 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:23.973624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384d126-ab31-4312-97a8-7bc48b8b0ca1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:23.973956 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384d126-ab31-4312-97a8-7bc48b8b0ca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:23.975338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384d126-ab31-4312-97a8-7bc48b8b0ca1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:23.983240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 26/52] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:23.989557 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3ed69-8ac9-4af0-a235-4d502634c6e2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:24.089779 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3ed69-8ac9-4af0-a235-4d502634c6e2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:24.122955 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c7c8-cc81-45f9-a957-b98e4fda09db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:24.123584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c7c8-cc81-45f9-a957-b98e4fda09db None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:24.123872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c7c8-cc81-45f9-a957-b98e4fda09db None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:24.124180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c7c8-cc81-45f9-a957-b98e4fda09db None admin] PATH_INFO: `/v3/users/100c1706b8bd4a93b5f2764550817d64` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:24.125306 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06c7c8-cc81-45f9-a957-b98e4fda09db None admin] RBAC: Authorizing `identity:get_user(user_id=100c1706b8bd4a93b5f2764550817d64)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:24.126799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06c7c8-cc81-45f9-a957-b98e4fda09db None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:24.128951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 27/53] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:23 2022] GET /identity/v3/users/100c1706b8bd4a93b5f2764550817d64 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:24.134588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384d126-ab31-4312-97a8-7bc48b8b0ca1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:24.164379 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c7c8-cc81-45f9-a957-b98e4fda09db None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:24.172864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:24.199908 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:24.235318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384d126-ab31-4312-97a8-7bc48b8b0ca1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:24.266621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c7c8-cc81-45f9-a957-b98e4fda09db None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:24.268578 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2fed3-7715-4f05-8036-ca3de3a77a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:24.269295 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2fed3-7715-4f05-8036-ca3de3a77a2d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:24.269659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2fed3-7715-4f05-8036-ca3de3a77a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:24.269977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2fed3-7715-4f05-8036-ca3de3a77a2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:24.271107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2fed3-7715-4f05-8036-ca3de3a77a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:24.272557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2fed3-7715-4f05-8036-ca3de3a77a2d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:24.274181 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 27/54] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:09:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:24.279831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2fed3-7715-4f05-8036-ca3de3a77a2d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:24.301337 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280900b-5f89-45be-9939-fd913f7f7289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:24.302004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280900b-5f89-45be-9939-fd913f7f7289 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:24.302289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280900b-5f89-45be-9939-fd913f7f7289 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:24.302574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280900b-5f89-45be-9939-fd913f7f7289 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:24.303720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280900b-5f89-45be-9939-fd913f7f7289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:24.305169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280900b-5f89-45be-9939-fd913f7f7289 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:24.306766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 28/55] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:09:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:24.312207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280900b-5f89-45be-9939-fd913f7f7289 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:24.380049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2fed3-7715-4f05-8036-ca3de3a77a2d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:24.387453 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:24.412680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280900b-5f89-45be-9939-fd913f7f7289 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:24.414162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb78dcd-ffee-4d28-9ee0-bdf619a2ed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:24.414772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb78dcd-ffee-4d28-9ee0-bdf619a2ed33 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:24.415055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb78dcd-ffee-4d28-9ee0-bdf619a2ed33 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:24.415324 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb78dcd-ffee-4d28-9ee0-bdf619a2ed33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:24.416046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb78dcd-ffee-4d28-9ee0-bdf619a2ed33 None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.domain.id=default, user.id=100c1706b8bd4a93b5f2764550817d64) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:24.416353 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb78dcd-ffee-4d28-9ee0-bdf619a2ed33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:24.417818 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb78dcd-ffee-4d28-9ee0-bdf619a2ed33 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:24.420011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:24.427453 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 28/56] 10.222.0.57 () {56 vars in 1322 bytes} [Tue Sep 27 17:09:24 2022] GET /identity/v3/role_assignments?user.id=100c1706b8bd4a93b5f2764550817d64&scope.domain.id=default&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:24.451977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee33d5b-9a86-4ba9-999e-dc7fb02d08b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:24.452611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee33d5b-9a86-4ba9-999e-dc7fb02d08b2 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:24.452896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee33d5b-9a86-4ba9-999e-dc7fb02d08b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:24.453169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee33d5b-9a86-4ba9-999e-dc7fb02d08b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:24.453869 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee33d5b-9a86-4ba9-999e-dc7fb02d08b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:24.455361 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee33d5b-9a86-4ba9-999e-dc7fb02d08b2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:24.484670 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 29/57] 10.222.0.57 () {60 vars in 1140 bytes} [Tue Sep 27 17:09:24 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:09:26.647352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8e291-2bbe-40c3-b75d-3758ef957109 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:26.647863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8e291-2bbe-40c3-b75d-3758ef957109 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:26.647949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8e291-2bbe-40c3-b75d-3758ef957109 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:26.649246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 29/58] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:09:26.654362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec61cd-444f-4d6f-ba92-ac3e573116fa None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:26.654727 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec61cd-444f-4d6f-ba92-ac3e573116fa None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:26.654920 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec61cd-444f-4d6f-ba92-ac3e573116fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:26.673099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c8ec61cd-444f-4d6f-ba92-ac3e573116fa None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:26.674319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c8ec61cd-444f-4d6f-ba92-ac3e573116fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:26.739373 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 30/59] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:27.005849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8e291-2bbe-40c3-b75d-3758ef957109 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:27.113708 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8e291-2bbe-40c3-b75d-3758ef957109 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:27.146117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef62d2d-65e4-4998-8fc1-ae053adb305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:27.146737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef62d2d-65e4-4998-8fc1-ae053adb305f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:27.147016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef62d2d-65e4-4998-8fc1-ae053adb305f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:27.147287 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef62d2d-65e4-4998-8fc1-ae053adb305f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:27.148398 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef62d2d-65e4-4998-8fc1-ae053adb305f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:27.149951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef62d2d-65e4-4998-8fc1-ae053adb305f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:27.151507 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 30/60] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:09:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:27.157013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec61cd-444f-4d6f-ba92-ac3e573116fa None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:27.214093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:27.261178 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec61cd-444f-4d6f-ba92-ac3e573116fa None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:27.295991 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e05fc1-ac83-4f1d-8765-8b7d4f98313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:27.296595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e05fc1-ac83-4f1d-8765-8b7d4f98313c None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:27.296874 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e05fc1-ac83-4f1d-8765-8b7d4f98313c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:27.297143 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e05fc1-ac83-4f1d-8765-8b7d4f98313c None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:27.297819 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e05fc1-ac83-4f1d-8765-8b7d4f98313c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:27.299258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e05fc1-ac83-4f1d-8765-8b7d4f98313c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:27.328089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 31/61] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:09:27 2022] POST /identity/v3/users => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:09:30.657480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f540002-d364-4340-bd9c-f72937006443 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:30.658529 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f540002-d364-4340-bd9c-f72937006443 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:30.659126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f540002-d364-4340-bd9c-f72937006443 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:30.660779 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 31/62] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:30.666877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8577ad5-7259-498b-ab43-e36f1270c9a5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:30.667808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8577ad5-7259-498b-ab43-e36f1270c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:30.668278 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8577ad5-7259-498b-ab43-e36f1270c9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:30.692906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f8577ad5-7259-498b-ab43-e36f1270c9a5 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:30.694129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f8577ad5-7259-498b-ab43-e36f1270c9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:30.771140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05cd7f-d031-49d5-9931-3ac9d020fb9b None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:30.771450 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05cd7f-d031-49d5-9931-3ac9d020fb9b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:30.771689 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05cd7f-d031-49d5-9931-3ac9d020fb9b None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:30.773266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 32/63] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:30.778381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c14e33-9431-494a-9300-0060d4620b97 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:30.778670 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c14e33-9431-494a-9300-0060d4620b97 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:30.778946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c14e33-9431-494a-9300-0060d4620b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:30.789056 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 32/64] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:30.800591 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-40c14e33-9431-494a-9300-0060d4620b97 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:30.802385 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-40c14e33-9431-494a-9300-0060d4620b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:30.885643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:30.895163 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 33/65] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:09:30.982473 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72465-87d4-4c02-af18-61676aaec59a None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:30.982752 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72465-87d4-4c02-af18-61676aaec59a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:30.982962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72465-87d4-4c02-af18-61676aaec59a None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:30.984318 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 33/66] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:30.990025 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f559c82-2195-4566-a8b7-f0010ed04d3b None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:30.990316 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f559c82-2195-4566-a8b7-f0010ed04d3b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:30.990592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f559c82-2195-4566-a8b7-f0010ed04d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:31.019604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-5f559c82-2195-4566-a8b7-f0010ed04d3b None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:31.020864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5f559c82-2195-4566-a8b7-f0010ed04d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:31.109128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 34/67] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:31.187342 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db72465-87d4-4c02-af18-61676aaec59a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:31.240791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f559c82-2195-4566-a8b7-f0010ed04d3b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:31.256360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:31.345814 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db72465-87d4-4c02-af18-61676aaec59a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:31.379183 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f559c82-2195-4566-a8b7-f0010ed04d3b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:31.391863 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91e801-5b3f-4bef-b6c6-ff43c1a66b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:31.393046 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91e801-5b3f-4bef-b6c6-ff43c1a66b14 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:31.393804 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91e801-5b3f-4bef-b6c6-ff43c1a66b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:31.394222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91e801-5b3f-4bef-b6c6-ff43c1a66b14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:31.408427 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91e801-5b3f-4bef-b6c6-ff43c1a66b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:31.410044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-bc91e801-5b3f-4bef-b6c6-ff43c1a66b14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:31.414883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:31.415782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:31.416547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:31.416547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:31.416547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:31.416547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:31.416547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:31.416547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:31.416547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:31.416547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:31.416547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:31.416547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:31.416547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:31.416547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:31.416547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 34/68] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:31.419052 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4a5a2-f984-4738-8333-67f9f7421c59 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:31.419348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4a5a2-f984-4738-8333-67f9f7421c59 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:31.419629 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4a5a2-f984-4738-8333-67f9f7421c59 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:31.420980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 35/69] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:31.425906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69648e1f-0db1-435d-bb53-db849c08adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:31.426680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2db957-6d9e-4ff0-b4a3-557c98b24241 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:31.427027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2db957-6d9e-4ff0-b4a3-557c98b24241 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:31.427226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69648e1f-0db1-435d-bb53-db849c08adb4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:31.427420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2db957-6d9e-4ff0-b4a3-557c98b24241 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:31.427778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69648e1f-0db1-435d-bb53-db849c08adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:31.428157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69648e1f-0db1-435d-bb53-db849c08adb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:31.429495 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 36/70] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:31.434532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2db957-6d9e-4ff0-b4a3-557c98b24241 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:31.444893 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69648e1f-0db1-435d-bb53-db849c08adb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-69648e1f-0db1-435d-bb53-db849c08adb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:31.450693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:31.451577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:31.452335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:31.452335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:31.452335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:31.452335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:31.452335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:31.452335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:31.452335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:31.452335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:31.452335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:31.452335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:31.452335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:31.452335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:09:31.452335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:09:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:31.453806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098d25c-aadf-439e-a965-7d43112f01a5 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:31.453806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098d25c-aadf-439e-a965-7d43112f01a5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:31.454081 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098d25c-aadf-439e-a965-7d43112f01a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:31.472439 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2098d25c-aadf-439e-a965-7d43112f01a5 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:31.473646 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2098d25c-aadf-439e-a965-7d43112f01a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:31.542922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 36/72] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:31.544082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004acb52-1377-48f7-9a70-6095518af439 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:31.544370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004acb52-1377-48f7-9a70-6095518af439 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:31.544649 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004acb52-1377-48f7-9a70-6095518af439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:31.546016 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2db957-6d9e-4ff0-b4a3-557c98b24241 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:31.554089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:31.564926 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-004acb52-1377-48f7-9a70-6095518af439 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:31.566973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-004acb52-1377-48f7-9a70-6095518af439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:31.582065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a7f48-c925-462f-917f-b19850e23ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:31.582684 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a7f48-c925-462f-917f-b19850e23ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:31.582963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a7f48-c925-462f-917f-b19850e23ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:31.583237 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a7f48-c925-462f-917f-b19850e23ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:31.583900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a7f48-c925-462f-917f-b19850e23ba9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:31.584205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a7f48-c925-462f-917f-b19850e23ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:31.585591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a7f48-c925-462f-917f-b19850e23ba9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:31.594424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 37/73] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:09:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:31.595121 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a7f48-c925-462f-917f-b19850e23ba9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:31.644307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 37/74] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:31.645155 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004acb52-1377-48f7-9a70-6095518af439 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:31.699583 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:31.728140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a7f48-c925-462f-917f-b19850e23ba9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:31.756260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004acb52-1377-48f7-9a70-6095518af439 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:31.772354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd4e34-0b0d-4bec-b94a-4fe6f131f09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:31.773394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd4e34-0b0d-4bec-b94a-4fe6f131f09b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:31.773942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd4e34-0b0d-4bec-b94a-4fe6f131f09b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:31.774871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd4e34-0b0d-4bec-b94a-4fe6f131f09b None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:31.775747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd4e34-0b0d-4bec-b94a-4fe6f131f09b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:31.776246 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd4e34-0b0d-4bec-b94a-4fe6f131f09b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:31.778399 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd4e34-0b0d-4bec-b94a-4fe6f131f09b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:31.790044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 38/75] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:31.791211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd4e34-0b0d-4bec-b94a-4fe6f131f09b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:31.797063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5bcdb-4b89-4bc3-a879-1f4cd2a4d4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:31.798014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5bcdb-4b89-4bc3-a879-1f4cd2a4d4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:31.798493 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5bcdb-4b89-4bc3-a879-1f4cd2a4d4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:31.799019 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5bcdb-4b89-4bc3-a879-1f4cd2a4d4c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:31.811495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5bcdb-4b89-4bc3-a879-1f4cd2a4d4c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-aec5bcdb-4b89-4bc3-a879-1f4cd2a4d4c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:31.816985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:31.818094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:31.818852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:31.818852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:31.818852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:31.818852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:31.818852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:31.818852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:31.818852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:31.818852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:31.818852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:31.818852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:31.818852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:09:31.818852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:09:31.818852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 38/76] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:09:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:31.819494 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5bcdb-4b89-4bc3-a879-1f4cd2a4d4c6 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:31.825107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:31.908714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd4e34-0b0d-4bec-b94a-4fe6f131f09b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:31.936399 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5bcdb-4b89-4bc3-a879-1f4cd2a4d4c6 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:31.943448 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095f46b-bc5f-4eb8-aa6a-16991f9467ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:31.943918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:31.944080 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095f46b-bc5f-4eb8-aa6a-16991f9467ca None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:31.944373 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095f46b-bc5f-4eb8-aa6a-16991f9467ca None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:31.944913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095f46b-bc5f-4eb8-aa6a-16991f9467ca None admin] PATH_INFO: `/v3/users/ed4262f495154c89b56a75b3077cbe77` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:31.958106 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095f46b-bc5f-4eb8-aa6a-16991f9467ca None admin] RBAC: Authorizing `identity:get_user(user_id=ed4262f495154c89b56a75b3077cbe77)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:31.959549 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095f46b-bc5f-4eb8-aa6a-16991f9467ca None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:31.965824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 39/77] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:31 2022] GET /identity/v3/users/ed4262f495154c89b56a75b3077cbe77 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:31.965824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095f46b-bc5f-4eb8-aa6a-16991f9467ca None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:31.973374 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d94027-ad8a-4417-8587-d7dea4188899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:31.974044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d94027-ad8a-4417-8587-d7dea4188899 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:31.974338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d94027-ad8a-4417-8587-d7dea4188899 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:31.974612 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d94027-ad8a-4417-8587-d7dea4188899 None admin] PATH_INFO: `/v3/users/100c1706b8bd4a93b5f2764550817d64` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:31.975760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d94027-ad8a-4417-8587-d7dea4188899 None admin] RBAC: Authorizing `identity:get_user(user_id=100c1706b8bd4a93b5f2764550817d64)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:31.977200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d94027-ad8a-4417-8587-d7dea4188899 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:31.978813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 39/78] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:31 2022] GET /identity/v3/users/100c1706b8bd4a93b5f2764550817d64 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:31.979561 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d94027-ad8a-4417-8587-d7dea4188899 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:32.047853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:32.063570 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095f46b-bc5f-4eb8-aa6a-16991f9467ca None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:32.075449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d94027-ad8a-4417-8587-d7dea4188899 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:32.097701 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0fb55-0f45-4def-96dd-1555623470b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:32.098355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0fb55-0f45-4def-96dd-1555623470b1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:32.098638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0fb55-0f45-4def-96dd-1555623470b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:32.098909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0fb55-0f45-4def-96dd-1555623470b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:32.100008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0fb55-0f45-4def-96dd-1555623470b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:32.101459 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0fb55-0f45-4def-96dd-1555623470b1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:32.103146 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 40/79] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:09:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:32.103806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0fb55-0f45-4def-96dd-1555623470b1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:32.109779 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad5a8f-57a7-4d98-a9b0-96707e358190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:32.110415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad5a8f-57a7-4d98-a9b0-96707e358190 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:32.110694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad5a8f-57a7-4d98-a9b0-96707e358190 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:32.110963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad5a8f-57a7-4d98-a9b0-96707e358190 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:32.111623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad5a8f-57a7-4d98-a9b0-96707e358190 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:32.111968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad5a8f-57a7-4d98-a9b0-96707e358190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:32.113484 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad5a8f-57a7-4d98-a9b0-96707e358190 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:32.121464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 40/80] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:09:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:32.122271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad5a8f-57a7-4d98-a9b0-96707e358190 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:32.155859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:32.202665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0fb55-0f45-4def-96dd-1555623470b1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:32.217976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad5a8f-57a7-4d98-a9b0-96707e358190 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:32.237636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65e89a-bbb4-4e91-a19a-c23d92834d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:32.238233 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65e89a-bbb4-4e91-a19a-c23d92834d89 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:32.238520 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65e89a-bbb4-4e91-a19a-c23d92834d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:32.238796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65e89a-bbb4-4e91-a19a-c23d92834d89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:32.249119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65e89a-bbb4-4e91-a19a-c23d92834d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:32.251590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b0045-5e83-4ac2-968b-db114a35fe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:32.252196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b0045-5e83-4ac2-968b-db114a35fe69 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:32.252483 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b0045-5e83-4ac2-968b-db114a35fe69 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:32.252996 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b0045-5e83-4ac2-968b-db114a35fe69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-7a65e89a-bbb4-4e91-a19a-c23d92834d89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:32.254017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:32.254962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:32.260756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:32.260756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:32.260756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:32.260756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:32.260756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:32.260756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:32.260756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:32.260756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:32.260756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:32.260756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:32.260756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:32.260756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:32.260756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 41/81] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:32.260756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65e89a-bbb4-4e91-a19a-c23d92834d89 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:32.272563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:32.319881 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b0045-5e83-4ac2-968b-db114a35fe69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:32.321281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b0045-5e83-4ac2-968b-db114a35fe69 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:32.354147 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:32.355456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65e89a-bbb4-4e91-a19a-c23d92834d89 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:32.388626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2d62d-1abd-4b36-b12c-4d5959a234a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:32.389225 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2d62d-1abd-4b36-b12c-4d5959a234a5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:32.389507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2d62d-1abd-4b36-b12c-4d5959a234a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:32.389809 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2d62d-1abd-4b36-b12c-4d5959a234a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:32.420186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 41/82] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:09:32.421345 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b0045-5e83-4ac2-968b-db114a35fe69 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:32.464011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2d62d-1abd-4b36-b12c-4d5959a234a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:32.465526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2d62d-1abd-4b36-b12c-4d5959a234a5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:32.480597 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:32.524396 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b0045-5e83-4ac2-968b-db114a35fe69 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:32.557472 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb0b85-bc81-43e6-a648-e253373dbf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:32.558121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb0b85-bc81-43e6-a648-e253373dbf46 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:32.558402 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb0b85-bc81-43e6-a648-e253373dbf46 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:32.558676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb0b85-bc81-43e6-a648-e253373dbf46 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:32.559322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb0b85-bc81-43e6-a648-e253373dbf46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:32.560752 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb0b85-bc81-43e6-a648-e253373dbf46 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:32.563265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 42/83] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:09:32.564098 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2d62d-1abd-4b36-b12c-4d5959a234a5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:32.574325 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:32.590628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 42/84] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:09:32 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:09:32.594714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb0b85-bc81-43e6-a648-e253373dbf46 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:32.679353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2d62d-1abd-4b36-b12c-4d5959a234a5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:32.693948 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:32.717066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4b800-8e6c-4dcc-9d02-98af724ca717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:32.717710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb0b85-bc81-43e6-a648-e253373dbf46 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:32.718163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4b800-8e6c-4dcc-9d02-98af724ca717 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:32.718163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4b800-8e6c-4dcc-9d02-98af724ca717 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:32.718291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4b800-8e6c-4dcc-9d02-98af724ca717 None admin] PATH_INFO: `/v3/users/ed4262f495154c89b56a75b3077cbe77` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:32.719535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4b800-8e6c-4dcc-9d02-98af724ca717 None admin] RBAC: Authorizing `identity:get_user(user_id=ed4262f495154c89b56a75b3077cbe77)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:32.721026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4b800-8e6c-4dcc-9d02-98af724ca717 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:32.728011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 43/85] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:32 2022] GET /identity/v3/users/ed4262f495154c89b56a75b3077cbe77 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:32.728011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4b800-8e6c-4dcc-9d02-98af724ca717 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:32.759277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa50237-c8c6-4512-bbd1-8bd5c63de2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:32.759898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa50237-c8c6-4512-bbd1-8bd5c63de2dd None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:32.760178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa50237-c8c6-4512-bbd1-8bd5c63de2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:32.760452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa50237-c8c6-4512-bbd1-8bd5c63de2dd None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:32.761119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa50237-c8c6-4512-bbd1-8bd5c63de2dd None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:32.761423 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa50237-c8c6-4512-bbd1-8bd5c63de2dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:32.762876 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa50237-c8c6-4512-bbd1-8bd5c63de2dd None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:32.772829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 43/86] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:09:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:32.773601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa50237-c8c6-4512-bbd1-8bd5c63de2dd None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:32.840379 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:32.849942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4b800-8e6c-4dcc-9d02-98af724ca717 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:32.891235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa50237-c8c6-4512-bbd1-8bd5c63de2dd None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:32.891447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e99e7-634b-4406-a70a-7239135ffffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:32.891447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e99e7-634b-4406-a70a-7239135ffffb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:32.891895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e99e7-634b-4406-a70a-7239135ffffb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:32.892107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e99e7-634b-4406-a70a-7239135ffffb None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:32.894899 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e99e7-634b-4406-a70a-7239135ffffb None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:32.896387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e99e7-634b-4406-a70a-7239135ffffb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:32.898737 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 44/87] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:32 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:32.899720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e99e7-634b-4406-a70a-7239135ffffb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:32.934128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f0caa-5dad-4045-9f75-c856b032778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:32.935118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f0caa-5dad-4045-9f75-c856b032778e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:32.935544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f0caa-5dad-4045-9f75-c856b032778e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:32.935823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f0caa-5dad-4045-9f75-c856b032778e None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:32.937152 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f0caa-5dad-4045-9f75-c856b032778e None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:32.938980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f0caa-5dad-4045-9f75-c856b032778e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:32.941431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 44/88] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:32 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:32.942435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f0caa-5dad-4045-9f75-c856b032778e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:32.959674 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:33.017198 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e99e7-634b-4406-a70a-7239135ffffb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:33.055115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d145c4-b34c-45d5-aff8-223e006cfbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:33.055733 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d145c4-b34c-45d5-aff8-223e006cfbda None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:33.056162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d145c4-b34c-45d5-aff8-223e006cfbda None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:33.056442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d145c4-b34c-45d5-aff8-223e006cfbda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:33.072663 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f0caa-5dad-4045-9f75-c856b032778e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:33.098828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:33.113596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1f5d3-6e9d-48e9-b122-f5b2ff7ef3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:33.114578 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1f5d3-6e9d-48e9-b122-f5b2ff7ef3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:33.114955 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1f5d3-6e9d-48e9-b122-f5b2ff7ef3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:33.115328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1f5d3-6e9d-48e9-b122-f5b2ff7ef3e9 None admin] PATH_INFO: `/v3/users/ed4262f495154c89b56a75b3077cbe77` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:33.116701 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1f5d3-6e9d-48e9-b122-f5b2ff7ef3e9 None admin] RBAC: Authorizing `identity:get_user(user_id=ed4262f495154c89b56a75b3077cbe77)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:33.118480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1f5d3-6e9d-48e9-b122-f5b2ff7ef3e9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:33.120606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 45/89] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:32 2022] GET /identity/v3/users/ed4262f495154c89b56a75b3077cbe77 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:33.121501 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1f5d3-6e9d-48e9-b122-f5b2ff7ef3e9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:33.151917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d145c4-b34c-45d5-aff8-223e006cfbda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:33.154342 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d145c4-b34c-45d5-aff8-223e006cfbda None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:33.220562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:33.236326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1f5d3-6e9d-48e9-b122-f5b2ff7ef3e9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:33.279353 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b2ab7-bcef-42d5-964c-83a8ca151619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:33.280274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b2ab7-bcef-42d5-964c-83a8ca151619 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:33.280980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b2ab7-bcef-42d5-964c-83a8ca151619 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:33.281433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b2ab7-bcef-42d5-964c-83a8ca151619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:33.282501 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b2ab7-bcef-42d5-964c-83a8ca151619 None admin] RBAC: Adding query filter params (role.id=1c0bdbdf6a98487cac86e3de530b11d2, scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f, user.id=ed4262f495154c89b56a75b3077cbe77) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:33.282820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b2ab7-bcef-42d5-964c-83a8ca151619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:33.285066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b2ab7-bcef-42d5-964c-83a8ca151619 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:33.295553 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 46/90] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:33 2022] GET /identity/v3/role_assignments?user.id=ed4262f495154c89b56a75b3077cbe77&scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f&role.id=1c0bdbdf6a98487cac86e3de530b11d2 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:33.295553 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b2ab7-bcef-42d5-964c-83a8ca151619 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:33.295818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 45/91] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:09:33.296559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d145c4-b34c-45d5-aff8-223e006cfbda None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:33.364528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:33.429973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b2ab7-bcef-42d5-964c-83a8ca151619 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:33.488593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5eeb0c-ea4e-4258-925d-265c1e5ffd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:33.489616 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eeb0c-ea4e-4258-925d-265c1e5ffd25 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:33.490338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eeb0c-ea4e-4258-925d-265c1e5ffd25 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:33.492338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eeb0c-ea4e-4258-925d-265c1e5ffd25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:33.493336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5eeb0c-ea4e-4258-925d-265c1e5ffd25 None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f, user.id=100c1706b8bd4a93b5f2764550817d64) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:33.495048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5eeb0c-ea4e-4258-925d-265c1e5ffd25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:33.498401 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5eeb0c-ea4e-4258-925d-265c1e5ffd25 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:33.512482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 47/92] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:33 2022] GET /identity/v3/role_assignments?user.id=100c1706b8bd4a93b5f2764550817d64&scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:33.513625 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5eeb0c-ea4e-4258-925d-265c1e5ffd25 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:33.534706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d145c4-b34c-45d5-aff8-223e006cfbda None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:33.590909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e7662-92ed-4c85-8a3e-dba3430d9d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:33.591933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e7662-92ed-4c85-8a3e-dba3430d9d26 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:33.592406 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e7662-92ed-4c85-8a3e-dba3430d9d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:33.594064 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e7662-92ed-4c85-8a3e-dba3430d9d26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:33.640647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:33.741714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5eeb0c-ea4e-4258-925d-265c1e5ffd25 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:33.752314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e7662-92ed-4c85-8a3e-dba3430d9d26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:33.754759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e7662-92ed-4c85-8a3e-dba3430d9d26 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:33.798078 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:33.807982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ad153-0825-4431-8dbf-38724afdc712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:33.807982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ad153-0825-4431-8dbf-38724afdc712 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:33.807982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ad153-0825-4431-8dbf-38724afdc712 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:33.807982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ad153-0825-4431-8dbf-38724afdc712 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:33.810627 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ad153-0825-4431-8dbf-38724afdc712 None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:33.815922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ad153-0825-4431-8dbf-38724afdc712 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:33.818069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 48/93] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:33 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:33.827471 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ad153-0825-4431-8dbf-38724afdc712 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:33.960953 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 46/94] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:09:33.966800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e7662-92ed-4c85-8a3e-dba3430d9d26 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:33.980453 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ad153-0825-4431-8dbf-38724afdc712 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:34.055712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7163707-3964-4b11-a4f4-ec27689f72cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:34.056347 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7163707-3964-4b11-a4f4-ec27689f72cd None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:34.056633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7163707-3964-4b11-a4f4-ec27689f72cd None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:34.056912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7163707-3964-4b11-a4f4-ec27689f72cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:34.057732 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7163707-3964-4b11-a4f4-ec27689f72cd None admin] RBAC: Adding query filter params (role.id=a1b50a29e5e4419db517dfaf3d70c19f, scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f, user.id=ed4262f495154c89b56a75b3077cbe77) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:34.058199 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7163707-3964-4b11-a4f4-ec27689f72cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:34.059660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7163707-3964-4b11-a4f4-ec27689f72cd None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:34.065530 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:34.066734 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 49/95] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:33 2022] GET /identity/v3/role_assignments?user.id=ed4262f495154c89b56a75b3077cbe77&scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f&role.id=a1b50a29e5e4419db517dfaf3d70c19f => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:34.152953 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e7662-92ed-4c85-8a3e-dba3430d9d26 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:34.202780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77928a7c-6c61-4b75-b6db-126ef91ab173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:34.203426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77928a7c-6c61-4b75-b6db-126ef91ab173 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:34.203708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77928a7c-6c61-4b75-b6db-126ef91ab173 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:34.203986 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77928a7c-6c61-4b75-b6db-126ef91ab173 None admin] PATH_INFO: `/v3/projects/03e8ee58b8874a24a158580e974832c3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:34.206598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77928a7c-6c61-4b75-b6db-126ef91ab173 None admin] RBAC: Authorizing `identity:get_project(project_id=03e8ee58b8874a24a158580e974832c3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:34.208064 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77928a7c-6c61-4b75-b6db-126ef91ab173 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:34.209978 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 47/96] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:33 2022] GET /identity/v3/projects/03e8ee58b8874a24a158580e974832c3 => generated 312 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:34.216453 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7163707-3964-4b11-a4f4-ec27689f72cd None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:34.294430 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:34.352107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7163707-3964-4b11-a4f4-ec27689f72cd None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:34.386994 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eef188-9c96-4cc6-8225-7fc4307f359f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:34.387610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eef188-9c96-4cc6-8225-7fc4307f359f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:34.387893 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eef188-9c96-4cc6-8225-7fc4307f359f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:34.388168 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eef188-9c96-4cc6-8225-7fc4307f359f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:34.388908 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eef188-9c96-4cc6-8225-7fc4307f359f None admin] RBAC: Adding query filter params (role.id=1c0bdbdf6a98487cac86e3de530b11d2, scope.project.id=03e8ee58b8874a24a158580e974832c3, user.id=ed4262f495154c89b56a75b3077cbe77) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:34.389221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eef188-9c96-4cc6-8225-7fc4307f359f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:34.390710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eef188-9c96-4cc6-8225-7fc4307f359f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:34.400664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 50/97] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:34 2022] GET /identity/v3/role_assignments?user.id=ed4262f495154c89b56a75b3077cbe77&scope.project.id=03e8ee58b8874a24a158580e974832c3&role.id=1c0bdbdf6a98487cac86e3de530b11d2 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:35.562949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b596d50-5ab7-4b67-9af2-a1150e7cb6e2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:35.566377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b596d50-5ab7-4b67-9af2-a1150e7cb6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:35.566377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b596d50-5ab7-4b67-9af2-a1150e7cb6e2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:35.566939 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 48/98] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:35.572995 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5425a-65ec-4b7d-9f29-32b810017cfd None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:35.573451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5425a-65ec-4b7d-9f29-32b810017cfd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:35.573646 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5425a-65ec-4b7d-9f29-32b810017cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:35.577512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea9323-c0b6-4c6b-8466-da34a68b03da None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:35.577850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea9323-c0b6-4c6b-8466-da34a68b03da None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:35.578131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea9323-c0b6-4c6b-8466-da34a68b03da None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:35.582048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 49/99] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:35.587994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990284e-06a4-4fe0-b6a3-d4b42945a2d8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:35.588279 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990284e-06a4-4fe0-b6a3-d4b42945a2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:35.588555 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990284e-06a4-4fe0-b6a3-d4b42945a2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:35.610705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-9cc5425a-65ec-4b7d-9f29-32b810017cfd None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:35.612031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9cc5425a-65ec-4b7d-9f29-32b810017cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:35.625921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7990284e-06a4-4fe0-b6a3-d4b42945a2d8 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:35.627123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7990284e-06a4-4fe0-b6a3-d4b42945a2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:35.744673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 51/100] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:35.763651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 50/101] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:36.206875 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5425a-65ec-4b7d-9f29-32b810017cfd None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:36.254218 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:36.310173 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5425a-65ec-4b7d-9f29-32b810017cfd None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:36.314203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990284e-06a4-4fe0-b6a3-d4b42945a2d8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:36.381712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fadaaf-9d87-45f7-8584-d7315591da34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:36.381712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fadaaf-9d87-45f7-8584-d7315591da34 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:36.381712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fadaaf-9d87-45f7-8584-d7315591da34 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:36.381712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fadaaf-9d87-45f7-8584-d7315591da34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:36.382109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fadaaf-9d87-45f7-8584-d7315591da34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:36.383029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fadaaf-9d87-45f7-8584-d7315591da34 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:36.384778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 52/102] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:09:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:36.392237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fadaaf-9d87-45f7-8584-d7315591da34 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:36.405480 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:36.520723 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990284e-06a4-4fe0-b6a3-d4b42945a2d8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:36.562403 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fadaaf-9d87-45f7-8584-d7315591da34 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:36.579299 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:36.606080 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb40a9-6f7e-485a-94cb-db0a6c6f3fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:36.606705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb40a9-6f7e-485a-94cb-db0a6c6f3fd7 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:36.606983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb40a9-6f7e-485a-94cb-db0a6c6f3fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:36.607354 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb40a9-6f7e-485a-94cb-db0a6c6f3fd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:36.608018 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb40a9-6f7e-485a-94cb-db0a6c6f3fd7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:36.609461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb40a9-6f7e-485a-94cb-db0a6c6f3fd7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:36.610386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7656eb-1211-42e7-8d31-3f63ce1ca6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:36.611042 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7656eb-1211-42e7-8d31-3f63ce1ca6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:36.611326 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7656eb-1211-42e7-8d31-3f63ce1ca6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:36.612134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7656eb-1211-42e7-8d31-3f63ce1ca6d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:36.634874 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7656eb-1211-42e7-8d31-3f63ce1ca6d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2f7656eb-1211-42e7-8d31-3f63ce1ca6d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:36.639688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:36.640532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:36.641651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:36.641651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:36.641651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:36.641651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:36.641651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:36.641651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:36.641651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:36.641651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:36.641651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:36.641651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:36.641651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:09:36.641651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:36.641651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 51/103] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:36.650950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7656eb-1211-42e7-8d31-3f63ce1ca6d8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:36.651986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 53/104] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Sep 27 17:09:36 2022] POST /identity/v3/projects => generated 302 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:09:36.801317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b69c2-acde-42b5-9fb6-bbc8447031e7 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:36.801611 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b69c2-acde-42b5-9fb6-bbc8447031e7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:36.801938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b69c2-acde-42b5-9fb6-bbc8447031e7 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:36.803450 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 54/105] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:36.809756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90ab74-70aa-4d57-acd3-b19e4b97dd12 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:36.810170 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90ab74-70aa-4d57-acd3-b19e4b97dd12 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:36.810447 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90ab74-70aa-4d57-acd3-b19e4b97dd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:36.811745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7656eb-1211-42e7-8d31-3f63ce1ca6d8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:36.820529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:36.847410 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-9c90ab74-70aa-4d57-acd3-b19e4b97dd12 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:36.848827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9c90ab74-70aa-4d57-acd3-b19e4b97dd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:36.876021 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6117d53-055c-47fb-a596-f77c1819d0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:36.876665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6117d53-055c-47fb-a596-f77c1819d0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:36.876949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6117d53-055c-47fb-a596-f77c1819d0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:36.877796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6117d53-055c-47fb-a596-f77c1819d0f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:36.878794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6117d53-055c-47fb-a596-f77c1819d0f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:36.879271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6117d53-055c-47fb-a596-f77c1819d0f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:36.880973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6117d53-055c-47fb-a596-f77c1819d0f2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:36.898773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 52/106] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:09:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:36.904532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6117d53-055c-47fb-a596-f77c1819d0f2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:37.020584 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 55/107] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:37.031187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6117d53-055c-47fb-a596-f77c1819d0f2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:37.072924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a6571-8d1d-4fcf-a19a-3f07e77be0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:37.073495 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a6571-8d1d-4fcf-a19a-3f07e77be0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:37.073835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a6571-8d1d-4fcf-a19a-3f07e77be0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:37.074118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a6571-8d1d-4fcf-a19a-3f07e77be0f0 None admin] PATH_INFO: `/v3/users/94c96260337d428383e28c99c3a75646` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:37.091378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a6571-8d1d-4fcf-a19a-3f07e77be0f0 None admin] RBAC: Authorizing `identity:get_user(user_id=94c96260337d428383e28c99c3a75646)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:37.092948 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a6571-8d1d-4fcf-a19a-3f07e77be0f0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:37.094988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 53/108] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:36 2022] GET /identity/v3/users/94c96260337d428383e28c99c3a75646 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:37.101394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90ab74-70aa-4d57-acd3-b19e4b97dd12 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:37.193907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de11d-d118-43be-8957-5f3ea30773c6 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:37.194220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de11d-d118-43be-8957-5f3ea30773c6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:37.194469 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de11d-d118-43be-8957-5f3ea30773c6 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:37.195836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 54/109] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:09:37.201206 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adbe18-3de5-437f-b65d-6c9b48b0bc59 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:37.201497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adbe18-3de5-437f-b65d-6c9b48b0bc59 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:37.201806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adbe18-3de5-437f-b65d-6c9b48b0bc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:37.224588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:37.233005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-45adbe18-3de5-437f-b65d-6c9b48b0bc59 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:37.234085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90ab74-70aa-4d57-acd3-b19e4b97dd12 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:37.235494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-45adbe18-3de5-437f-b65d-6c9b48b0bc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:37.276098 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:37.312135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7c083-ecb2-47ed-8861-6e4f297d4a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:37.312771 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7c083-ecb2-47ed-8861-6e4f297d4a26 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:37.313064 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7c083-ecb2-47ed-8861-6e4f297d4a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:37.313351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7c083-ecb2-47ed-8861-6e4f297d4a26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:37.387331 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 55/110] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:09:37.388608 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0c97c-966a-4dc5-80a7-27dbbb66b86f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:37.388901 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0c97c-966a-4dc5-80a7-27dbbb66b86f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:37.389183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0c97c-966a-4dc5-80a7-27dbbb66b86f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:37.393928 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 56/111] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:37.409131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aee3b3-27bc-42e6-9a69-25f9d9cc9749 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:37.409415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aee3b3-27bc-42e6-9a69-25f9d9cc9749 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:37.409743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aee3b3-27bc-42e6-9a69-25f9d9cc9749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:37.485724 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-49aee3b3-27bc-42e6-9a69-25f9d9cc9749 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:37.485724 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-49aee3b3-27bc-42e6-9a69-25f9d9cc9749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:37.499241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7c083-ecb2-47ed-8861-6e4f297d4a26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:37.500757 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7c083-ecb2-47ed-8861-6e4f297d4a26 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:37.663372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 57/112] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:09:37.664061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aee3b3-27bc-42e6-9a69-25f9d9cc9749 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:37.673709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:37.678815 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 56/113] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:09:37.681518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d2a48-573e-45be-933d-581e3703779e None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:37.681518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d2a48-573e-45be-933d-581e3703779e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:37.681518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d2a48-573e-45be-933d-581e3703779e None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:37.687604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 57/114] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:37.688397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d2a48-573e-45be-933d-581e3703779e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:37.818045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d2a48-573e-45be-933d-581e3703779e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:37.852663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:37.865641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138ce1d-ec31-4a8a-b2d8-a8f14cfd2f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:37.866308 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138ce1d-ec31-4a8a-b2d8-a8f14cfd2f25 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:37.866593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138ce1d-ec31-4a8a-b2d8-a8f14cfd2f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:37.866871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138ce1d-ec31-4a8a-b2d8-a8f14cfd2f25 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:37.868409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138ce1d-ec31-4a8a-b2d8-a8f14cfd2f25 None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:37.869965 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138ce1d-ec31-4a8a-b2d8-a8f14cfd2f25 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:37.876885 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 58/115] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:37 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:37.877397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aee3b3-27bc-42e6-9a69-25f9d9cc9749 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:37.878643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1cc7e-e917-4eb1-a65e-929ec54679ae None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:37.878939 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1cc7e-e917-4eb1-a65e-929ec54679ae None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:37.880828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1cc7e-e917-4eb1-a65e-929ec54679ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:37.918783 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-bdd1cc7e-e917-4eb1-a65e-929ec54679ae None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:37.920755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bdd1cc7e-e917-4eb1-a65e-929ec54679ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:37.926590 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0baeb5-a2f0-47e4-a0fb-bbeb423c661d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:37.930641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0baeb5-a2f0-47e4-a0fb-bbeb423c661d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:37.930928 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0baeb5-a2f0-47e4-a0fb-bbeb423c661d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:37.931205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0baeb5-a2f0-47e4-a0fb-bbeb423c661d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:37.946957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0baeb5-a2f0-47e4-a0fb-bbeb423c661d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8e0baeb5-a2f0-47e4-a0fb-bbeb423c661d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:37.952600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:37.954909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:37.956419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:37.956419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:37.956419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:37.956419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:37.956419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:37.956419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:37.956419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:37.956419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:37.956419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:37.956419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:37.956419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:37.956419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:37.956419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 58/116] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:37.960627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0baeb5-a2f0-47e4-a0fb-bbeb423c661d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:38.010812 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:38.023665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 59/117] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:38.024614 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1cc7e-e917-4eb1-a65e-929ec54679ae None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:38.086839 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0baeb5-a2f0-47e4-a0fb-bbeb423c661d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:38.129439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f87eb-41d8-4e86-abe6-7e22e3f091ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:38.130110 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f87eb-41d8-4e86-abe6-7e22e3f091ef None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:38.130393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f87eb-41d8-4e86-abe6-7e22e3f091ef None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:38.130674 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f87eb-41d8-4e86-abe6-7e22e3f091ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:38.141903 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f87eb-41d8-4e86-abe6-7e22e3f091ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:38.146813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1cc7e-e917-4eb1-a65e-929ec54679ae None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-894f87eb-41d8-4e86-abe6-7e22e3f091ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:38.147736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:38.148758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:38.149646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:38.149646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:38.149646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:38.149646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:38.149646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:38.149646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:38.149646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:38.149646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:38.149646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:38.149646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:38.149646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:38.149646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:38.149646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 59/118] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:09:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:38.150542 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f87eb-41d8-4e86-abe6-7e22e3f091ef None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:38.160821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:38.195185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471b7b6-f32a-4d8c-b44e-57e3b5ec082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:38.196184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471b7b6-f32a-4d8c-b44e-57e3b5ec082f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:38.196668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471b7b6-f32a-4d8c-b44e-57e3b5ec082f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:38.197143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471b7b6-f32a-4d8c-b44e-57e3b5ec082f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:38.198118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471b7b6-f32a-4d8c-b44e-57e3b5ec082f None admin] RBAC: Adding query filter params (role.id=3d56d71a94cf4ce1887d1b743039657b, scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f, user.id=94c96260337d428383e28c99c3a75646) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:38.198632 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471b7b6-f32a-4d8c-b44e-57e3b5ec082f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:38.200380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471b7b6-f32a-4d8c-b44e-57e3b5ec082f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:38.206816 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 60/119] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:38 2022] GET /identity/v3/role_assignments?user.id=94c96260337d428383e28c99c3a75646&scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f&role.id=3d56d71a94cf4ce1887d1b743039657b => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:38.207996 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471b7b6-f32a-4d8c-b44e-57e3b5ec082f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:38.274503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:38.314616 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f87eb-41d8-4e86-abe6-7e22e3f091ef None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:38.334394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471b7b6-f32a-4d8c-b44e-57e3b5ec082f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:38.354250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e35c4-b5dc-4eff-b016-91d812e29db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:38.354874 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e35c4-b5dc-4eff-b016-91d812e29db9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:38.355164 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e35c4-b5dc-4eff-b016-91d812e29db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:38.355437 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e35c4-b5dc-4eff-b016-91d812e29db9 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:38.356203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e35c4-b5dc-4eff-b016-91d812e29db9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:38.356416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e35c4-b5dc-4eff-b016-91d812e29db9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:38.357934 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e35c4-b5dc-4eff-b016-91d812e29db9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:38.372216 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 60/120] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:09:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:38.372216 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e35c4-b5dc-4eff-b016-91d812e29db9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:38.386734 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13fb56-20e4-43f0-9834-00710336314f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:38.388192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13fb56-20e4-43f0-9834-00710336314f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:38.388925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13fb56-20e4-43f0-9834-00710336314f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:38.389360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13fb56-20e4-43f0-9834-00710336314f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:38.404173 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13fb56-20e4-43f0-9834-00710336314f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-7a13fb56-20e4-43f0-9834-00710336314f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:38.411659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:38.412593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:38.413380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:38.413380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:38.413380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:38.413380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:38.413380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:38.413380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:38.413380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:38.413380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:38.413380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:38.413380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:38.413380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:09:38.413380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:09:38.420073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 61/121] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:09:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:38.420073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13fb56-20e4-43f0-9834-00710336314f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:38.459891 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:38.508016 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e35c4-b5dc-4eff-b016-91d812e29db9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:38.538952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13fb56-20e4-43f0-9834-00710336314f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:38.546546 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03ebd5-8fda-4992-b83d-a3b282b24367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:38.547229 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03ebd5-8fda-4992-b83d-a3b282b24367 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:38.547514 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03ebd5-8fda-4992-b83d-a3b282b24367 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:38.547782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03ebd5-8fda-4992-b83d-a3b282b24367 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:38.548454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03ebd5-8fda-4992-b83d-a3b282b24367 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:38.549229 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03ebd5-8fda-4992-b83d-a3b282b24367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:38.551470 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03ebd5-8fda-4992-b83d-a3b282b24367 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:38.558884 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:38.562516 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 61/122] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:38.563147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03ebd5-8fda-4992-b83d-a3b282b24367 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:38.593038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442fd8f-a989-49cc-b98c-c752e6e724b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:38.594023 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442fd8f-a989-49cc-b98c-c752e6e724b3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:38.594487 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442fd8f-a989-49cc-b98c-c752e6e724b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:38.594987 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442fd8f-a989-49cc-b98c-c752e6e724b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:38.612774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442fd8f-a989-49cc-b98c-c752e6e724b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-d442fd8f-a989-49cc-b98c-c752e6e724b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:38.619246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:38.620102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:38.620866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:38.620866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:38.620866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:38.620866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:38.620866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:38.620866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:38.620866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:38.620866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:38.620866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:38.620866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:38.620866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:38.620866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:09:38.629104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 62/123] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:38.629104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442fd8f-a989-49cc-b98c-c752e6e724b3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:38.698341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03ebd5-8fda-4992-b83d-a3b282b24367 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:38.744876 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:38.752226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442fd8f-a989-49cc-b98c-c752e6e724b3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:38.754535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27a5b7-90af-491d-b516-0fb7d93378d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:38.756221 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27a5b7-90af-491d-b516-0fb7d93378d5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:38.756649 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27a5b7-90af-491d-b516-0fb7d93378d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:38.757093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27a5b7-90af-491d-b516-0fb7d93378d5 None admin] PATH_INFO: `/v3/users/ed4262f495154c89b56a75b3077cbe77` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:38.758403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27a5b7-90af-491d-b516-0fb7d93378d5 None admin] RBAC: Authorizing `identity:get_user(user_id=ed4262f495154c89b56a75b3077cbe77)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:38.760075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27a5b7-90af-491d-b516-0fb7d93378d5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:38.762821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 62/124] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:38 2022] GET /identity/v3/users/ed4262f495154c89b56a75b3077cbe77 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:38.763599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27a5b7-90af-491d-b516-0fb7d93378d5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:38.788968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d349c02-58dc-436c-a429-8b8a99cde9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:38.789583 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d349c02-58dc-436c-a429-8b8a99cde9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:38.789894 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d349c02-58dc-436c-a429-8b8a99cde9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:38.790167 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d349c02-58dc-436c-a429-8b8a99cde9a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:38.790931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d349c02-58dc-436c-a429-8b8a99cde9a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:38.791238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d349c02-58dc-436c-a429-8b8a99cde9a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:38.792652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d349c02-58dc-436c-a429-8b8a99cde9a7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:38.801243 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 63/125] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:09:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:38.802092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d349c02-58dc-436c-a429-8b8a99cde9a7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:38.850124 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:38.872334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27a5b7-90af-491d-b516-0fb7d93378d5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:38.908900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f534279-4299-45f2-aa66-6454d528312e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:38.909615 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f534279-4299-45f2-aa66-6454d528312e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:38.909931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f534279-4299-45f2-aa66-6454d528312e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:38.910209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f534279-4299-45f2-aa66-6454d528312e None admin] PATH_INFO: `/v3/users/100c1706b8bd4a93b5f2764550817d64` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:38.911438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f534279-4299-45f2-aa66-6454d528312e None admin] RBAC: Authorizing `identity:get_user(user_id=100c1706b8bd4a93b5f2764550817d64)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:38.913619 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f534279-4299-45f2-aa66-6454d528312e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:38.916372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 63/126] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:38 2022] GET /identity/v3/users/100c1706b8bd4a93b5f2764550817d64 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:38.917361 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f534279-4299-45f2-aa66-6454d528312e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:38.919840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d349c02-58dc-436c-a429-8b8a99cde9a7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:38.960154 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0442aa8-5019-445c-ac3d-c607c447398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:38.961271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0442aa8-5019-445c-ac3d-c607c447398a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:38.962117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0442aa8-5019-445c-ac3d-c607c447398a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:38.962645 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0442aa8-5019-445c-ac3d-c607c447398a None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:38.963566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0442aa8-5019-445c-ac3d-c607c447398a None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:38.964069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0442aa8-5019-445c-ac3d-c607c447398a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:38.965711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0442aa8-5019-445c-ac3d-c607c447398a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:38.975927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 64/127] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:09:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:38.977033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0442aa8-5019-445c-ac3d-c607c447398a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:39.007035 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:39.054813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f534279-4299-45f2-aa66-6454d528312e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:39.094033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:39.097717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0442aa8-5019-445c-ac3d-c607c447398a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:39.104508 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd83d7-c577-4167-a7c1-e6a2b6603c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:39.105147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd83d7-c577-4167-a7c1-e6a2b6603c8d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:39.105429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd83d7-c577-4167-a7c1-e6a2b6603c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:39.105722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd83d7-c577-4167-a7c1-e6a2b6603c8d None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:39.106873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd83d7-c577-4167-a7c1-e6a2b6603c8d None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:39.108867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd83d7-c577-4167-a7c1-e6a2b6603c8d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:39.111031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 64/128] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:38 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:39.113283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd83d7-c577-4167-a7c1-e6a2b6603c8d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:39.137937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957d35d-0a3c-4a2a-ab24-c872daeba0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:39.138974 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957d35d-0a3c-4a2a-ab24-c872daeba0da None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:39.139505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957d35d-0a3c-4a2a-ab24-c872daeba0da None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:39.139981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957d35d-0a3c-4a2a-ab24-c872daeba0da None admin] PATH_INFO: `/v3/users/ed4262f495154c89b56a75b3077cbe77` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:39.141336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957d35d-0a3c-4a2a-ab24-c872daeba0da None admin] RBAC: Authorizing `identity:get_user(user_id=ed4262f495154c89b56a75b3077cbe77)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:39.143138 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957d35d-0a3c-4a2a-ab24-c872daeba0da None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:39.145227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 65/129] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:38 2022] GET /identity/v3/users/ed4262f495154c89b56a75b3077cbe77 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:39.146273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957d35d-0a3c-4a2a-ab24-c872daeba0da None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:39.232785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd83d7-c577-4167-a7c1-e6a2b6603c8d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:39.269574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa0ec5-367c-41ed-af66-06729da49303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:39.270593 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa0ec5-367c-41ed-af66-06729da49303 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:39.271076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa0ec5-367c-41ed-af66-06729da49303 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:39.271551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa0ec5-367c-41ed-af66-06729da49303 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:39.272873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa0ec5-367c-41ed-af66-06729da49303 None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:39.274542 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa0ec5-367c-41ed-af66-06729da49303 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:39.277075 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957d35d-0a3c-4a2a-ab24-c872daeba0da None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:39.277316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 65/130] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:39 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:39.278343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa0ec5-367c-41ed-af66-06729da49303 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:39.281215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:39.318859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f70ebf-979b-4f31-a11a-cf31110e37e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:39.320363 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f70ebf-979b-4f31-a11a-cf31110e37e2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:39.320655 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f70ebf-979b-4f31-a11a-cf31110e37e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:39.320934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f70ebf-979b-4f31-a11a-cf31110e37e2 None admin] PATH_INFO: `/v3/users/ed4262f495154c89b56a75b3077cbe77` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:39.322109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f70ebf-979b-4f31-a11a-cf31110e37e2 None admin] RBAC: Authorizing `identity:get_user(user_id=ed4262f495154c89b56a75b3077cbe77)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:39.323558 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f70ebf-979b-4f31-a11a-cf31110e37e2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:39.325306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 66/131] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:39 2022] GET /identity/v3/users/ed4262f495154c89b56a75b3077cbe77 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:39.329899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f70ebf-979b-4f31-a11a-cf31110e37e2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:39.369356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:39.399053 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa0ec5-367c-41ed-af66-06729da49303 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:39.438235 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636310e-6c6e-4f89-8738-726baa07a017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:39.438830 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636310e-6c6e-4f89-8738-726baa07a017 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:39.439168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636310e-6c6e-4f89-8738-726baa07a017 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:39.439443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636310e-6c6e-4f89-8738-726baa07a017 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f/users/ed4262f495154c89b56a75b3077cbe77/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:39.442336 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636310e-6c6e-4f89-8738-726baa07a017 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f, user_id=ed4262f495154c89b56a75b3077cbe77, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:39.443553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636310e-6c6e-4f89-8738-726baa07a017 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:39.459878 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f70ebf-979b-4f31-a11a-cf31110e37e2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:39.461112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 66/132] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:09:39 2022] PUT /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f/users/ed4262f495154c89b56a75b3077cbe77/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:09:39.462530 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636310e-6c6e-4f89-8738-726baa07a017 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:39.503517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fa644-9315-496c-9721-04c0748e5fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:39.504586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fa644-9315-496c-9721-04c0748e5fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:39.505097 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fa644-9315-496c-9721-04c0748e5fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:39.505579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fa644-9315-496c-9721-04c0748e5fc1 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:39.507268 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fa644-9315-496c-9721-04c0748e5fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:39.509051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fa644-9315-496c-9721-04c0748e5fc1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:39.511181 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 67/133] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:39 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:39.512247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fa644-9315-496c-9721-04c0748e5fc1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:39.551973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:39.597383 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636310e-6c6e-4f89-8738-726baa07a017 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:39.635159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe926a-554a-44ce-aab8-e69ab21de8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:39.635853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe926a-554a-44ce-aab8-e69ab21de8dc None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:39.636134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe926a-554a-44ce-aab8-e69ab21de8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:39.636414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe926a-554a-44ce-aab8-e69ab21de8dc None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f/users/100c1706b8bd4a93b5f2764550817d64/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:39.639287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe926a-554a-44ce-aab8-e69ab21de8dc None admin] RBAC: Authorizing `identity:create_grant(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f, user_id=100c1706b8bd4a93b5f2764550817d64, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:39.640272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe926a-554a-44ce-aab8-e69ab21de8dc None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:39.656863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fa644-9315-496c-9721-04c0748e5fc1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:39.661183 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:39.662462 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 67/134] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:09:39 2022] PUT /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f/users/100c1706b8bd4a93b5f2764550817d64/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:09:39.671178 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe926a-554a-44ce-aab8-e69ab21de8dc None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:39.706328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456abdc-fdf2-4892-8fb0-5029b31a2f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:39.707372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456abdc-fdf2-4892-8fb0-5029b31a2f89 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:39.707929 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456abdc-fdf2-4892-8fb0-5029b31a2f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:39.708409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456abdc-fdf2-4892-8fb0-5029b31a2f89 None admin] PATH_INFO: `/v3/projects/03e8ee58b8874a24a158580e974832c3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:39.710483 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456abdc-fdf2-4892-8fb0-5029b31a2f89 None admin] RBAC: Authorizing `identity:get_project(project_id=03e8ee58b8874a24a158580e974832c3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:39.712480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456abdc-fdf2-4892-8fb0-5029b31a2f89 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:39.714484 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 68/135] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:39 2022] GET /identity/v3/projects/03e8ee58b8874a24a158580e974832c3 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:39.715963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4b1ce-20c8-4817-b87d-4b5e8a8c9ec8 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:39.716451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4b1ce-20c8-4817-b87d-4b5e8a8c9ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:39.716950 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4b1ce-20c8-4817-b87d-4b5e8a8c9ec8 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:39.718533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 69/136] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:39.720426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4b1ce-20c8-4817-b87d-4b5e8a8c9ec8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:39.810066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe926a-554a-44ce-aab8-e69ab21de8dc None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:39.862388 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:39.864025 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4b1ce-20c8-4817-b87d-4b5e8a8c9ec8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:39.868272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5509d-89b6-4fb7-8e80-778d9a43f82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:39.868959 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5509d-89b6-4fb7-8e80-778d9a43f82f None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:39.869248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5509d-89b6-4fb7-8e80-778d9a43f82f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:39.869528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5509d-89b6-4fb7-8e80-778d9a43f82f None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f/users/ed4262f495154c89b56a75b3077cbe77/roles/a1b50a29e5e4419db517dfaf3d70c19f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:39.872083 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5509d-89b6-4fb7-8e80-778d9a43f82f None admin] RBAC: Authorizing `identity:create_grant(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f, user_id=ed4262f495154c89b56a75b3077cbe77, role_id=a1b50a29e5e4419db517dfaf3d70c19f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:39.874343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5509d-89b6-4fb7-8e80-778d9a43f82f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:39.894429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 68/137] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:09:39 2022] PUT /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f/users/ed4262f495154c89b56a75b3077cbe77/roles/a1b50a29e5e4419db517dfaf3d70c19f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:09:39.896446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aa48f-45e1-436e-a54f-e43de428ddf2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:39.896808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aa48f-45e1-436e-a54f-e43de428ddf2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:39.897095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aa48f-45e1-436e-a54f-e43de428ddf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:39.919988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b35aa48f-45e1-436e-a54f-e43de428ddf2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:39.921321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b35aa48f-45e1-436e-a54f-e43de428ddf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:39.933482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c78c7-724f-4282-b2cd-cf9e2f3bbb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:39.934207 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c78c7-724f-4282-b2cd-cf9e2f3bbb3f None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:39.934498 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c78c7-724f-4282-b2cd-cf9e2f3bbb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:39.934770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c78c7-724f-4282-b2cd-cf9e2f3bbb3f None admin] PATH_INFO: `/v3/projects/03e8ee58b8874a24a158580e974832c3/users/ed4262f495154c89b56a75b3077cbe77/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:39.942241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c78c7-724f-4282-b2cd-cf9e2f3bbb3f None admin] RBAC: Authorizing `identity:create_grant(project_id=03e8ee58b8874a24a158580e974832c3, user_id=ed4262f495154c89b56a75b3077cbe77, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:39.944910 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c78c7-724f-4282-b2cd-cf9e2f3bbb3f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:39.969611 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 70/138] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:09:39 2022] PUT /identity/v3/projects/03e8ee58b8874a24a158580e974832c3/users/ed4262f495154c89b56a75b3077cbe77/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:09:40.031483 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 69/139] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:40.406573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c78c7-724f-4282-b2cd-cf9e2f3bbb3f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:40.445049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:40.532603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c78c7-724f-4282-b2cd-cf9e2f3bbb3f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:40.579034 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2b39f-9444-4d34-aa5e-3d73a56dedd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:40.579687 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b39f-9444-4d34-aa5e-3d73a56dedd4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:40.579969 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b39f-9444-4d34-aa5e-3d73a56dedd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:40.580893 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b39f-9444-4d34-aa5e-3d73a56dedd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:40.582166 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2b39f-9444-4d34-aa5e-3d73a56dedd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:40.583666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2b39f-9444-4d34-aa5e-3d73a56dedd4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:40.585348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 71/140] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:09:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:40.591068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aa48f-45e1-436e-a54f-e43de428ddf2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:40.732612 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aa48f-45e1-436e-a54f-e43de428ddf2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:40.750022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:40.778797 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc4402-763f-4146-93f9-1cf0fbfa48c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:40.779468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc4402-763f-4146-93f9-1cf0fbfa48c5 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:40.779757 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc4402-763f-4146-93f9-1cf0fbfa48c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:40.780029 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc4402-763f-4146-93f9-1cf0fbfa48c5 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:40.780714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc4402-763f-4146-93f9-1cf0fbfa48c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:40.782215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc4402-763f-4146-93f9-1cf0fbfa48c5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:40.816916 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 70/141] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:09:40 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:09:41.054369 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8b70f-9e32-4a87-9d57-3531b2806522 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:41.054859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8b70f-9e32-4a87-9d57-3531b2806522 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:41.054859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8b70f-9e32-4a87-9d57-3531b2806522 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:41.056186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 72/142] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:41.061867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc17830-c373-4e82-9025-5a99df93eb4c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:41.062177 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc17830-c373-4e82-9025-5a99df93eb4c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:41.062433 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc17830-c373-4e82-9025-5a99df93eb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:41.087034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6bc17830-c373-4e82-9025-5a99df93eb4c None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:41.088273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6bc17830-c373-4e82-9025-5a99df93eb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:41.187588 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 71/143] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:41.750295 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8b70f-9e32-4a87-9d57-3531b2806522 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:41.867974 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:41.886390 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8b70f-9e32-4a87-9d57-3531b2806522 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:41.944777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421f653-7faa-4ecd-9c20-649a15a13403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:41.945428 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421f653-7faa-4ecd-9c20-649a15a13403 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:41.945738 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421f653-7faa-4ecd-9c20-649a15a13403 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:41.946017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421f653-7faa-4ecd-9c20-649a15a13403 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:41.962066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421f653-7faa-4ecd-9c20-649a15a13403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-7421f653-7faa-4ecd-9c20-649a15a13403 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:41.967331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:41.968230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:41.969044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:41.969044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:41.969044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:41.969044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:41.969044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:41.969044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:41.969044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:41.969044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:41.969044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:41.969044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:41.969044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:09:41.969044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:09:41.972711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 73/144] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:41.978295 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc17830-c373-4e82-9025-5a99df93eb4c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:42.127275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:42.131174 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc17830-c373-4e82-9025-5a99df93eb4c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:42.170383 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95cc46-f31e-498b-8eb3-0217bf8d9c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:42.171003 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95cc46-f31e-498b-8eb3-0217bf8d9c7e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:42.171286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95cc46-f31e-498b-8eb3-0217bf8d9c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:42.171561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95cc46-f31e-498b-8eb3-0217bf8d9c7e None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:42.172237 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95cc46-f31e-498b-8eb3-0217bf8d9c7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:42.172554 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95cc46-f31e-498b-8eb3-0217bf8d9c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:42.174016 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95cc46-f31e-498b-8eb3-0217bf8d9c7e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:42.182639 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 72/145] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:09:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:42.188324 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421f653-7faa-4ecd-9c20-649a15a13403 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:42.323239 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421f653-7faa-4ecd-9c20-649a15a13403 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:42.369270 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabbbd1-707a-4bdc-ae71-19c00c6339cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:42.370327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabbbd1-707a-4bdc-ae71-19c00c6339cc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:42.370812 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabbbd1-707a-4bdc-ae71-19c00c6339cc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:42.371374 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aabbbd1-707a-4bdc-ae71-19c00c6339cc None admin] PATH_INFO: `/v3/users/94c96260337d428383e28c99c3a75646` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:42.373503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabbbd1-707a-4bdc-ae71-19c00c6339cc None admin] RBAC: Authorizing `identity:get_user(user_id=94c96260337d428383e28c99c3a75646)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:42.375225 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aabbbd1-707a-4bdc-ae71-19c00c6339cc None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:42.377250 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 74/146] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:42 2022] GET /identity/v3/users/94c96260337d428383e28c99c3a75646 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:42.386799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95cc46-f31e-498b-8eb3-0217bf8d9c7e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:42.532043 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95cc46-f31e-498b-8eb3-0217bf8d9c7e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:42.569010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a66d48-7eab-4d18-b134-3cf934c35251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:42.569650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a66d48-7eab-4d18-b134-3cf934c35251 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:42.569954 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a66d48-7eab-4d18-b134-3cf934c35251 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:42.570226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a66d48-7eab-4d18-b134-3cf934c35251 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:42.571412 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a66d48-7eab-4d18-b134-3cf934c35251 None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:42.572842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a66d48-7eab-4d18-b134-3cf934c35251 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:42.574510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 73/147] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:42 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:42.580517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabbbd1-707a-4bdc-ae71-19c00c6339cc None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:42.625317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:42.676263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a90db6-50ee-4df5-8df9-bac65a6cb1ab None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:42.676677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a90db6-50ee-4df5-8df9-bac65a6cb1ab None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:42.676787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a90db6-50ee-4df5-8df9-bac65a6cb1ab None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:42.678386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 74/148] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:42.683683 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea722dd5-5e53-4d6c-9f0d-7f0dd1a47b8b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:42.683963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea722dd5-5e53-4d6c-9f0d-7f0dd1a47b8b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:42.684239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea722dd5-5e53-4d6c-9f0d-7f0dd1a47b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:42.716795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aabbbd1-707a-4bdc-ae71-19c00c6339cc None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:42.725747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ea722dd5-5e53-4d6c-9f0d-7f0dd1a47b8b None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:42.725747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ea722dd5-5e53-4d6c-9f0d-7f0dd1a47b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:42.770384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21150269-abcd-47d9-87d4-3066e5f4a531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:42.771659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:42.772895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21150269-abcd-47d9-87d4-3066e5f4a531 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:42.773389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21150269-abcd-47d9-87d4-3066e5f4a531 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:42.773897 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21150269-abcd-47d9-87d4-3066e5f4a531 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f/users/94c96260337d428383e28c99c3a75646/roles/3d56d71a94cf4ce1887d1b743039657b` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:42.780528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21150269-abcd-47d9-87d4-3066e5f4a531 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f, user_id=94c96260337d428383e28c99c3a75646, role_id=3d56d71a94cf4ce1887d1b743039657b)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:42.783322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21150269-abcd-47d9-87d4-3066e5f4a531 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:42.807970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 75/149] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:09:42 2022] PUT /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f/users/94c96260337d428383e28c99c3a75646/roles/3d56d71a94cf4ce1887d1b743039657b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:09:42.851127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 75/150] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:09:43.283506 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c963d88-23d1-411c-a07d-0c27e8cc192f None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:43.284606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c963d88-23d1-411c-a07d-0c27e8cc192f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:43.285109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c963d88-23d1-411c-a07d-0c27e8cc192f None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:43.286839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 76/151] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:43.300929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0df158-92f8-4ec6-acab-227f8bbc7d59 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:43.301915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0df158-92f8-4ec6-acab-227f8bbc7d59 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:43.302421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0df158-92f8-4ec6-acab-227f8bbc7d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:43.327480 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2f0df158-92f8-4ec6-acab-227f8bbc7d59 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:43.329010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2f0df158-92f8-4ec6-acab-227f8bbc7d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:43.413105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c963d88-23d1-411c-a07d-0c27e8cc192f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:43.447632 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 76/152] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:43.524241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518012b-ffd0-40e0-9237-3e3be066ffeb None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:43.525119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518012b-ffd0-40e0-9237-3e3be066ffeb None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:43.526056 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518012b-ffd0-40e0-9237-3e3be066ffeb None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:43.527917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 77/153] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:43.534424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7980f-d7b9-46cb-9cdb-bea7b014aa43 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:43.535843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7980f-d7b9-46cb-9cdb-bea7b014aa43 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:43.536340 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7980f-d7b9-46cb-9cdb-bea7b014aa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:43.571743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-11f7980f-d7b9-46cb-9cdb-bea7b014aa43 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:43.573261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-11f7980f-d7b9-46cb-9cdb-bea7b014aa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:43.574342 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:43.613224 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c963d88-23d1-411c-a07d-0c27e8cc192f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:43.680446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 78/154] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:43.703279 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb4789-4009-4295-a5f7-1d7b9ac80b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:43.703946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4789-4009-4295-a5f7-1d7b9ac80b68 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:43.704228 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4789-4009-4295-a5f7-1d7b9ac80b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:43.704500 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4789-4009-4295-a5f7-1d7b9ac80b68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:43.722191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb4789-4009-4295-a5f7-1d7b9ac80b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-2fcb4789-4009-4295-a5f7-1d7b9ac80b68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:43.727226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:43.728094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:43.728864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:43.728864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:43.728864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:43.728864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:43.728864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:43.728864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:43.728864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:43.728864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:43.728864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:43.728864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:43.728864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:43.728864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:09:43.728864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 77/155] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:43.734432 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7980f-d7b9-46cb-9cdb-bea7b014aa43 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:43.763504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:43.855788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7980f-d7b9-46cb-9cdb-bea7b014aa43 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:43.897060 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7121a3-a0da-4d0d-be7a-a5645bd334a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:43.898076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7121a3-a0da-4d0d-be7a-a5645bd334a5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:43.898578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7121a3-a0da-4d0d-be7a-a5645bd334a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:43.899063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7121a3-a0da-4d0d-be7a-a5645bd334a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:43.899946 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7121a3-a0da-4d0d-be7a-a5645bd334a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:43.900481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7121a3-a0da-4d0d-be7a-a5645bd334a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:43.902114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7121a3-a0da-4d0d-be7a-a5645bd334a5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:43.912112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 79/156] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:09:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:43.918790 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb4789-4009-4295-a5f7-1d7b9ac80b68 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:44.035677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7121a3-a0da-4d0d-be7a-a5645bd334a5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:44.046360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb4789-4009-4295-a5f7-1d7b9ac80b68 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:44.114564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60ec96-9190-4fb8-abf8-8ebcbbd83bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:44.115131 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60ec96-9190-4fb8-abf8-8ebcbbd83bdd None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:44.115414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60ec96-9190-4fb8-abf8-8ebcbbd83bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:44.115692 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60ec96-9190-4fb8-abf8-8ebcbbd83bdd None admin] PATH_INFO: `/v3/users/ed4262f495154c89b56a75b3077cbe77` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:44.117205 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60ec96-9190-4fb8-abf8-8ebcbbd83bdd None admin] RBAC: Authorizing `identity:get_user(user_id=ed4262f495154c89b56a75b3077cbe77)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:44.119334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60ec96-9190-4fb8-abf8-8ebcbbd83bdd None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:44.124221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 78/157] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:43 2022] GET /identity/v3/users/ed4262f495154c89b56a75b3077cbe77 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:44.124221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58252d2-ae4d-4154-b616-ce42b581fbae None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:44.124221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58252d2-ae4d-4154-b616-ce42b581fbae None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:44.124221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58252d2-ae4d-4154-b616-ce42b581fbae None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:44.124556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 79/158] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:44.128919 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58252d2-ae4d-4154-b616-ce42b581fbae None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:44.159523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:44.194800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:44.234100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7121a3-a0da-4d0d-be7a-a5645bd334a5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:44.311355 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58252d2-ae4d-4154-b616-ce42b581fbae None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:44.319313 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b950da-b8a3-4894-afcc-9f23ae04ce85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:44.319962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b950da-b8a3-4894-afcc-9f23ae04ce85 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:44.320247 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b950da-b8a3-4894-afcc-9f23ae04ce85 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:44.320524 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b950da-b8a3-4894-afcc-9f23ae04ce85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:44.353235 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b950da-b8a3-4894-afcc-9f23ae04ce85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f5b950da-b8a3-4894-afcc-9f23ae04ce85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:44.356061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:44.357019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:44.357813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:44.357813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:44.357813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:44.357813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:44.357813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:44.357813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:44.357813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:44.357813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:44.357813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:44.357813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:44.357813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:44.357813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:44.357813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 80/159] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:09:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:09:44.363035 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76de65-45e9-473a-b8f2-89f69a4a1987 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:44.363345 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76de65-45e9-473a-b8f2-89f69a4a1987 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:44.363625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76de65-45e9-473a-b8f2-89f69a4a1987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:44.383455 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb34163-80a6-4a7c-9abb-44f982cbb3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:44.384422 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb34163-80a6-4a7c-9abb-44f982cbb3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:44.384898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb34163-80a6-4a7c-9abb-44f982cbb3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:44.385372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb34163-80a6-4a7c-9abb-44f982cbb3c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:44.401706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fd76de65-45e9-473a-b8f2-89f69a4a1987 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:44.401706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fd76de65-45e9-473a-b8f2-89f69a4a1987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:44.522023 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb34163-80a6-4a7c-9abb-44f982cbb3c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:44.524190 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb34163-80a6-4a7c-9abb-44f982cbb3c8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:44.556511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:44.575918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 81/160] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:44.576848 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76de65-45e9-473a-b8f2-89f69a4a1987 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:44.668154 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 80/161] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 17:09:44.668931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb34163-80a6-4a7c-9abb-44f982cbb3c8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:44.764489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:44.835396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76de65-45e9-473a-b8f2-89f69a4a1987 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:44.850728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb34163-80a6-4a7c-9abb-44f982cbb3c8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:44.903630 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:44.915320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa9e5f-0982-458b-b4c1-965c82b859e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:44.915952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa9e5f-0982-458b-b4c1-965c82b859e2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:44.916242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa9e5f-0982-458b-b4c1-965c82b859e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:44.916515 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa9e5f-0982-458b-b4c1-965c82b859e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:44.917187 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa9e5f-0982-458b-b4c1-965c82b859e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:44.917491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa9e5f-0982-458b-b4c1-965c82b859e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:44.918986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa9e5f-0982-458b-b4c1-965c82b859e2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:44.926954 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dc9f9-614e-430c-9e2a-7eebe8167c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:44.927605 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dc9f9-614e-430c-9e2a-7eebe8167c17 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:44.927889 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dc9f9-614e-430c-9e2a-7eebe8167c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:44.928166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dc9f9-614e-430c-9e2a-7eebe8167c17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:44.933297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 81/162] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:44.934172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa9e5f-0982-458b-b4c1-965c82b859e2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:44.951840 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dc9f9-614e-430c-9e2a-7eebe8167c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-0a1dc9f9-614e-430c-9e2a-7eebe8167c17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:44.957240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:44.958157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:44.958932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:44.958932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:44.958932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:44.958932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:44.958932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:44.958932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:44.958932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:44.958932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:44.958932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:44.958932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:44.958932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:44.958932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:44.962787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 82/163] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:44.963595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dc9f9-614e-430c-9e2a-7eebe8167c17 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:45.088333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa9e5f-0982-458b-b4c1-965c82b859e2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:45.136552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dc9f9-614e-430c-9e2a-7eebe8167c17 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:45.157008 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735c9f4-17ef-485c-bc38-f0ac3fb59fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:45.158444 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735c9f4-17ef-485c-bc38-f0ac3fb59fcd None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:45.158842 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735c9f4-17ef-485c-bc38-f0ac3fb59fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:45.159127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735c9f4-17ef-485c-bc38-f0ac3fb59fcd None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:45.164692 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735c9f4-17ef-485c-bc38-f0ac3fb59fcd None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:45.166206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735c9f4-17ef-485c-bc38-f0ac3fb59fcd None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:45.168069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 82/164] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:44 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:45.168649 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735c9f4-17ef-485c-bc38-f0ac3fb59fcd None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:45.193247 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:45.206740 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e532e-75db-482f-9e6f-da86bb72666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:45.207403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e532e-75db-482f-9e6f-da86bb72666a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:45.207688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e532e-75db-482f-9e6f-da86bb72666a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:45.207966 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e532e-75db-482f-9e6f-da86bb72666a None admin] PATH_INFO: `/v3/users/100c1706b8bd4a93b5f2764550817d64` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:45.209182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e532e-75db-482f-9e6f-da86bb72666a None admin] RBAC: Authorizing `identity:get_user(user_id=100c1706b8bd4a93b5f2764550817d64)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:45.210794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e532e-75db-482f-9e6f-da86bb72666a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:45.213041 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 83/165] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:44 2022] GET /identity/v3/users/100c1706b8bd4a93b5f2764550817d64 => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:45.213780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e532e-75db-482f-9e6f-da86bb72666a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:45.247845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:45.322099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735c9f4-17ef-485c-bc38-f0ac3fb59fcd None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:45.377217 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da3c30-165d-4376-80e9-4541b04c2c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:45.377867 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da3c30-165d-4376-80e9-4541b04c2c4c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:45.378149 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da3c30-165d-4376-80e9-4541b04c2c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:45.378426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da3c30-165d-4376-80e9-4541b04c2c4c None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:45.379098 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da3c30-165d-4376-80e9-4541b04c2c4c None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:45.379406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da3c30-165d-4376-80e9-4541b04c2c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:45.380794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da3c30-165d-4376-80e9-4541b04c2c4c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:45.397242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 83/166] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:09:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:45.397947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da3c30-165d-4376-80e9-4541b04c2c4c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:45.447912 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e532e-75db-482f-9e6f-da86bb72666a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:45.523345 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb49af-c20a-4adb-9550-183591bffde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:45.523345 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb49af-c20a-4adb-9550-183591bffde7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:45.523835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb49af-c20a-4adb-9550-183591bffde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:45.524179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb49af-c20a-4adb-9550-183591bffde7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:45.554384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb49af-c20a-4adb-9550-183591bffde7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-bddb49af-c20a-4adb-9550-183591bffde7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:45.559231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:45.560324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:45.561183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:45.561183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:45.561183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:45.561183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:45.561183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:45.561183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:45.561183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:45.561183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:45.561183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:45.561183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:45.561183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:09:45.561183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:45.561183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 84/167] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:09:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:45.566662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb49af-c20a-4adb-9550-183591bffde7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:45.577106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da3c30-165d-4376-80e9-4541b04c2c4c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:45.587020 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:45.615881 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29730b7-29a6-431d-b795-a1289b94380d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:45.616583 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29730b7-29a6-431d-b795-a1289b94380d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:45.616923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29730b7-29a6-431d-b795-a1289b94380d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:45.617202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29730b7-29a6-431d-b795-a1289b94380d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:45.618046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29730b7-29a6-431d-b795-a1289b94380d None admin] RBAC: Adding query filter params (role.id=1c0bdbdf6a98487cac86e3de530b11d2, scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f, user.id=ed4262f495154c89b56a75b3077cbe77) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:45.618363 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29730b7-29a6-431d-b795-a1289b94380d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:45.619858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29730b7-29a6-431d-b795-a1289b94380d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:45.627675 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 84/168] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:45 2022] GET /identity/v3/role_assignments?user.id=ed4262f495154c89b56a75b3077cbe77&scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f&role.id=1c0bdbdf6a98487cac86e3de530b11d2 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:45.628696 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29730b7-29a6-431d-b795-a1289b94380d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:45.693309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:45.791764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29730b7-29a6-431d-b795-a1289b94380d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:45.810601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb49af-c20a-4adb-9550-183591bffde7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:45.862158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb560be5-7dac-49a9-988e-312789d0d769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:45.862830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb560be5-7dac-49a9-988e-312789d0d769 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:45.863120 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb560be5-7dac-49a9-988e-312789d0d769 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:45.863397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb560be5-7dac-49a9-988e-312789d0d769 None admin] PATH_INFO: `/v3/users/ed4262f495154c89b56a75b3077cbe77` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:45.864655 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb560be5-7dac-49a9-988e-312789d0d769 None admin] RBAC: Authorizing `identity:get_user(user_id=ed4262f495154c89b56a75b3077cbe77)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:45.866140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb560be5-7dac-49a9-988e-312789d0d769 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:45.867815 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 85/169] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:45 2022] GET /identity/v3/users/ed4262f495154c89b56a75b3077cbe77 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:45.868521 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb560be5-7dac-49a9-988e-312789d0d769 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:45.890595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955ad5f-91d5-4551-a53e-0a4b75919b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:45.891234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955ad5f-91d5-4551-a53e-0a4b75919b11 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:45.891514 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955ad5f-91d5-4551-a53e-0a4b75919b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:45.891790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955ad5f-91d5-4551-a53e-0a4b75919b11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:45.963974 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:46.041380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb560be5-7dac-49a9-988e-312789d0d769 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:46.074614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955ad5f-91d5-4551-a53e-0a4b75919b11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:46.076018 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955ad5f-91d5-4551-a53e-0a4b75919b11 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:46.079372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a461e4-eb45-4fba-bcc7-fcd672705824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:46.080932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a461e4-eb45-4fba-bcc7-fcd672705824 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:46.081426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a461e4-eb45-4fba-bcc7-fcd672705824 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:46.081944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a461e4-eb45-4fba-bcc7-fcd672705824 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:46.082841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a461e4-eb45-4fba-bcc7-fcd672705824 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:46.083346 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a461e4-eb45-4fba-bcc7-fcd672705824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:46.084927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a461e4-eb45-4fba-bcc7-fcd672705824 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:46.094480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 86/170] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:09:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:46.095715 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a461e4-eb45-4fba-bcc7-fcd672705824 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:46.167268 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:46.224646 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a461e4-eb45-4fba-bcc7-fcd672705824 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:46.226391 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 85/171] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:09:46.228627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efda08-1a34-4567-80a3-7ce437ec958b None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:46.229067 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efda08-1a34-4567-80a3-7ce437ec958b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:46.229492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efda08-1a34-4567-80a3-7ce437ec958b None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:46.230962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 86/172] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:46.231808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efda08-1a34-4567-80a3-7ce437ec958b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:46.247158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:46.271608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb533fab-ebea-49af-a101-b3d310ca23d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:46.272573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb533fab-ebea-49af-a101-b3d310ca23d5 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:46.273214 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb533fab-ebea-49af-a101-b3d310ca23d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:46.273722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb533fab-ebea-49af-a101-b3d310ca23d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:46.350664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efda08-1a34-4567-80a3-7ce437ec958b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:46.354853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb533fab-ebea-49af-a101-b3d310ca23d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:46.356967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb533fab-ebea-49af-a101-b3d310ca23d5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:46.392448 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cc9a5-6a44-4237-a928-d6bdf0b94ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:46.393408 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc9a5-6a44-4237-a928-d6bdf0b94ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:46.393715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc9a5-6a44-4237-a928-d6bdf0b94ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:46.393981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc9a5-6a44-4237-a928-d6bdf0b94ef7 None admin] PATH_INFO: `/v3/users/ed4262f495154c89b56a75b3077cbe77` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:46.395108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cc9a5-6a44-4237-a928-d6bdf0b94ef7 None admin] RBAC: Authorizing `identity:get_user(user_id=ed4262f495154c89b56a75b3077cbe77)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:46.396555 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cc9a5-6a44-4237-a928-d6bdf0b94ef7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:46.398575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 87/173] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:46 2022] GET /identity/v3/users/ed4262f495154c89b56a75b3077cbe77 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:46.399834 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47935c76-bedf-4c50-9f70-7d827eb0159e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:46.400116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47935c76-bedf-4c50-9f70-7d827eb0159e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:46.400385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47935c76-bedf-4c50-9f70-7d827eb0159e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:46.405596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 88/174] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:46.405596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47935c76-bedf-4c50-9f70-7d827eb0159e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:46.438620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:46.491854 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 87/175] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:09:46.492541 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32842474-462c-458a-8a2f-20ee74549a90 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:46.492828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32842474-462c-458a-8a2f-20ee74549a90 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:46.493102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32842474-462c-458a-8a2f-20ee74549a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:46.499273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:46.513174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-32842474-462c-458a-8a2f-20ee74549a90 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:46.514394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-32842474-462c-458a-8a2f-20ee74549a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:46.528939 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47935c76-bedf-4c50-9f70-7d827eb0159e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:46.566500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27597ba-889b-4faf-9c52-059eea03f3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:46.567133 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27597ba-889b-4faf-9c52-059eea03f3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:46.567410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27597ba-889b-4faf-9c52-059eea03f3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:46.567680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27597ba-889b-4faf-9c52-059eea03f3c9 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:46.568788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27597ba-889b-4faf-9c52-059eea03f3c9 None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:46.570275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27597ba-889b-4faf-9c52-059eea03f3c9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:46.571898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 89/176] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:46 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:46.572649 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27597ba-889b-4faf-9c52-059eea03f3c9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:46.587316 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 88/177] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:46.588550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949716e-5fd7-4716-b872-78099c46b35d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:46.588836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949716e-5fd7-4716-b872-78099c46b35d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:46.589109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949716e-5fd7-4716-b872-78099c46b35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:46.606814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4949716e-5fd7-4716-b872-78099c46b35d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:46.607746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4949716e-5fd7-4716-b872-78099c46b35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:46.683776 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 89/178] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:46.693517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469f85c-c5c5-414b-a9d2-6d4c7b58dca2 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:46.693517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469f85c-c5c5-414b-a9d2-6d4c7b58dca2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:46.693517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469f85c-c5c5-414b-a9d2-6d4c7b58dca2 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:46.693517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 90/179] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:46.693517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469f85c-c5c5-414b-a9d2-6d4c7b58dca2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:46.696586 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:46.702626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27597ba-889b-4faf-9c52-059eea03f3c9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:46.742317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934d913-46ad-4d2c-977a-66ec39df2fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:46.743074 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934d913-46ad-4d2c-977a-66ec39df2fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:46.743351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934d913-46ad-4d2c-977a-66ec39df2fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:46.743666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934d913-46ad-4d2c-977a-66ec39df2fc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:46.775755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:46.818081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934d913-46ad-4d2c-977a-66ec39df2fc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:46.819628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934d913-46ad-4d2c-977a-66ec39df2fc2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:46.826596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469f85c-c5c5-414b-a9d2-6d4c7b58dca2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:46.870404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470b511-c58a-43b3-b0d4-497594b9d45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:46.870955 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470b511-c58a-43b3-b0d4-497594b9d45e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:46.871239 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470b511-c58a-43b3-b0d4-497594b9d45e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:46.871511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470b511-c58a-43b3-b0d4-497594b9d45e None admin] PATH_INFO: `/v3/projects/03e8ee58b8874a24a158580e974832c3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:46.872714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470b511-c58a-43b3-b0d4-497594b9d45e None admin] RBAC: Authorizing `identity:get_project(project_id=03e8ee58b8874a24a158580e974832c3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:46.874181 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470b511-c58a-43b3-b0d4-497594b9d45e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:46.875810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 91/180] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:46 2022] GET /identity/v3/projects/03e8ee58b8874a24a158580e974832c3 => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:46.876938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526a16e-f901-4156-93be-f46b9ec93a49 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:46.877289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526a16e-f901-4156-93be-f46b9ec93a49 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:46.877567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526a16e-f901-4156-93be-f46b9ec93a49 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:46.878791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 92/181] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:46.882947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526a16e-f901-4156-93be-f46b9ec93a49 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:46.924734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:46.932569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 90/182] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:09:46.938312 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0cef7-cd3e-4f7a-bf1c-6bb943a3c2a4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:46.938603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0cef7-cd3e-4f7a-bf1c-6bb943a3c2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:46.938881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0cef7-cd3e-4f7a-bf1c-6bb943a3c2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:46.956648 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2fa0cef7-cd3e-4f7a-bf1c-6bb943a3c2a4 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:46.957872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2fa0cef7-cd3e-4f7a-bf1c-6bb943a3c2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:46.990000 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526a16e-f901-4156-93be-f46b9ec93a49 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:47.017946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:47.024346 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d34cd-1006-4c5f-a73b-82b7fa529dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:47.024510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 91/183] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:47.024958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d34cd-1006-4c5f-a73b-82b7fa529dcd None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:47.025237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d34cd-1006-4c5f-a73b-82b7fa529dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:47.025326 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0cef7-cd3e-4f7a-bf1c-6bb943a3c2a4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:47.025647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d34cd-1006-4c5f-a73b-82b7fa529dcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:47.026337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d34cd-1006-4c5f-a73b-82b7fa529dcd None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f, user.id=100c1706b8bd4a93b5f2764550817d64) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:47.026649 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d34cd-1006-4c5f-a73b-82b7fa529dcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:47.028087 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d34cd-1006-4c5f-a73b-82b7fa529dcd None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:47.041759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 93/184] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:46 2022] GET /identity/v3/role_assignments?user.id=100c1706b8bd4a93b5f2764550817d64&scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:47.041759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d34cd-1006-4c5f-a73b-82b7fa529dcd None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:47.148912 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0cef7-cd3e-4f7a-bf1c-6bb943a3c2a4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:47.155028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d34cd-1006-4c5f-a73b-82b7fa529dcd None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:47.176362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:47.190296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94819d2-311c-4942-ae2b-6899a18358d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:47.190944 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94819d2-311c-4942-ae2b-6899a18358d7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:47.191268 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94819d2-311c-4942-ae2b-6899a18358d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:47.191545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94819d2-311c-4942-ae2b-6899a18358d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:47.195110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506a0a2-1450-4557-be87-836584f28a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:47.195978 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506a0a2-1450-4557-be87-836584f28a8e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:47.196462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506a0a2-1450-4557-be87-836584f28a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:47.196911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506a0a2-1450-4557-be87-836584f28a8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:47.197859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506a0a2-1450-4557-be87-836584f28a8e None admin] RBAC: Adding query filter params (role.id=1c0bdbdf6a98487cac86e3de530b11d2, scope.project.id=03e8ee58b8874a24a158580e974832c3, user.id=ed4262f495154c89b56a75b3077cbe77) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:47.198532 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506a0a2-1450-4557-be87-836584f28a8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:47.200374 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506a0a2-1450-4557-be87-836584f28a8e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:47.203521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94819d2-311c-4942-ae2b-6899a18358d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:47.208168 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 94/185] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:47 2022] GET /identity/v3/role_assignments?user.id=ed4262f495154c89b56a75b3077cbe77&scope.project.id=03e8ee58b8874a24a158580e974832c3&role.id=1c0bdbdf6a98487cac86e3de530b11d2 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:47.209709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4113e7-a320-46b3-b507-e296d7e8c8f1 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e94819d2-311c-4942-ae2b-6899a18358d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:47.210082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:47.210929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:47.217149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:47.217149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:47.217149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:47.217149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:47.217149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:47.217149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:47.217149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:47.217149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:47.217149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:47.217149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:47.217149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:47.217149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:47.217149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 92/186] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:09:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:47.217149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94819d2-311c-4942-ae2b-6899a18358d7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:47.218522 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4113e7-a320-46b3-b507-e296d7e8c8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:47.218948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4113e7-a320-46b3-b507-e296d7e8c8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:47.243062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ad4113e7-a320-46b3-b507-e296d7e8c8f1 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:47.244288 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ad4113e7-a320-46b3-b507-e296d7e8c8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:47.323771 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:47.343548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 95/187] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:47.345013 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4113e7-a320-46b3-b507-e296d7e8c8f1 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:47.360146 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94819d2-311c-4942-ae2b-6899a18358d7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:47.418991 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98ce35-184f-4c44-ac7d-f10af9934465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:47.419668 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98ce35-184f-4c44-ac7d-f10af9934465 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:47.420009 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98ce35-184f-4c44-ac7d-f10af9934465 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:47.420346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98ce35-184f-4c44-ac7d-f10af9934465 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:47.422336 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98ce35-184f-4c44-ac7d-f10af9934465 None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:47.423960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98ce35-184f-4c44-ac7d-f10af9934465 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:47.425652 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 93/188] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:47 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:47.428514 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98ce35-184f-4c44-ac7d-f10af9934465 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:47.497354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:47.518339 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4113e7-a320-46b3-b507-e296d7e8c8f1 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:47.551439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98ce35-184f-4c44-ac7d-f10af9934465 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:47.556957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccc765-4c6c-4b55-b0f6-fa8cecc2b8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:47.557590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccc765-4c6c-4b55-b0f6-fa8cecc2b8ee None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:47.557924 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccc765-4c6c-4b55-b0f6-fa8cecc2b8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:47.558197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccc765-4c6c-4b55-b0f6-fa8cecc2b8ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:47.559412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccc765-4c6c-4b55-b0f6-fa8cecc2b8ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:47.560837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccc765-4c6c-4b55-b0f6-fa8cecc2b8ee None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:47.562605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 96/189] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:09:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:47.563266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccc765-4c6c-4b55-b0f6-fa8cecc2b8ee None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:47.586895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89c3a7-e542-4a2d-bdf1-b78e00d94b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:47.587508 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89c3a7-e542-4a2d-bdf1-b78e00d94b1d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:47.587791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89c3a7-e542-4a2d-bdf1-b78e00d94b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:47.588067 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89c3a7-e542-4a2d-bdf1-b78e00d94b1d None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:47.588729 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89c3a7-e542-4a2d-bdf1-b78e00d94b1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:47.589034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89c3a7-e542-4a2d-bdf1-b78e00d94b1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:47.590453 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89c3a7-e542-4a2d-bdf1-b78e00d94b1d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:47.599972 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 94/190] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:47.600614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89c3a7-e542-4a2d-bdf1-b78e00d94b1d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:47.627868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:47.676007 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccc765-4c6c-4b55-b0f6-fa8cecc2b8ee None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:47.700469 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89c3a7-e542-4a2d-bdf1-b78e00d94b1d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:47.708659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efb2bc-81a6-4c7a-aa1c-7048246c9da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:47.709279 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efb2bc-81a6-4c7a-aa1c-7048246c9da0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:47.709555 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efb2bc-81a6-4c7a-aa1c-7048246c9da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:47.710159 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efb2bc-81a6-4c7a-aa1c-7048246c9da0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:47.715300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:47.720558 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efb2bc-81a6-4c7a-aa1c-7048246c9da0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-60efb2bc-81a6-4c7a-aa1c-7048246c9da0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:47.725847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:47.726714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:47.727499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:47.727499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:47.727499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:47.727499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:47.727499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:47.727499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:47.727499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:47.727499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:47.727499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:47.727499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:47.727499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:09:47.727499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:09:47.727499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 97/191] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:09:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:47.728136 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efb2bc-81a6-4c7a-aa1c-7048246c9da0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:47.740673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c619346-9818-43fc-8057-b2acd9a61139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:47.741277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c619346-9818-43fc-8057-b2acd9a61139 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:47.741558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c619346-9818-43fc-8057-b2acd9a61139 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:47.741887 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c619346-9818-43fc-8057-b2acd9a61139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:47.742622 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c619346-9818-43fc-8057-b2acd9a61139 None admin] RBAC: Adding query filter params (role.id=a1b50a29e5e4419db517dfaf3d70c19f, scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f, user.id=ed4262f495154c89b56a75b3077cbe77) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:47.742915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c619346-9818-43fc-8057-b2acd9a61139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:47.744328 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c619346-9818-43fc-8057-b2acd9a61139 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:47.758964 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 95/192] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:47 2022] GET /identity/v3/role_assignments?user.id=ed4262f495154c89b56a75b3077cbe77&scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f&role.id=a1b50a29e5e4419db517dfaf3d70c19f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:47.758964 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c619346-9818-43fc-8057-b2acd9a61139 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:47.838050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efb2bc-81a6-4c7a-aa1c-7048246c9da0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:47.856789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:47.874463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c619346-9818-43fc-8057-b2acd9a61139 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:47.878830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3024a81-8a01-4e7a-b842-c2e5f6c3a3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:47.879465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3024a81-8a01-4e7a-b842-c2e5f6c3a3e5 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:47.879746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3024a81-8a01-4e7a-b842-c2e5f6c3a3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:47.880020 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3024a81-8a01-4e7a-b842-c2e5f6c3a3e5 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:47.880696 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3024a81-8a01-4e7a-b842-c2e5f6c3a3e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:47.882237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3024a81-8a01-4e7a-b842-c2e5f6c3a3e5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:47.906581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 98/193] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:09:47 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:09:47.907799 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3024a81-8a01-4e7a-b842-c2e5f6c3a3e5 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:47.927807 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3673a1-a4ae-4a07-bd48-75e562dcd301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:47.928574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3673a1-a4ae-4a07-bd48-75e562dcd301 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:47.928858 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3673a1-a4ae-4a07-bd48-75e562dcd301 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:47.929138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3673a1-a4ae-4a07-bd48-75e562dcd301 None admin] PATH_INFO: `/v3/users/b5b1504290ae46f5852ce71d5a24367d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:47.953092 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3673a1-a4ae-4a07-bd48-75e562dcd301 None admin] RBAC: Authorizing `identity:get_user(user_id=b5b1504290ae46f5852ce71d5a24367d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:47.954803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3673a1-a4ae-4a07-bd48-75e562dcd301 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:47.957601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 96/194] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:47 2022] GET /identity/v3/users/b5b1504290ae46f5852ce71d5a24367d => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:47.958291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3673a1-a4ae-4a07-bd48-75e562dcd301 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:48.004361 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:48.042507 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3024a81-8a01-4e7a-b842-c2e5f6c3a3e5 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:48.084791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3673a1-a4ae-4a07-bd48-75e562dcd301 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:48.088595 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1258aa-afc5-4367-850c-795ecc4c0f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:48.089242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1258aa-afc5-4367-850c-795ecc4c0f89 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:48.089524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1258aa-afc5-4367-850c-795ecc4c0f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:48.089847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1258aa-afc5-4367-850c-795ecc4c0f89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:48.101384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1258aa-afc5-4367-850c-795ecc4c0f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-ed1258aa-afc5-4367-850c-795ecc4c0f89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:48.107608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:48.108473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:48.109248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:48.109248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:48.109248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:48.109248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:48.109248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:48.109248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:48.109248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:48.109248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:48.109248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:48.109248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:48.109248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:09:48.109248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:09:48.109248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 99/195] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:48.109248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1258aa-afc5-4367-850c-795ecc4c0f89 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:48.128927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bca98c-71ef-4dd9-b850-d7ce3b861b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:48.129541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bca98c-71ef-4dd9-b850-d7ce3b861b30 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:48.129866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bca98c-71ef-4dd9-b850-d7ce3b861b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:48.130142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bca98c-71ef-4dd9-b850-d7ce3b861b30 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:48.130808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bca98c-71ef-4dd9-b850-d7ce3b861b30 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:48.131112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bca98c-71ef-4dd9-b850-d7ce3b861b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:48.132567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bca98c-71ef-4dd9-b850-d7ce3b861b30 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:48.145126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 97/196] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:09:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:48.145126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bca98c-71ef-4dd9-b850-d7ce3b861b30 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:48.149734 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:48.237393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1258aa-afc5-4367-850c-795ecc4c0f89 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:48.262933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:48.267662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bca98c-71ef-4dd9-b850-d7ce3b861b30 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:48.284301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd424844-fc07-4c8e-9527-ae382efb225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:48.284931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd424844-fc07-4c8e-9527-ae382efb225f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:48.285202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd424844-fc07-4c8e-9527-ae382efb225f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:48.285477 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd424844-fc07-4c8e-9527-ae382efb225f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:48.305591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119bb82-58be-421d-b3b2-e94239bbf38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:48.306220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119bb82-58be-421d-b3b2-e94239bbf38c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:48.306500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119bb82-58be-421d-b3b2-e94239bbf38c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:48.306772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119bb82-58be-421d-b3b2-e94239bbf38c None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:48.307472 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119bb82-58be-421d-b3b2-e94239bbf38c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:48.307840 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119bb82-58be-421d-b3b2-e94239bbf38c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:48.309232 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119bb82-58be-421d-b3b2-e94239bbf38c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:48.321372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 98/197] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:09:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:48.321753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119bb82-58be-421d-b3b2-e94239bbf38c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:48.384582 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd424844-fc07-4c8e-9527-ae382efb225f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:48.386513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd424844-fc07-4c8e-9527-ae382efb225f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:48.429736 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:48.440950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119bb82-58be-421d-b3b2-e94239bbf38c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:48.477280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b30789-0c9a-4690-8280-efe522b4335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:48.478493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b30789-0c9a-4690-8280-efe522b4335c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:48.479059 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b30789-0c9a-4690-8280-efe522b4335c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:48.479522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b30789-0c9a-4690-8280-efe522b4335c None admin] PATH_INFO: `/v3/users/b5b1504290ae46f5852ce71d5a24367d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:48.481001 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b30789-0c9a-4690-8280-efe522b4335c None admin] RBAC: Authorizing `identity:get_user(user_id=b5b1504290ae46f5852ce71d5a24367d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:48.482726 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b30789-0c9a-4690-8280-efe522b4335c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:48.484599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 99/198] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:48 2022] GET /identity/v3/users/b5b1504290ae46f5852ce71d5a24367d => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:48.485862 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b30789-0c9a-4690-8280-efe522b4335c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:48.514475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 100/199] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:09:48.515640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd424844-fc07-4c8e-9527-ae382efb225f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:48.525327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:48.630555 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b30789-0c9a-4690-8280-efe522b4335c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:48.631539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd424844-fc07-4c8e-9527-ae382efb225f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:48.662122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:48.668116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03e29b-3d7e-4217-9fed-1098e0dae661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:48.668824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03e29b-3d7e-4217-9fed-1098e0dae661 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:48.669331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03e29b-3d7e-4217-9fed-1098e0dae661 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:48.669709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03e29b-3d7e-4217-9fed-1098e0dae661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:48.682058 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ea001-9122-4e88-86d6-0521bd05f3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:48.683101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ea001-9122-4e88-86d6-0521bd05f3da None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:48.683386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ea001-9122-4e88-86d6-0521bd05f3da None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:48.683661 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ea001-9122-4e88-86d6-0521bd05f3da None admin] PATH_INFO: `/v3/users/94c96260337d428383e28c99c3a75646` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:48.685076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ea001-9122-4e88-86d6-0521bd05f3da None admin] RBAC: Authorizing `identity:get_user(user_id=94c96260337d428383e28c99c3a75646)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:48.687429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ea001-9122-4e88-86d6-0521bd05f3da None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:48.690287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 100/200] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:48 2022] GET /identity/v3/users/94c96260337d428383e28c99c3a75646 => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:48.691143 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ea001-9122-4e88-86d6-0521bd05f3da None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:48.743833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03e29b-3d7e-4217-9fed-1098e0dae661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:48.745463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03e29b-3d7e-4217-9fed-1098e0dae661 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:48.822302 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:48.832222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ea001-9122-4e88-86d6-0521bd05f3da None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:48.854466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 101/201] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:09:48.856515 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03e29b-3d7e-4217-9fed-1098e0dae661 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:48.878144 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2356eee-0f93-4701-b4bb-445b17c9c018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:48.878790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2356eee-0f93-4701-b4bb-445b17c9c018 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:48.879072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2356eee-0f93-4701-b4bb-445b17c9c018 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:48.879346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2356eee-0f93-4701-b4bb-445b17c9c018 None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:48.880575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2356eee-0f93-4701-b4bb-445b17c9c018 None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:48.882140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2356eee-0f93-4701-b4bb-445b17c9c018 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:48.883771 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 101/202] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:48 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:48.889266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2356eee-0f93-4701-b4bb-445b17c9c018 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:48.902856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:48.992802 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03e29b-3d7e-4217-9fed-1098e0dae661 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:49.002152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2356eee-0f93-4701-b4bb-445b17c9c018 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:49.037616 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d85bf-e850-4071-9ecc-9b5a7b641b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:49.038395 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d85bf-e850-4071-9ecc-9b5a7b641b9b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:49.038746 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d85bf-e850-4071-9ecc-9b5a7b641b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:49.039081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d85bf-e850-4071-9ecc-9b5a7b641b9b None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:49.040409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d85bf-e850-4071-9ecc-9b5a7b641b9b None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:49.040882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18349d-1c8c-4f9e-89bc-26af5d28915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:49.041728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18349d-1c8c-4f9e-89bc-26af5d28915e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:49.042182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18349d-1c8c-4f9e-89bc-26af5d28915e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:49.042310 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d85bf-e850-4071-9ecc-9b5a7b641b9b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:49.042746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18349d-1c8c-4f9e-89bc-26af5d28915e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:49.049597 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 102/203] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:48 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:49.050837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d85bf-e850-4071-9ecc-9b5a7b641b9b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:49.084392 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:49.131215 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18349d-1c8c-4f9e-89bc-26af5d28915e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:49.133358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18349d-1c8c-4f9e-89bc-26af5d28915e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:49.162174 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d85bf-e850-4071-9ecc-9b5a7b641b9b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:49.166885 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:49.198877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39131e91-1737-42cf-b8df-a9c3a4bcf8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:49.199812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39131e91-1737-42cf-b8df-a9c3a4bcf8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:49.200307 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39131e91-1737-42cf-b8df-a9c3a4bcf8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:49.200768 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39131e91-1737-42cf-b8df-a9c3a4bcf8d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:49.201732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39131e91-1737-42cf-b8df-a9c3a4bcf8d1 None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2, user.id=b5b1504290ae46f5852ce71d5a24367d) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:49.202232 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39131e91-1737-42cf-b8df-a9c3a4bcf8d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:49.203914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39131e91-1737-42cf-b8df-a9c3a4bcf8d1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:49.217935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 103/204] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:49 2022] GET /identity/v3/role_assignments?user.id=b5b1504290ae46f5852ce71d5a24367d&scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:49.218852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39131e91-1737-42cf-b8df-a9c3a4bcf8d1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:49.244813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 102/205] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:09:49.250724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18349d-1c8c-4f9e-89bc-26af5d28915e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:49.378519 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18349d-1c8c-4f9e-89bc-26af5d28915e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:49.398983 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:49.407111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39131e91-1737-42cf-b8df-a9c3a4bcf8d1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:49.425952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:49.439889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4654814-2dfa-48df-aaa8-43e2190f37d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:49.440656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4654814-2dfa-48df-aaa8-43e2190f37d8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:49.440853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4654814-2dfa-48df-aaa8-43e2190f37d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:49.441131 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4654814-2dfa-48df-aaa8-43e2190f37d8 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:49.442334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4654814-2dfa-48df-aaa8-43e2190f37d8 None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:49.443808 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4654814-2dfa-48df-aaa8-43e2190f37d8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:49.445771 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 103/206] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:49 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:49.451955 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4654814-2dfa-48df-aaa8-43e2190f37d8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:49.460602 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e211616-00cf-4ddd-819f-920354bcaa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:49.461801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e211616-00cf-4ddd-819f-920354bcaa9b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:49.462274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e211616-00cf-4ddd-819f-920354bcaa9b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:49.462753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e211616-00cf-4ddd-819f-920354bcaa9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:49.463677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e211616-00cf-4ddd-819f-920354bcaa9b None admin] RBAC: Adding query filter params (role.id=a1b50a29e5e4419db517dfaf3d70c19f, scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2, user.id=b5b1504290ae46f5852ce71d5a24367d) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:49.464429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e211616-00cf-4ddd-819f-920354bcaa9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:49.465977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e211616-00cf-4ddd-819f-920354bcaa9b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:49.472282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 104/207] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:49 2022] GET /identity/v3/role_assignments?user.id=b5b1504290ae46f5852ce71d5a24367d&scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2&role.id=a1b50a29e5e4419db517dfaf3d70c19f => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:49.568058 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4654814-2dfa-48df-aaa8-43e2190f37d8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:49.625349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf1dee-c18d-4ad2-b2b1-fa604586bcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:49.626007 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf1dee-c18d-4ad2-b2b1-fa604586bcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:49.626833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf1dee-c18d-4ad2-b2b1-fa604586bcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:49.627110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf1dee-c18d-4ad2-b2b1-fa604586bcd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:49.627858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf1dee-c18d-4ad2-b2b1-fa604586bcd0 None admin] RBAC: Adding query filter params (role.id=3d56d71a94cf4ce1887d1b743039657b, scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f, user.id=94c96260337d428383e28c99c3a75646) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:49.628173 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf1dee-c18d-4ad2-b2b1-fa604586bcd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:49.629705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf1dee-c18d-4ad2-b2b1-fa604586bcd0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:49.636386 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 104/208] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:49 2022] GET /identity/v3/role_assignments?user.id=94c96260337d428383e28c99c3a75646&scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f&role.id=3d56d71a94cf4ce1887d1b743039657b => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:50.343156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55185afc-7978-4788-9868-ce4531777e13 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:50.343689 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55185afc-7978-4788-9868-ce4531777e13 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:50.343689 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55185afc-7978-4788-9868-ce4531777e13 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:50.345477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 105/209] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:50.351167 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63bcd9-8898-487e-8d84-42aea373e8a6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:50.351453 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63bcd9-8898-487e-8d84-42aea373e8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:50.351909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63bcd9-8898-487e-8d84-42aea373e8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:50.374841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7e63bcd9-8898-487e-8d84-42aea373e8a6 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:50.376647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7e63bcd9-8898-487e-8d84-42aea373e8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:50.459669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:50.468309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 105/210] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:50.495147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f116f-711d-4ad6-8e56-67c06fca8ad9 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:50.495440 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f116f-711d-4ad6-8e56-67c06fca8ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:50.495711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f116f-711d-4ad6-8e56-67c06fca8ad9 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:50.497199 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 106/211] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:50.502821 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ceb7f-4036-4fb3-b3a5-0752f8926617 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:50.503106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ceb7f-4036-4fb3-b3a5-0752f8926617 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:50.503381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ceb7f-4036-4fb3-b3a5-0752f8926617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:50.521542 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-709ceb7f-4036-4fb3-b3a5-0752f8926617 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:50.522759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-709ceb7f-4036-4fb3-b3a5-0752f8926617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:50.590143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 106/212] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:50.754017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f116f-711d-4ad6-8e56-67c06fca8ad9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:50.857991 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f116f-711d-4ad6-8e56-67c06fca8ad9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:50.895873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f8b51-2dff-497b-8c94-a62010314d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:50.896064 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ceb7f-4036-4fb3-b3a5-0752f8926617 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:50.896488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f8b51-2dff-497b-8c94-a62010314d6f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:50.896488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f8b51-2dff-497b-8c94-a62010314d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:50.896488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f8b51-2dff-497b-8c94-a62010314d6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:50.915371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f8b51-2dff-497b-8c94-a62010314d6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:50.915371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-018f8b51-2dff-497b-8c94-a62010314d6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:50.915371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:50.915371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:50.915371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:50.915371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:50.915371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:50.915371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:50.915371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:50.915371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:50.915371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:50.915371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:50.915371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:50.915371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:50.916190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:50.917002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:50.917002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:50.917002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:50.917002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:50.917002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:50.917002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:50.917002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:50.917002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:50.917002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:50.917002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:50.917002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:50.917002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:50.917002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:50.917002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:50.917002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 107/213] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:50.924723 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f8b51-2dff-497b-8c94-a62010314d6f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:50.960436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:51.009437 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ceb7f-4036-4fb3-b3a5-0752f8926617 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:51.037901 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:51.051825 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928b8dc-d06f-47c3-ae6a-aa9ba90cb455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:51.052614 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928b8dc-d06f-47c3-ae6a-aa9ba90cb455 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:51.052989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928b8dc-d06f-47c3-ae6a-aa9ba90cb455 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:51.053336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928b8dc-d06f-47c3-ae6a-aa9ba90cb455 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:51.055267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928b8dc-d06f-47c3-ae6a-aa9ba90cb455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:51.057221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928b8dc-d06f-47c3-ae6a-aa9ba90cb455 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:51.059143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 107/214] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:09:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:51.064661 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928b8dc-d06f-47c3-ae6a-aa9ba90cb455 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:51.069919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f8b51-2dff-497b-8c94-a62010314d6f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:51.117882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d65d0-2efa-4307-8de9-785e3fee78ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:51.119015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d65d0-2efa-4307-8de9-785e3fee78ac None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:51.119463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d65d0-2efa-4307-8de9-785e3fee78ac None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:51.120123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d65d0-2efa-4307-8de9-785e3fee78ac None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:51.121367 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d65d0-2efa-4307-8de9-785e3fee78ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:51.121885 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d65d0-2efa-4307-8de9-785e3fee78ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:51.123999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d65d0-2efa-4307-8de9-785e3fee78ac None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:51.141149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 108/215] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:09:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:51.141813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d65d0-2efa-4307-8de9-785e3fee78ac None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:51.193574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928b8dc-d06f-47c3-ae6a-aa9ba90cb455 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:51.227659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:51.237110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa5d91-79e5-41ae-bf23-e923c03ca4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:51.238368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa5d91-79e5-41ae-bf23-e923c03ca4d3 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:51.238833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa5d91-79e5-41ae-bf23-e923c03ca4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:51.239244 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa5d91-79e5-41ae-bf23-e923c03ca4d3 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:51.240127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa5d91-79e5-41ae-bf23-e923c03ca4d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:51.241836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa5d91-79e5-41ae-bf23-e923c03ca4d3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:51.250633 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d65d0-2efa-4307-8de9-785e3fee78ac None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:51.269377 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 108/216] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:09:51 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:09:51.308621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ac57e-1bfa-471b-a9e1-00b3d795b2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:51.310106 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac57e-1bfa-471b-a9e1-00b3d795b2ae None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:51.310596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac57e-1bfa-471b-a9e1-00b3d795b2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:51.311138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac57e-1bfa-471b-a9e1-00b3d795b2ae None admin] PATH_INFO: `/v3/users/a2720c3bd895445eb24baf17f7e1a348` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:51.328779 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ac57e-1bfa-471b-a9e1-00b3d795b2ae None admin] RBAC: Authorizing `identity:get_user(user_id=a2720c3bd895445eb24baf17f7e1a348)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:51.330786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ac57e-1bfa-471b-a9e1-00b3d795b2ae None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:51.333340 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 109/217] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:51 2022] GET /identity/v3/users/a2720c3bd895445eb24baf17f7e1a348 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:51.339754 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa5d91-79e5-41ae-bf23-e923c03ca4d3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:51.401101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:51.465726 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa5d91-79e5-41ae-bf23-e923c03ca4d3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:51.510272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21c96b-48b3-4db2-982f-d634aa452fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:51.511144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21c96b-48b3-4db2-982f-d634aa452fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:51.511419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21c96b-48b3-4db2-982f-d634aa452fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:51.511686 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21c96b-48b3-4db2-982f-d634aa452fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:51.585329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21c96b-48b3-4db2-982f-d634aa452fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:51.587068 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21c96b-48b3-4db2-982f-d634aa452fb9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:51.590373 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e56b0-7193-463f-a96e-c46db55f94ee None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:51.590841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e56b0-7193-463f-a96e-c46db55f94ee None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:51.590949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e56b0-7193-463f-a96e-c46db55f94ee None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:51.593118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 110/218] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:09:51.601856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53be9b-2f20-4dc9-a4d6-aea0bfe9c143 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:51.602141 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53be9b-2f20-4dc9-a4d6-aea0bfe9c143 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:51.602413 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53be9b-2f20-4dc9-a4d6-aea0bfe9c143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:51.630186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1a53be9b-2f20-4dc9-a4d6-aea0bfe9c143 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:51.633115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1a53be9b-2f20-4dc9-a4d6-aea0bfe9c143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:51.641196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:51.707268 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 109/219] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:09:51.713195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21c96b-48b3-4db2-982f-d634aa452fb9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:51.721676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 111/220] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:51.822416 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21c96b-48b3-4db2-982f-d634aa452fb9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:51.862033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b752a0-a3be-4d81-9f31-cc2857e1ba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:51.862602 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b752a0-a3be-4d81-9f31-cc2857e1ba22 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:51.862878 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b752a0-a3be-4d81-9f31-cc2857e1ba22 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:51.863145 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b752a0-a3be-4d81-9f31-cc2857e1ba22 None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:51.864285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b752a0-a3be-4d81-9f31-cc2857e1ba22 None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:51.865733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b752a0-a3be-4d81-9f31-cc2857e1ba22 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:51.867388 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 110/221] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:51 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:51.874806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53be9b-2f20-4dc9-a4d6-aea0bfe9c143 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:51.956862 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3889ef9-5351-40c4-80b8-30d99a9f1725 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:51.957870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3889ef9-5351-40c4-80b8-30d99a9f1725 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:51.958246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3889ef9-5351-40c4-80b8-30d99a9f1725 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:51.959694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 111/222] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:09:51.975834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd42bc6-eaaf-4458-af40-270d3c6f7ae3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:51.976422 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd42bc6-eaaf-4458-af40-270d3c6f7ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:51.976913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd42bc6-eaaf-4458-af40-270d3c6f7ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:51.983597 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:52.006704 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ccd42bc6-eaaf-4458-af40-270d3c6f7ae3 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:52.013727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ccd42bc6-eaaf-4458-af40-270d3c6f7ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:52.036977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:52.039963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53be9b-2f20-4dc9-a4d6-aea0bfe9c143 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:52.080250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab2622-2b08-4842-8a36-e357d8829c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:52.080895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab2622-2b08-4842-8a36-e357d8829c86 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:52.081171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab2622-2b08-4842-8a36-e357d8829c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:52.081440 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab2622-2b08-4842-8a36-e357d8829c86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:52.082318 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab2622-2b08-4842-8a36-e357d8829c86 None admin] RBAC: Adding query filter params (role.id=1c0bdbdf6a98487cac86e3de530b11d2, scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2, user.id=a2720c3bd895445eb24baf17f7e1a348) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:52.082715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab2622-2b08-4842-8a36-e357d8829c86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:52.084163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab2622-2b08-4842-8a36-e357d8829c86 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:52.090809 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 112/223] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:51 2022] GET /identity/v3/role_assignments?user.id=a2720c3bd895445eb24baf17f7e1a348&scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2&role.id=1c0bdbdf6a98487cac86e3de530b11d2 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:52.091617 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab2622-2b08-4842-8a36-e357d8829c86 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:52.113213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 112/224] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:09:52.229503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab2622-2b08-4842-8a36-e357d8829c86 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:52.294469 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1bee9-c14c-43e9-b8a0-074b6c2de382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:52.295117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1bee9-c14c-43e9-b8a0-074b6c2de382 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:52.295397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1bee9-c14c-43e9-b8a0-074b6c2de382 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:52.295665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1bee9-c14c-43e9-b8a0-074b6c2de382 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:52.306920 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:52.311132 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1bee9-c14c-43e9-b8a0-074b6c2de382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e5b1bee9-c14c-43e9-b8a0-074b6c2de382 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:52.318034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:52.318897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:52.319666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:52.319666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:52.319666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:52.319666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:52.319666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:52.319666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:52.319666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:52.319666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:52.319666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:52.319666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:52.319666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:52.319666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:52.319666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 113/225] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:09:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:52.325171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd42bc6-eaaf-4458-af40-270d3c6f7ae3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:52.463839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd42bc6-eaaf-4458-af40-270d3c6f7ae3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:52.499728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dfa95-55d6-4465-a565-bff353780790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:52.500352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dfa95-55d6-4465-a565-bff353780790 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:52.500634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dfa95-55d6-4465-a565-bff353780790 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:52.500908 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dfa95-55d6-4465-a565-bff353780790 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:52.501844 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dfa95-55d6-4465-a565-bff353780790 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:52.502156 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dfa95-55d6-4465-a565-bff353780790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:52.503540 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dfa95-55d6-4465-a565-bff353780790 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:52.512592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 113/226] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:52.518643 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1bee9-c14c-43e9-b8a0-074b6c2de382 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:52.573881 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dfa95-55d6-4465-a565-bff353780790 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:52.588231 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:52.689941 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dfa95-55d6-4465-a565-bff353780790 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:52.726813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dee18-72ae-46d8-bb05-7c216317f223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:52.727726 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dee18-72ae-46d8-bb05-7c216317f223 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:52.728061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dee18-72ae-46d8-bb05-7c216317f223 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:52.728288 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dee18-72ae-46d8-bb05-7c216317f223 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:52.742336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07dee18-72ae-46d8-bb05-7c216317f223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-d07dee18-72ae-46d8-bb05-7c216317f223 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:52.748329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:52.749201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:52.751528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:52.751528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:52.751528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:52.751528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:52.751528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:52.751528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:52.751528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:52.751528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:52.751528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:52.751528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:52.751528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:09:52.751528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:09:52.751528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 114/227] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:09:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:52.759788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1bee9-c14c-43e9-b8a0-074b6c2de382 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:52.762039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dee18-72ae-46d8-bb05-7c216317f223 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:52.826787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9cac7-97a3-4794-b6dd-b95bdb2352de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:52.827430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9cac7-97a3-4794-b6dd-b95bdb2352de None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:52.827713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9cac7-97a3-4794-b6dd-b95bdb2352de None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:52.827987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9cac7-97a3-4794-b6dd-b95bdb2352de None admin] PATH_INFO: `/v3/users/b5b1504290ae46f5852ce71d5a24367d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:52.831191 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9cac7-97a3-4794-b6dd-b95bdb2352de None admin] RBAC: Authorizing `identity:get_user(user_id=b5b1504290ae46f5852ce71d5a24367d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:52.832650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9cac7-97a3-4794-b6dd-b95bdb2352de None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:52.834263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 114/228] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:52 2022] GET /identity/v3/users/b5b1504290ae46f5852ce71d5a24367d => generated 283 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:52.840371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9cac7-97a3-4794-b6dd-b95bdb2352de None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:52.903643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:52.936957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:52.972796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dee18-72ae-46d8-bb05-7c216317f223 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:53.006349 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9cac7-97a3-4794-b6dd-b95bdb2352de None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:53.009076 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744d2ae-ceae-477e-9eec-4e8a70a1aab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:53.009716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744d2ae-ceae-477e-9eec-4e8a70a1aab7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:53.010011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744d2ae-ceae-477e-9eec-4e8a70a1aab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:53.010289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744d2ae-ceae-477e-9eec-4e8a70a1aab7 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:53.010964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744d2ae-ceae-477e-9eec-4e8a70a1aab7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:53.011269 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744d2ae-ceae-477e-9eec-4e8a70a1aab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:53.012649 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744d2ae-ceae-477e-9eec-4e8a70a1aab7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:53.022019 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 115/229] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:09:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:53.027519 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744d2ae-ceae-477e-9eec-4e8a70a1aab7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:53.074420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3977009-20d4-4955-a494-5a951c0ed69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:53.075071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3977009-20d4-4955-a494-5a951c0ed69c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:53.075356 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3977009-20d4-4955-a494-5a951c0ed69c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:53.075628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3977009-20d4-4955-a494-5a951c0ed69c None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:53.076802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3977009-20d4-4955-a494-5a951c0ed69c None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:53.078269 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3977009-20d4-4955-a494-5a951c0ed69c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:53.080270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 115/230] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:52 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:53.085734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3977009-20d4-4955-a494-5a951c0ed69c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:53.134436 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744d2ae-ceae-477e-9eec-4e8a70a1aab7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:53.167599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:53.172675 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534018c-eda2-4a92-bb93-3ae057b568cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:53.173861 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534018c-eda2-4a92-bb93-3ae057b568cb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:53.174149 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534018c-eda2-4a92-bb93-3ae057b568cb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:53.174426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534018c-eda2-4a92-bb93-3ae057b568cb None admin] PATH_INFO: `/v3/users/b5b1504290ae46f5852ce71d5a24367d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:53.178287 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534018c-eda2-4a92-bb93-3ae057b568cb None admin] RBAC: Authorizing `identity:get_user(user_id=b5b1504290ae46f5852ce71d5a24367d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:53.180768 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534018c-eda2-4a92-bb93-3ae057b568cb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:53.182599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 116/231] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:53 2022] GET /identity/v3/users/b5b1504290ae46f5852ce71d5a24367d => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:53.189434 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534018c-eda2-4a92-bb93-3ae057b568cb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:53.299423 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534018c-eda2-4a92-bb93-3ae057b568cb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:53.331862 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3977009-20d4-4955-a494-5a951c0ed69c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:53.333149 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd9a77-0d69-4a70-9a38-23e1d2d727b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:53.333824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd9a77-0d69-4a70-9a38-23e1d2d727b2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:53.334116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd9a77-0d69-4a70-9a38-23e1d2d727b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:53.334397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd9a77-0d69-4a70-9a38-23e1d2d727b2 None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:53.335555 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd9a77-0d69-4a70-9a38-23e1d2d727b2 None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:53.337259 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd9a77-0d69-4a70-9a38-23e1d2d727b2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:53.343743 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 117/232] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:53 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:53.345578 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd9a77-0d69-4a70-9a38-23e1d2d727b2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:53.403954 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:53.418015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:53.434950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46a400-04c8-4657-b719-318dcb20cbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:53.435633 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46a400-04c8-4657-b719-318dcb20cbf0 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:53.435909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46a400-04c8-4657-b719-318dcb20cbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:53.436180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46a400-04c8-4657-b719-318dcb20cbf0 None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2/users/b5b1504290ae46f5852ce71d5a24367d/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:53.438131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46a400-04c8-4657-b719-318dcb20cbf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad3b24197d4b3b8d9880cb3f4241e2, user_id=b5b1504290ae46f5852ce71d5a24367d, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:53.440436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46a400-04c8-4657-b719-318dcb20cbf0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:53.449331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd9a77-0d69-4a70-9a38-23e1d2d727b2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:53.472294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 116/233] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:09:53 2022] PUT /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2/users/b5b1504290ae46f5852ce71d5a24367d/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:09:53.493475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedd844-03ab-42ae-8bf2-cfe83498f0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:53.494176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedd844-03ab-42ae-8bf2-cfe83498f0bd None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:53.494458 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedd844-03ab-42ae-8bf2-cfe83498f0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:53.494733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedd844-03ab-42ae-8bf2-cfe83498f0bd None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2/users/b5b1504290ae46f5852ce71d5a24367d/roles/a1b50a29e5e4419db517dfaf3d70c19f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:53.497167 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedd844-03ab-42ae-8bf2-cfe83498f0bd None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad3b24197d4b3b8d9880cb3f4241e2, user_id=b5b1504290ae46f5852ce71d5a24367d, role_id=a1b50a29e5e4419db517dfaf3d70c19f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:53.498713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedd844-03ab-42ae-8bf2-cfe83498f0bd None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:53.525991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 118/234] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:09:53 2022] PUT /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2/users/b5b1504290ae46f5852ce71d5a24367d/roles/a1b50a29e5e4419db517dfaf3d70c19f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:09:54.070359 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec62c8-d7a0-4450-847c-064b8c54ff13 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:54.070868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec62c8-d7a0-4450-847c-064b8c54ff13 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:54.070868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec62c8-d7a0-4450-847c-064b8c54ff13 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:54.072450 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 117/235] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:54.078001 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c386cb-761f-47e4-ab57-9a7918bd871d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:54.078450 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c386cb-761f-47e4-ab57-9a7918bd871d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:54.078525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c386cb-761f-47e4-ab57-9a7918bd871d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:54.111426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-89c386cb-761f-47e4-ab57-9a7918bd871d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:54.112733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-89c386cb-761f-47e4-ab57-9a7918bd871d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:54.208152 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 119/236] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:09:54.420966 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25af24e-44b9-4a7a-ab6f-32d6a0fb873e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:54.421251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25af24e-44b9-4a7a-ab6f-32d6a0fb873e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:54.421421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25af24e-44b9-4a7a-ab6f-32d6a0fb873e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:54.423150 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 118/237] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:54.433664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0638b-49e4-41d0-8b23-9c3a9dd0faf0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:54.433977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0638b-49e4-41d0-8b23-9c3a9dd0faf0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:54.434250 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0638b-49e4-41d0-8b23-9c3a9dd0faf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:54.465902 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-85a0638b-49e4-41d0-8b23-9c3a9dd0faf0 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:54.467088 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-85a0638b-49e4-41d0-8b23-9c3a9dd0faf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:54.534196 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25af24e-44b9-4a7a-ab6f-32d6a0fb873e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:54.544908 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:54.570280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 120/238] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:54.627221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5791e-4259-4bf3-8cfa-8b48d9ab801c None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:54.628141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5791e-4259-4bf3-8cfa-8b48d9ab801c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:54.628629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5791e-4259-4bf3-8cfa-8b48d9ab801c None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:54.630821 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 121/239] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:09:54.639164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696fcad-951a-4853-a8bf-54a632a11de2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:54.639450 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696fcad-951a-4853-a8bf-54a632a11de2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:54.639725 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696fcad-951a-4853-a8bf-54a632a11de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:54.670636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a696fcad-951a-4853-a8bf-54a632a11de2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:54.671870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a696fcad-951a-4853-a8bf-54a632a11de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:54.711948 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25af24e-44b9-4a7a-ab6f-32d6a0fb873e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:54.752204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7ccd2-a89d-4f08-9623-1d96a3d7755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:54.752839 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7ccd2-a89d-4f08-9623-1d96a3d7755a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:54.753120 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7ccd2-a89d-4f08-9623-1d96a3d7755a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:54.753394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7ccd2-a89d-4f08-9623-1d96a3d7755a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:54.754539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7ccd2-a89d-4f08-9623-1d96a3d7755a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:54.755992 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7ccd2-a89d-4f08-9623-1d96a3d7755a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:54.757930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 119/240] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:09:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:54.763384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7ccd2-a89d-4f08-9623-1d96a3d7755a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:54.817548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 122/241] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:54.872352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:54.923759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696fcad-951a-4853-a8bf-54a632a11de2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:54.929848 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7ccd2-a89d-4f08-9623-1d96a3d7755a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:54.965838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9675926-3c52-43d0-abbd-d11d8cef41b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:54.966435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9675926-3c52-43d0-abbd-d11d8cef41b1 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:54.966710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9675926-3c52-43d0-abbd-d11d8cef41b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:54.966982 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9675926-3c52-43d0-abbd-d11d8cef41b1 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:54.967631 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9675926-3c52-43d0-abbd-d11d8cef41b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:54.969059 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9675926-3c52-43d0-abbd-d11d8cef41b1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:54.995607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 120/242] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:09:54 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:09:55.084618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696fcad-951a-4853-a8bf-54a632a11de2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:55.104811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:55.119402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9675926-3c52-43d0-abbd-d11d8cef41b1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:55.125402 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c4b7-3f1a-4efd-9c18-56c6be992313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:55.126815 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c4b7-3f1a-4efd-9c18-56c6be992313 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:55.127314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c4b7-3f1a-4efd-9c18-56c6be992313 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:55.127619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c4b7-3f1a-4efd-9c18-56c6be992313 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:55.142412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7c4b7-3f1a-4efd-9c18-56c6be992313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-76c7c4b7-3f1a-4efd-9c18-56c6be992313 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:55.148674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:55.149636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:55.154770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:55.154770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:55.154770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:55.154770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:55.154770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:55.154770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:55.154770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:55.154770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:55.154770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:55.154770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:55.154770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:09:55.154770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:09:55.154770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 123/243] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:09:55.158575 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c4b7-3f1a-4efd-9c18-56c6be992313 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:55.259923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9675926-3c52-43d0-abbd-d11d8cef41b1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:55.285211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:55.302305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c4b7-3f1a-4efd-9c18-56c6be992313 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:55.326033 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17037f6-7c3e-4ecf-b5b5-dec7530c8308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:55.327143 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17037f6-7c3e-4ecf-b5b5-dec7530c8308 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:55.327616 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17037f6-7c3e-4ecf-b5b5-dec7530c8308 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:55.328081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17037f6-7c3e-4ecf-b5b5-dec7530c8308 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:55.341948 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17037f6-7c3e-4ecf-b5b5-dec7530c8308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:55.346233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4f891-3e70-44ca-bcb2-80f7534a80c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:55.346851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4f891-3e70-44ca-bcb2-80f7534a80c6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:55.347130 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4f891-3e70-44ca-bcb2-80f7534a80c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:55.347403 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4f891-3e70-44ca-bcb2-80f7534a80c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:55.348073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4f891-3e70-44ca-bcb2-80f7534a80c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:55.348376 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4f891-3e70-44ca-bcb2-80f7534a80c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e17037f6-7c3e-4ecf-b5b5-dec7530c8308 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:55.349569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:55.350445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:55.351227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:55.351227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:55.351227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:55.351227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:55.351227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:55.351227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:55.351227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:55.351227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:55.351227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:55.351227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:55.351227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:55.351227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:55.351909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4f891-3e70-44ca-bcb2-80f7534a80c6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:55.353721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 121/244] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:09:55.360904 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 124/245] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:09:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:55.361913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17037f6-7c3e-4ecf-b5b5-dec7530c8308 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:55.367750 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4f891-3e70-44ca-bcb2-80f7534a80c6 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:55.415996 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:55.514050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4f891-3e70-44ca-bcb2-80f7534a80c6 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:55.515206 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17037f6-7c3e-4ecf-b5b5-dec7530c8308 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:55.558656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f42b18-7158-469a-a0b8-79e5cc56e027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:55.559304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f42b18-7158-469a-a0b8-79e5cc56e027 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:55.559585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f42b18-7158-469a-a0b8-79e5cc56e027 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:55.559860 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f42b18-7158-469a-a0b8-79e5cc56e027 None admin] PATH_INFO: `/v3/users/2d27e3c5a50847b2aa5e5dbc04c7bb6f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:55.562282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76f728-8824-4658-a2ca-7a8285966b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:55.563159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76f728-8824-4658-a2ca-7a8285966b3a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:55.564426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76f728-8824-4658-a2ca-7a8285966b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:55.565030 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76f728-8824-4658-a2ca-7a8285966b3a None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:55.565893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76f728-8824-4658-a2ca-7a8285966b3a None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:55.566385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76f728-8824-4658-a2ca-7a8285966b3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:55.567938 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76f728-8824-4658-a2ca-7a8285966b3a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:55.577856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 122/246] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:09:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:55.582217 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f42b18-7158-469a-a0b8-79e5cc56e027 None admin] RBAC: Authorizing `identity:get_user(user_id=2d27e3c5a50847b2aa5e5dbc04c7bb6f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:55.584046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f42b18-7158-469a-a0b8-79e5cc56e027 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:55.585157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76f728-8824-4658-a2ca-7a8285966b3a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:55.587701 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 125/247] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:55 2022] GET /identity/v3/users/2d27e3c5a50847b2aa5e5dbc04c7bb6f => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:55.594018 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f42b18-7158-469a-a0b8-79e5cc56e027 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:55.634392 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:55.730658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:55.735339 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76f728-8824-4658-a2ca-7a8285966b3a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:55.739259 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f42b18-7158-469a-a0b8-79e5cc56e027 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:55.778769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125b115-5fe6-4bd1-8dca-e37110de895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:55.779704 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125b115-5fe6-4bd1-8dca-e37110de895d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:55.780114 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125b115-5fe6-4bd1-8dca-e37110de895d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:55.780505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125b115-5fe6-4bd1-8dca-e37110de895d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:55.784047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0957513-9558-49a2-8d87-90b20fe06112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:55.784812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0957513-9558-49a2-8d87-90b20fe06112 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:55.785200 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0957513-9558-49a2-8d87-90b20fe06112 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:55.786045 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0957513-9558-49a2-8d87-90b20fe06112 None admin] PATH_INFO: `/v3/users/a2720c3bd895445eb24baf17f7e1a348` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:55.788342 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0957513-9558-49a2-8d87-90b20fe06112 None admin] RBAC: Authorizing `identity:get_user(user_id=a2720c3bd895445eb24baf17f7e1a348)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:55.789946 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0957513-9558-49a2-8d87-90b20fe06112 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:55.793782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 123/248] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:55 2022] GET /identity/v3/users/a2720c3bd895445eb24baf17f7e1a348 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:55.799297 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0957513-9558-49a2-8d87-90b20fe06112 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:55.886908 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125b115-5fe6-4bd1-8dca-e37110de895d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:55.889445 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125b115-5fe6-4bd1-8dca-e37110de895d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:55.912282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0957513-9558-49a2-8d87-90b20fe06112 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:55.915800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:55.950717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64511b4d-51c6-45ff-ad3e-7c0411ca66fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:55.951641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64511b4d-51c6-45ff-ad3e-7c0411ca66fd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:55.952089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64511b4d-51c6-45ff-ad3e-7c0411ca66fd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:55.952556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64511b4d-51c6-45ff-ad3e-7c0411ca66fd None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:55.955435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64511b4d-51c6-45ff-ad3e-7c0411ca66fd None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:55.957109 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64511b4d-51c6-45ff-ad3e-7c0411ca66fd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:55.959209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 124/249] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:55 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:55.966192 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64511b4d-51c6-45ff-ad3e-7c0411ca66fd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:56.010380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:56.018723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 126/250] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:09:56.026683 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125b115-5fe6-4bd1-8dca-e37110de895d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:56.096089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64511b4d-51c6-45ff-ad3e-7c0411ca66fd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:56.137150 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59e421-157b-4d6f-bd1a-8b97f66c99d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:56.138539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59e421-157b-4d6f-bd1a-8b97f66c99d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:56.138964 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59e421-157b-4d6f-bd1a-8b97f66c99d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:56.139461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59e421-157b-4d6f-bd1a-8b97f66c99d4 None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2/users/a2720c3bd895445eb24baf17f7e1a348/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:56.142272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59e421-157b-4d6f-bd1a-8b97f66c99d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad3b24197d4b3b8d9880cb3f4241e2, user_id=a2720c3bd895445eb24baf17f7e1a348, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:56.144085 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59e421-157b-4d6f-bd1a-8b97f66c99d4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:56.163400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 125/251] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:09:55 2022] PUT /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2/users/a2720c3bd895445eb24baf17f7e1a348/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:09:56.212671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125b115-5fe6-4bd1-8dca-e37110de895d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:56.257853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ac986-10c9-4aec-8f44-77eff839cb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:56.258753 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ac986-10c9-4aec-8f44-77eff839cb10 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:56.259211 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ac986-10c9-4aec-8f44-77eff839cb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:56.259697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ac986-10c9-4aec-8f44-77eff839cb10 None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:56.261097 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ac986-10c9-4aec-8f44-77eff839cb10 None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:56.262747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ac986-10c9-4aec-8f44-77eff839cb10 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:56.264661 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 127/252] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:56 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:56.271398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59e421-157b-4d6f-bd1a-8b97f66c99d4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:56.316207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:56.411525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59e421-157b-4d6f-bd1a-8b97f66c99d4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:56.461414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff434fd-9ab7-45e3-8d55-5045a48d040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:56.462075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff434fd-9ab7-45e3-8d55-5045a48d040c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:56.462360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff434fd-9ab7-45e3-8d55-5045a48d040c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:56.462637 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff434fd-9ab7-45e3-8d55-5045a48d040c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:56.463383 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff434fd-9ab7-45e3-8d55-5045a48d040c None admin] RBAC: Adding query filter params (role.id=3d56d71a94cf4ce1887d1b743039657b, scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2, user.id=2d27e3c5a50847b2aa5e5dbc04c7bb6f) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:56.463695 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff434fd-9ab7-45e3-8d55-5045a48d040c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:56.465175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff434fd-9ab7-45e3-8d55-5045a48d040c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:56.472508 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 126/253] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:56 2022] GET /identity/v3/role_assignments?user.id=2d27e3c5a50847b2aa5e5dbc04c7bb6f&scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2&role.id=3d56d71a94cf4ce1887d1b743039657b => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:56.667164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fda932-8d04-4f69-8107-60d5fadf9690 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:56.667779 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fda932-8d04-4f69-8107-60d5fadf9690 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:56.668291 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fda932-8d04-4f69-8107-60d5fadf9690 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:56.669899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 128/254] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:56.685837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf745ff-ac61-41f8-b850-349307bbdeaf None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:56.686449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf745ff-ac61-41f8-b850-349307bbdeaf None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:56.686931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf745ff-ac61-41f8-b850-349307bbdeaf None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:56.689367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 129/255] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:56.691104 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e457594-6f4f-4414-88e5-45b65a6b9376 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:56.691620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e457594-6f4f-4414-88e5-45b65a6b9376 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:56.692114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e457594-6f4f-4414-88e5-45b65a6b9376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:56.703279 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb7488-4002-4434-bfba-8b738c5f15b8 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:56.704479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb7488-4002-4434-bfba-8b738c5f15b8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:56.704950 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb7488-4002-4434-bfba-8b738c5f15b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:56.717061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2e457594-6f4f-4414-88e5-45b65a6b9376 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:56.718333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2e457594-6f4f-4414-88e5-45b65a6b9376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:56.751334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e6cb7488-4002-4434-bfba-8b738c5f15b8 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:56.752999 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e6cb7488-4002-4434-bfba-8b738c5f15b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:56.822342 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:56.831027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 127/256] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:56.833614 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 130/257] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:09:57.368945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e457594-6f4f-4414-88e5-45b65a6b9376 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:57.372724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb7488-4002-4434-bfba-8b738c5f15b8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:57.429170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:57.564149 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb7488-4002-4434-bfba-8b738c5f15b8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:57.568155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e457594-6f4f-4414-88e5-45b65a6b9376 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:57.622963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdacd1-9c4c-409f-afbf-15deb6a87d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:57.623526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdacd1-9c4c-409f-afbf-15deb6a87d3e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:57.623808 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdacd1-9c4c-409f-afbf-15deb6a87d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:57.624082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdacd1-9c4c-409f-afbf-15deb6a87d3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:57.628905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87844db3-63b5-4f44-b680-8fda6e7e524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:57.629603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87844db3-63b5-4f44-b680-8fda6e7e524d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:57.629914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87844db3-63b5-4f44-b680-8fda6e7e524d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:57.630187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87844db3-63b5-4f44-b680-8fda6e7e524d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:57.650265 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cdacd1-9c4c-409f-afbf-15deb6a87d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-44cdacd1-9c4c-409f-afbf-15deb6a87d3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:57.665429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:57.666356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:57.668716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:57.668716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:57.668716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:57.668716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:57.668716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:57.668716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:57.668716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:57.668716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:57.668716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:57.668716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:57.668716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:09:57.668716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:09:57.668716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 131/258] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:09:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:57.670359 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87844db3-63b5-4f44-b680-8fda6e7e524d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-87844db3-63b5-4f44-b680-8fda6e7e524d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:57.674803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:57.676826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:57.678872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:57.678872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:57.678872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:57.678872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:57.678872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:57.678872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:57.678872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:57.678872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:57.678872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:57.678872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:57.678872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:09:57.678872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:57.680326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdacd1-9c4c-409f-afbf-15deb6a87d3e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:57.680469 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 128/259] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:09:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:57.686892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87844db3-63b5-4f44-b680-8fda6e7e524d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:57.791354 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:57.853605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdacd1-9c4c-409f-afbf-15deb6a87d3e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:57.890212 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:57.892481 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418005d0-6b14-4d06-8d3c-6ad8de8c3e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:57.893477 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418005d0-6b14-4d06-8d3c-6ad8de8c3e48 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:57.894128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418005d0-6b14-4d06-8d3c-6ad8de8c3e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:57.894746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418005d0-6b14-4d06-8d3c-6ad8de8c3e48 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:57.895756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418005d0-6b14-4d06-8d3c-6ad8de8c3e48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:57.896584 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418005d0-6b14-4d06-8d3c-6ad8de8c3e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:57.898218 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418005d0-6b14-4d06-8d3c-6ad8de8c3e48 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:57.908092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 132/260] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:57.913706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87844db3-63b5-4f44-b680-8fda6e7e524d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:57.921256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418005d0-6b14-4d06-8d3c-6ad8de8c3e48 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:57.987755 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a59393-acc8-44f7-97f8-3ec7873f5dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:57.988465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a59393-acc8-44f7-97f8-3ec7873f5dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:57.988745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a59393-acc8-44f7-97f8-3ec7873f5dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:57.989017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a59393-acc8-44f7-97f8-3ec7873f5dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:57.989700 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a59393-acc8-44f7-97f8-3ec7873f5dc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:57.990021 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a59393-acc8-44f7-97f8-3ec7873f5dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:57.991415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a59393-acc8-44f7-97f8-3ec7873f5dc9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:58.012130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 129/261] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:09:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:58.022738 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a59393-acc8-44f7-97f8-3ec7873f5dc9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:58.034036 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418005d0-6b14-4d06-8d3c-6ad8de8c3e48 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:58.055966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:58.071334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b015b3-7777-40df-a049-b7ad9180a93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:58.072607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b015b3-7777-40df-a049-b7ad9180a93c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:58.073088 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b015b3-7777-40df-a049-b7ad9180a93c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:58.073575 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b015b3-7777-40df-a049-b7ad9180a93c None admin] PATH_INFO: `/v3/users/b5b1504290ae46f5852ce71d5a24367d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:58.075398 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b015b3-7777-40df-a049-b7ad9180a93c None admin] RBAC: Authorizing `identity:get_user(user_id=b5b1504290ae46f5852ce71d5a24367d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:58.077199 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b015b3-7777-40df-a049-b7ad9180a93c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:58.080221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 133/262] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:57 2022] GET /identity/v3/users/b5b1504290ae46f5852ce71d5a24367d => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:58.086759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b015b3-7777-40df-a049-b7ad9180a93c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:58.276355 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b015b3-7777-40df-a049-b7ad9180a93c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:58.292542 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a59393-acc8-44f7-97f8-3ec7873f5dc9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:58.317454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7f7da-61d1-44f1-a9ec-88e0adea24d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:58.318745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f7da-61d1-44f1-a9ec-88e0adea24d2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:58.319227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f7da-61d1-44f1-a9ec-88e0adea24d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:58.319723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f7da-61d1-44f1-a9ec-88e0adea24d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:58.386190 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:58.402208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7f7da-61d1-44f1-a9ec-88e0adea24d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:58.403820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7f7da-61d1-44f1-a9ec-88e0adea24d2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:58.434974 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6947484-a1e3-4a66-b8bc-186c3a1ef8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:58.435642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6947484-a1e3-4a66-b8bc-186c3a1ef8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:58.435925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6947484-a1e3-4a66-b8bc-186c3a1ef8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:58.436204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6947484-a1e3-4a66-b8bc-186c3a1ef8d8 None admin] PATH_INFO: `/v3/users/b5b1504290ae46f5852ce71d5a24367d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:58.437351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6947484-a1e3-4a66-b8bc-186c3a1ef8d8 None admin] RBAC: Authorizing `identity:get_user(user_id=b5b1504290ae46f5852ce71d5a24367d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:58.439558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6947484-a1e3-4a66-b8bc-186c3a1ef8d8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:58.441629 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 130/263] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:09:58 2022] GET /identity/v3/users/b5b1504290ae46f5852ce71d5a24367d => generated 283 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:58.447015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6947484-a1e3-4a66-b8bc-186c3a1ef8d8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:58.510087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:58.550746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 134/264] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:09:58.552027 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82755c55-c299-43a2-ad28-1fd26cda95ed None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:58.552378 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82755c55-c299-43a2-ad28-1fd26cda95ed None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:58.552719 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82755c55-c299-43a2-ad28-1fd26cda95ed None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:58.554483 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 135/265] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:58.555993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82755c55-c299-43a2-ad28-1fd26cda95ed None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:58.651734 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:58.671712 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6947484-a1e3-4a66-b8bc-186c3a1ef8d8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:58.676735 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82755c55-c299-43a2-ad28-1fd26cda95ed None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:58.744831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654aa9c-1311-4a3d-b21d-c862cd18e9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:58.745449 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654aa9c-1311-4a3d-b21d-c862cd18e9ae None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:58.745739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654aa9c-1311-4a3d-b21d-c862cd18e9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:58.746014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654aa9c-1311-4a3d-b21d-c862cd18e9ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:58.752964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cad1b1-b02d-46d7-8384-1f424db85271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:58.753595 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cad1b1-b02d-46d7-8384-1f424db85271 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:58.753953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cad1b1-b02d-46d7-8384-1f424db85271 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:58.754227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cad1b1-b02d-46d7-8384-1f424db85271 None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:58.758470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cad1b1-b02d-46d7-8384-1f424db85271 None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:58.760082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cad1b1-b02d-46d7-8384-1f424db85271 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:58.762254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 136/266] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:58 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:09:58.763430 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc018eb-e6c4-423b-a861-55c21514aa24 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:58.763712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc018eb-e6c4-423b-a861-55c21514aa24 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:58.763985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc018eb-e6c4-423b-a861-55c21514aa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:58.791910 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2fc018eb-e6c4-423b-a861-55c21514aa24 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:58.793121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2fc018eb-e6c4-423b-a861-55c21514aa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:58.856099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654aa9c-1311-4a3d-b21d-c862cd18e9ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:58.857600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654aa9c-1311-4a3d-b21d-c862cd18e9ae None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:58.871714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 137/267] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:09:58.872563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc018eb-e6c4-423b-a861-55c21514aa24 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:58.886656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:58.977486 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:59.010903 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc018eb-e6c4-423b-a861-55c21514aa24 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:59.017224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 131/268] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:09:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 17:09:59.018667 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c4cf9-14cd-4b9d-b6f2-c565c945850d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:59.018960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c4cf9-14cd-4b9d-b6f2-c565c945850d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:59.019235 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c4cf9-14cd-4b9d-b6f2-c565c945850d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:59.020655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 132/269] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:59.028297 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b7a43-98d3-4182-8da1-f97aa3fb21d6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:59.028297 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b7a43-98d3-4182-8da1-f97aa3fb21d6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:59.028297 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b7a43-98d3-4182-8da1-f97aa3fb21d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:59.047088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-014b7a43-98d3-4182-8da1-f97aa3fb21d6 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:59.049074 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-014b7a43-98d3-4182-8da1-f97aa3fb21d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:59.097249 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103297-3028-4a18-93b3-2cb872c902bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:59.097889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103297-3028-4a18-93b3-2cb872c902bb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:59.098171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103297-3028-4a18-93b3-2cb872c902bb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:59.098443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103297-3028-4a18-93b3-2cb872c902bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:59.099174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6103297-3028-4a18-93b3-2cb872c902bb None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2, user.id=b5b1504290ae46f5852ce71d5a24367d) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:59.099484 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6103297-3028-4a18-93b3-2cb872c902bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:59.100928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6103297-3028-4a18-93b3-2cb872c902bb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:59.117945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 138/270] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:58 2022] GET /identity/v3/role_assignments?user.id=b5b1504290ae46f5852ce71d5a24367d&scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:59.118704 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103297-3028-4a18-93b3-2cb872c902bb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:59.181599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 133/271] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:09:59.183008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518c6b5-c682-4ad6-94be-ca22302da7ed None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:59.183301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518c6b5-c682-4ad6-94be-ca22302da7ed None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:59.183574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518c6b5-c682-4ad6-94be-ca22302da7ed None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:59.185228 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 134/272] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:59.191695 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38df0c-56fb-4066-944d-9649f6077f15 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:59.191984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38df0c-56fb-4066-944d-9649f6077f15 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:59.192379 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38df0c-56fb-4066-944d-9649f6077f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:59.218881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4a38df0c-56fb-4066-944d-9649f6077f15 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:09:59.220130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4a38df0c-56fb-4066-944d-9649f6077f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:09:59.303934 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:59.358069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 135/273] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:09:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:09:59.362926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38df0c-56fb-4066-944d-9649f6077f15 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:59.364213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103297-3028-4a18-93b3-2cb872c902bb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:59.460404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df187d-0062-4638-805d-79ab991a94f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:59.461409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df187d-0062-4638-805d-79ab991a94f5 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:59.465706 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df187d-0062-4638-805d-79ab991a94f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:59.465706 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df187d-0062-4638-805d-79ab991a94f5 None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:59.465706 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df187d-0062-4638-805d-79ab991a94f5 None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:59.465706 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df187d-0062-4638-805d-79ab991a94f5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:59.466236 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 139/274] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:09:59 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:59.476132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df187d-0062-4638-805d-79ab991a94f5 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:59.503739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:59.543831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38df0c-56fb-4066-944d-9649f6077f15 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:59.598155 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df187d-0062-4638-805d-79ab991a94f5 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:59.603491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92a5ae-1f92-4ea8-af13-d6fe886f79d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:59.604139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92a5ae-1f92-4ea8-af13-d6fe886f79d1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:59.604419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92a5ae-1f92-4ea8-af13-d6fe886f79d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:59.604693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92a5ae-1f92-4ea8-af13-d6fe886f79d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:59.620020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92a5ae-1f92-4ea8-af13-d6fe886f79d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ec92a5ae-1f92-4ea8-af13-d6fe886f79d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:09:59.626786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:09:59.627664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:09:59.628435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:09:59.628435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:09:59.628435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:09:59.628435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:09:59.628435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:09:59.628435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:09:59.628435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:09:59.628435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:09:59.628435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:09:59.628435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:09:59.628435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:09:59.628435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:09:59.628435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 136/275] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:09:59.629162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92a5ae-1f92-4ea8-af13-d6fe886f79d1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:59.637298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0fa5c-6d3d-40e9-bd05-d11d74265efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:59.637947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0fa5c-6d3d-40e9-bd05-d11d74265efb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:59.638234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0fa5c-6d3d-40e9-bd05-d11d74265efb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:59.638507 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0fa5c-6d3d-40e9-bd05-d11d74265efb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:59.639237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0fa5c-6d3d-40e9-bd05-d11d74265efb None admin] RBAC: Adding query filter params (role.id=a1b50a29e5e4419db517dfaf3d70c19f, scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2, user.id=b5b1504290ae46f5852ce71d5a24367d) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:59.639555 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0fa5c-6d3d-40e9-bd05-d11d74265efb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:59.640987 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0fa5c-6d3d-40e9-bd05-d11d74265efb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:59.653546 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 140/276] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:09:59 2022] GET /identity/v3/role_assignments?user.id=b5b1504290ae46f5852ce71d5a24367d&scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2&role.id=a1b50a29e5e4419db517dfaf3d70c19f => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:59.654583 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0fa5c-6d3d-40e9-bd05-d11d74265efb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:59.678662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:59.780224 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:59.797068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92a5ae-1f92-4ea8-af13-d6fe886f79d1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:59.814264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0fa5c-6d3d-40e9-bd05-d11d74265efb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:59.838188 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad1328-7855-4163-9f95-b48fa9ad1fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:59.838984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad1328-7855-4163-9f95-b48fa9ad1fbd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:59.839368 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad1328-7855-4163-9f95-b48fa9ad1fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:59.839791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad1328-7855-4163-9f95-b48fa9ad1fbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:59.841313 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad1328-7855-4163-9f95-b48fa9ad1fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:59.842952 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad1328-7855-4163-9f95-b48fa9ad1fbd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:59.845147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 137/277] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:09:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:59.846134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad1328-7855-4163-9f95-b48fa9ad1fbd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:59.856478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e100e0b-e64f-4680-9fca-8c70d651ebda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:09:59.857106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e100e0b-e64f-4680-9fca-8c70d651ebda None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:59.857387 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e100e0b-e64f-4680-9fca-8c70d651ebda None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:59.857661 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e100e0b-e64f-4680-9fca-8c70d651ebda None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:59.858375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e100e0b-e64f-4680-9fca-8c70d651ebda None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:09:59.858679 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e100e0b-e64f-4680-9fca-8c70d651ebda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:09:59.860610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e100e0b-e64f-4680-9fca-8c70d651ebda None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:09:59.869247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 141/278] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:09:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:09:59.870549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f71991-6fa5-4218-b8a1-eac2ea8e51c5 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:09:59.870836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f71991-6fa5-4218-b8a1-eac2ea8e51c5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:09:59.872026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f71991-6fa5-4218-b8a1-eac2ea8e51c5 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:09:59.873513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 142/279] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:09:59.874486 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f71991-6fa5-4218-b8a1-eac2ea8e51c5 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:09:59.969064 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad1328-7855-4163-9f95-b48fa9ad1fbd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:09:59.972135 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:09:59.992582 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f71991-6fa5-4218-b8a1-eac2ea8e51c5 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:00.003717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fde76d-9c00-4c53-af6d-03e5e7d1eeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:00.004340 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fde76d-9c00-4c53-af6d-03e5e7d1eeb7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:00.004618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fde76d-9c00-4c53-af6d-03e5e7d1eeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:00.004890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fde76d-9c00-4c53-af6d-03e5e7d1eeb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:00.014951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fde76d-9c00-4c53-af6d-03e5e7d1eeb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e6fde76d-9c00-4c53-af6d-03e5e7d1eeb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:00.020386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:00.021488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:00.022430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:00.022430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:00.022430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:00.022430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:00.022430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:00.022430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:00.022430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:00.022430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:00.022430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:00.022430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:00.022430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:00.022430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:00.022430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 138/280] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:09:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:00.022430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fde76d-9c00-4c53-af6d-03e5e7d1eeb7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:00.028447 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f0522-d29f-4bad-9c95-cab9af6015f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:00.029057 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f0522-d29f-4bad-9c95-cab9af6015f0 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:00.029339 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f0522-d29f-4bad-9c95-cab9af6015f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:00.029611 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f0522-d29f-4bad-9c95-cab9af6015f0 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:00.030423 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f0522-d29f-4bad-9c95-cab9af6015f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:00.032368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f0522-d29f-4bad-9c95-cab9af6015f0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:00.043817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:00.054981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 143/281] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:09:59 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:10:00.056273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e88c4b-3c26-4c6b-a6dc-b94e950df740 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:00.056566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e88c4b-3c26-4c6b-a6dc-b94e950df740 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:00.056842 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e88c4b-3c26-4c6b-a6dc-b94e950df740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:00.078253 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-81e88c4b-3c26-4c6b-a6dc-b94e950df740 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:00.080064 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-81e88c4b-3c26-4c6b-a6dc-b94e950df740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:00.141811 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fde76d-9c00-4c53-af6d-03e5e7d1eeb7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:00.164524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 144/282] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:00.166604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e88c4b-3c26-4c6b-a6dc-b94e950df740 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:00.184181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29058a69-6c14-406c-b76c-5268501502ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:00.184886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29058a69-6c14-406c-b76c-5268501502ed None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:00.185470 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29058a69-6c14-406c-b76c-5268501502ed None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:00.185470 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29058a69-6c14-406c-b76c-5268501502ed None admin] PATH_INFO: `/v3/users/bb116c714cde44329da8323fabd8b4ec` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:00.201133 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29058a69-6c14-406c-b76c-5268501502ed None admin] RBAC: Authorizing `identity:get_user(user_id=bb116c714cde44329da8323fabd8b4ec)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:00.202720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29058a69-6c14-406c-b76c-5268501502ed None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:00.205124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 139/283] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:10:00 2022] GET /identity/v3/users/bb116c714cde44329da8323fabd8b4ec => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:00.210962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29058a69-6c14-406c-b76c-5268501502ed None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:00.240127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:00.298633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e88c4b-3c26-4c6b-a6dc-b94e950df740 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:00.326042 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:00.333620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29058a69-6c14-406c-b76c-5268501502ed None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:00.342607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e6bda-4334-4069-bea5-bf0b9e9e1f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:00.343314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e6bda-4334-4069-bea5-bf0b9e9e1f91 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:00.344024 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e6bda-4334-4069-bea5-bf0b9e9e1f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:00.344881 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e6bda-4334-4069-bea5-bf0b9e9e1f91 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:00.345533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e6bda-4334-4069-bea5-bf0b9e9e1f91 None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:00.346169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e6bda-4334-4069-bea5-bf0b9e9e1f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:00.348244 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e6bda-4334-4069-bea5-bf0b9e9e1f91 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:00.357188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 145/284] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:10:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:00.363678 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e6bda-4334-4069-bea5-bf0b9e9e1f91 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:00.378516 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8398f28-0e93-486e-a41a-868da9b81271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:00.379484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8398f28-0e93-486e-a41a-868da9b81271 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:00.380272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8398f28-0e93-486e-a41a-868da9b81271 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:00.380546 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8398f28-0e93-486e-a41a-868da9b81271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:00.381550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8398f28-0e93-486e-a41a-868da9b81271 None admin] RBAC: Adding query filter params (role.id=1c0bdbdf6a98487cac86e3de530b11d2, user.id=bb116c714cde44329da8323fabd8b4ec, scope.system=all) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:00.381882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8398f28-0e93-486e-a41a-868da9b81271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:00.383498 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8398f28-0e93-486e-a41a-868da9b81271 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:00.390748 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 140/285] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Sep 27 17:10:00 2022] GET /identity/v3/role_assignments?user.id=bb116c714cde44329da8323fabd8b4ec&scope.system=all&role.id=1c0bdbdf6a98487cac86e3de530b11d2 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:00.446734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8398f28-0e93-486e-a41a-868da9b81271 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:00.489977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e6bda-4334-4069-bea5-bf0b9e9e1f91 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:00.534974 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4fdd9-9817-4035-8ee7-c168ef6fe904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:00.535638 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4fdd9-9817-4035-8ee7-c168ef6fe904 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:00.535925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4fdd9-9817-4035-8ee7-c168ef6fe904 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:00.536200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4fdd9-9817-4035-8ee7-c168ef6fe904 None admin] PATH_INFO: `/v3/users/a2720c3bd895445eb24baf17f7e1a348` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:00.537405 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4fdd9-9817-4035-8ee7-c168ef6fe904 None admin] RBAC: Authorizing `identity:get_user(user_id=a2720c3bd895445eb24baf17f7e1a348)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:00.538918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4fdd9-9817-4035-8ee7-c168ef6fe904 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:00.545516 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 146/286] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:10:00 2022] GET /identity/v3/users/a2720c3bd895445eb24baf17f7e1a348 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:00.548371 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4fdd9-9817-4035-8ee7-c168ef6fe904 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:00.567772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:00.588538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8398f28-0e93-486e-a41a-868da9b81271 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:00.620421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:00.644339 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8f485-57e0-4e71-95ae-f9ebb4680833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:00.644983 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8f485-57e0-4e71-95ae-f9ebb4680833 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:00.645255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8f485-57e0-4e71-95ae-f9ebb4680833 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:00.645520 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8f485-57e0-4e71-95ae-f9ebb4680833 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:00.668115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8f485-57e0-4e71-95ae-f9ebb4680833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-7fc8f485-57e0-4e71-95ae-f9ebb4680833 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:00.676510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:00.677421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:00.678251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:00.678251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:00.678251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:00.678251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:00.678251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:00.678251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:00.678251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:00.678251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:00.678251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:00.678251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:00.678251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:10:00.678251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:00.678875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 141/287] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:00.689615 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8f485-57e0-4e71-95ae-f9ebb4680833 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:00.713332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4fdd9-9817-4035-8ee7-c168ef6fe904 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:00.778245 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9a614-3530-442c-8b46-08ff40a13704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:00.779209 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9a614-3530-442c-8b46-08ff40a13704 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:00.780464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9a614-3530-442c-8b46-08ff40a13704 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:00.781148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9a614-3530-442c-8b46-08ff40a13704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:00.884169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9a614-3530-442c-8b46-08ff40a13704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:00.887308 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9a614-3530-442c-8b46-08ff40a13704 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:00.891280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8f485-57e0-4e71-95ae-f9ebb4680833 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:00.952680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb4e79-6198-4115-a12e-0b2ca7288c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:00.953298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4e79-6198-4115-a12e-0b2ca7288c9c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:00.953634 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4e79-6198-4115-a12e-0b2ca7288c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:00.953946 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4e79-6198-4115-a12e-0b2ca7288c9c None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:00.954618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb4e79-6198-4115-a12e-0b2ca7288c9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:00.954920 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb4e79-6198-4115-a12e-0b2ca7288c9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:00.956289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb4e79-6198-4115-a12e-0b2ca7288c9c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:00.971365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 142/288] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:10:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:00.979172 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb4e79-6198-4115-a12e-0b2ca7288c9c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:00.998055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:00.998259 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:01.088676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 147/289] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:01.094763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9a614-3530-442c-8b46-08ff40a13704 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:01.147043 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb4e79-6198-4115-a12e-0b2ca7288c9c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:01.182988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a4c3a-2f26-425b-9b75-d46d3fa0cf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:01.183989 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a4c3a-2f26-425b-9b75-d46d3fa0cf83 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:01.184495 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a4c3a-2f26-425b-9b75-d46d3fa0cf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:01.184967 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a4c3a-2f26-425b-9b75-d46d3fa0cf83 None admin] PATH_INFO: `/v3/users/2d27e3c5a50847b2aa5e5dbc04c7bb6f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:01.186364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a4c3a-2f26-425b-9b75-d46d3fa0cf83 None admin] RBAC: Authorizing `identity:get_user(user_id=2d27e3c5a50847b2aa5e5dbc04c7bb6f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:01.188623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a4c3a-2f26-425b-9b75-d46d3fa0cf83 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:01.190756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 143/290] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:10:00 2022] GET /identity/v3/users/2d27e3c5a50847b2aa5e5dbc04c7bb6f => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:01.196261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a4c3a-2f26-425b-9b75-d46d3fa0cf83 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:01.301232 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9a614-3530-442c-8b46-08ff40a13704 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:01.319393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:01.357401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a4c3a-2f26-425b-9b75-d46d3fa0cf83 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:01.367902 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16719d6-5986-4dc1-aa3d-96b42e757bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:01.368549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16719d6-5986-4dc1-aa3d-96b42e757bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:01.368830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16719d6-5986-4dc1-aa3d-96b42e757bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:01.369101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16719d6-5986-4dc1-aa3d-96b42e757bc7 None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:01.371811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16719d6-5986-4dc1-aa3d-96b42e757bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:01.373263 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16719d6-5986-4dc1-aa3d-96b42e757bc7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:01.380503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 148/291] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:01 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:01.383558 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16719d6-5986-4dc1-aa3d-96b42e757bc7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:01.431409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8ff26-5bed-4c69-94c6-f6032c77fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:01.432083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:01.432179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8ff26-5bed-4c69-94c6-f6032c77fe1f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:01.432250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8ff26-5bed-4c69-94c6-f6032c77fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:01.432506 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8ff26-5bed-4c69-94c6-f6032c77fe1f None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:01.434395 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8ff26-5bed-4c69-94c6-f6032c77fe1f None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:01.435930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8ff26-5bed-4c69-94c6-f6032c77fe1f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:01.438494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 144/292] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:01 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:01.444451 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8ff26-5bed-4c69-94c6-f6032c77fe1f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:01.568190 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16719d6-5986-4dc1-aa3d-96b42e757bc7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:01.623682 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8ff26-5bed-4c69-94c6-f6032c77fe1f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:01.629149 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25dc7a-c948-4a6e-8632-1a280e773cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:01.629811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25dc7a-c948-4a6e-8632-1a280e773cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:01.630097 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25dc7a-c948-4a6e-8632-1a280e773cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:01.630372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25dc7a-c948-4a6e-8632-1a280e773cd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:01.631099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25dc7a-c948-4a6e-8632-1a280e773cd6 None admin] RBAC: Adding query filter params (role.id=1c0bdbdf6a98487cac86e3de530b11d2, scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2, user.id=a2720c3bd895445eb24baf17f7e1a348) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:01.631407 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25dc7a-c948-4a6e-8632-1a280e773cd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:01.632874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25dc7a-c948-4a6e-8632-1a280e773cd6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:01.641894 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 149/293] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:10:01 2022] GET /identity/v3/role_assignments?user.id=a2720c3bd895445eb24baf17f7e1a348&scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2&role.id=1c0bdbdf6a98487cac86e3de530b11d2 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:01.677482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c393e-b491-4d2e-b4ac-d7b03572a598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:01.678563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c393e-b491-4d2e-b4ac-d7b03572a598 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:01.679046 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c393e-b491-4d2e-b4ac-d7b03572a598 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:01.679545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c393e-b491-4d2e-b4ac-d7b03572a598 None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2/users/2d27e3c5a50847b2aa5e5dbc04c7bb6f/roles/3d56d71a94cf4ce1887d1b743039657b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:01.682266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c393e-b491-4d2e-b4ac-d7b03572a598 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad3b24197d4b3b8d9880cb3f4241e2, user_id=2d27e3c5a50847b2aa5e5dbc04c7bb6f, role_id=3d56d71a94cf4ce1887d1b743039657b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:01.683981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c393e-b491-4d2e-b4ac-d7b03572a598 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:01.711040 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 145/294] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:10:01 2022] PUT /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2/users/2d27e3c5a50847b2aa5e5dbc04c7bb6f/roles/3d56d71a94cf4ce1887d1b743039657b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:10:02.671782 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324640a1-25de-4be1-bee3-4301bad7ab5b None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:02.673046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324640a1-25de-4be1-bee3-4301bad7ab5b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:02.673046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324640a1-25de-4be1-bee3-4301bad7ab5b None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:02.674512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 150/295] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:02.679915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae01d6d-f9a7-4e43-82a0-919343948e8d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:02.680383 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae01d6d-f9a7-4e43-82a0-919343948e8d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:02.680479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae01d6d-f9a7-4e43-82a0-919343948e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:02.688840 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:02.703530 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-eae01d6d-f9a7-4e43-82a0-919343948e8d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:02.705000 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-eae01d6d-f9a7-4e43-82a0-919343948e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:02.786560 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 146/296] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:02.841454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fe35c-5cd2-46a8-a9a4-37a1017b95fa None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:02.841772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fe35c-5cd2-46a8-a9a4-37a1017b95fa None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:02.842024 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fe35c-5cd2-46a8-a9a4-37a1017b95fa None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:02.843618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 151/297] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:02.849140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f120a91-fad1-43b3-9c34-ed16758ed088 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:02.849431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f120a91-fad1-43b3-9c34-ed16758ed088 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:02.849714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f120a91-fad1-43b3-9c34-ed16758ed088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:02.855320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f004f-02df-4722-9eef-be6d753d114b None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:02.855320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f004f-02df-4722-9eef-be6d753d114b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:02.855320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f004f-02df-4722-9eef-be6d753d114b None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:02.856448 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 152/298] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:02.863469 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0e329-957c-4c6a-b216-08eef2c24fa3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:02.863857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0e329-957c-4c6a-b216-08eef2c24fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:02.864234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0e329-957c-4c6a-b216-08eef2c24fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:02.870655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5f120a91-fad1-43b3-9c34-ed16758ed088 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:02.872128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5f120a91-fad1-43b3-9c34-ed16758ed088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:02.883160 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-65e0e329-957c-4c6a-b216-08eef2c24fa3 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:02.884560 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-65e0e329-957c-4c6a-b216-08eef2c24fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:02.946021 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 147/299] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:02.964058 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 153/300] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:10:03.059311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f120a91-fad1-43b3-9c34-ed16758ed088 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:03.130502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:03.166760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f120a91-fad1-43b3-9c34-ed16758ed088 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:03.201323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec224c-a919-4a7d-912a-0fbcbe4c2a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:03.202172 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec224c-a919-4a7d-912a-0fbcbe4c2a45 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:03.202588 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec224c-a919-4a7d-912a-0fbcbe4c2a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:03.203020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec224c-a919-4a7d-912a-0fbcbe4c2a45 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:03.213534 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec224c-a919-4a7d-912a-0fbcbe4c2a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-08ec224c-a919-4a7d-912a-0fbcbe4c2a45 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:03.218672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:03.220244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:03.221209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:03.221209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:03.221209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:03.221209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:03.221209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:03.221209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:03.221209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:03.221209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:03.221209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:03.221209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:03.221209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:10:03.221209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:03.223096 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 148/301] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:03.233033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0e329-957c-4c6a-b216-08eef2c24fa3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:03.249972 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:03.255181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec224c-a919-4a7d-912a-0fbcbe4c2a45 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:03.336911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0e329-957c-4c6a-b216-08eef2c24fa3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:03.356796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec224c-a919-4a7d-912a-0fbcbe4c2a45 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:03.375664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982f33b-9b9e-4621-b022-4d5c5e054ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:03.376272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982f33b-9b9e-4621-b022-4d5c5e054ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:03.376551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982f33b-9b9e-4621-b022-4d5c5e054ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:03.376821 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982f33b-9b9e-4621-b022-4d5c5e054ca9 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:03.377728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982f33b-9b9e-4621-b022-4d5c5e054ca9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:03.377853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982f33b-9b9e-4621-b022-4d5c5e054ca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:03.379169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982f33b-9b9e-4621-b022-4d5c5e054ca9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:03.382267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:03.388918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 154/302] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:10:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:03.389974 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982f33b-9b9e-4621-b022-4d5c5e054ca9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:03.398266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0f83b-91d8-4dec-b9d1-c26a02f396d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:03.398903 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0f83b-91d8-4dec-b9d1-c26a02f396d4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:03.399180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0f83b-91d8-4dec-b9d1-c26a02f396d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:03.399447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0f83b-91d8-4dec-b9d1-c26a02f396d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:03.400695 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0f83b-91d8-4dec-b9d1-c26a02f396d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:03.402172 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0f83b-91d8-4dec-b9d1-c26a02f396d4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:03.403843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 149/303] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:03.404459 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0f83b-91d8-4dec-b9d1-c26a02f396d4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:03.489391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:03.512286 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982f33b-9b9e-4621-b022-4d5c5e054ca9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:03.515456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0f83b-91d8-4dec-b9d1-c26a02f396d4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:03.552860 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5091da-f540-4eab-a93d-276ea780c452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:03.553101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a2562-13a8-4b04-a63c-3c50e6396e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:03.553504 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5091da-f540-4eab-a93d-276ea780c452 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:03.553603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a2562-13a8-4b04-a63c-3c50e6396e78 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:03.553803 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5091da-f540-4eab-a93d-276ea780c452 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:03.553906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a2562-13a8-4b04-a63c-3c50e6396e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:03.554067 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5091da-f540-4eab-a93d-276ea780c452 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:03.554156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a2562-13a8-4b04-a63c-3c50e6396e78 None admin] PATH_INFO: `/v3/users/484016db325d4044957e3b81f330c206` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:03.565279 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5091da-f540-4eab-a93d-276ea780c452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:03.570528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a2562-13a8-4b04-a63c-3c50e6396e78 None admin] RBAC: Authorizing `identity:get_user(user_id=484016db325d4044957e3b81f330c206)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-bf5091da-f540-4eab-a93d-276ea780c452 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:03.570642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:03.571552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:03.572384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:03.572384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:03.572384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:03.572384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:03.572384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:03.572384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:03.572384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:03.572384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:03.572384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:03.572384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:03.572384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:03.572384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:03.572989 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a2562-13a8-4b04-a63c-3c50e6396e78 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:03.573805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 150/304] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:10:03 2022] GET /identity/v3/users/484016db325d4044957e3b81f330c206 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:03.574351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a2562-13a8-4b04-a63c-3c50e6396e78 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:03.580899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 155/305] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:03.581824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5091da-f540-4eab-a93d-276ea780c452 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:03.635325 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:03.684936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5091da-f540-4eab-a93d-276ea780c452 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:03.688407 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a2562-13a8-4b04-a63c-3c50e6396e78 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:03.718790 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca0b86-84b8-43d0-bad2-70b7e7ca143e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:03.719637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca0b86-84b8-43d0-bad2-70b7e7ca143e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:03.719896 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca0b86-84b8-43d0-bad2-70b7e7ca143e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:03.720170 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca0b86-84b8-43d0-bad2-70b7e7ca143e None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:03.720830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca0b86-84b8-43d0-bad2-70b7e7ca143e None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:03.721140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca0b86-84b8-43d0-bad2-70b7e7ca143e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:03.722538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca0b86-84b8-43d0-bad2-70b7e7ca143e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:03.724181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1abbe-676d-4e21-9fee-0b3f83841e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:03.724895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1abbe-676d-4e21-9fee-0b3f83841e9a None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:03.725168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1abbe-676d-4e21-9fee-0b3f83841e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:03.725437 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1abbe-676d-4e21-9fee-0b3f83841e9a None admin] PATH_INFO: `/v3/groups` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:03.726099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1abbe-676d-4e21-9fee-0b3f83841e9a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:03.727625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1abbe-676d-4e21-9fee-0b3f83841e9a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:03.732186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 156/306] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:10:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:03.733179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca0b86-84b8-43d0-bad2-70b7e7ca143e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:03.736404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:03.748714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 151/307] 10.222.0.57 () {60 vars in 1134 bytes} [Tue Sep 27 17:10:03 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:10:03.749788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1abbe-676d-4e21-9fee-0b3f83841e9a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:03.879311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1abbe-676d-4e21-9fee-0b3f83841e9a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:03.896829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:03.899041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca0b86-84b8-43d0-bad2-70b7e7ca143e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:03.935346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f404c5-e8da-449b-a167-ac0f1d77fc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:03.936006 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f404c5-e8da-449b-a167-ac0f1d77fc73 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:03.936288 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f404c5-e8da-449b-a167-ac0f1d77fc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:03.936564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f404c5-e8da-449b-a167-ac0f1d77fc73 None admin] PATH_INFO: `/v3/users/bb116c714cde44329da8323fabd8b4ec` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:03.938372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f404c5-e8da-449b-a167-ac0f1d77fc73 None admin] RBAC: Authorizing `identity:get_user(user_id=bb116c714cde44329da8323fabd8b4ec)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:03.940116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f404c5-e8da-449b-a167-ac0f1d77fc73 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:03.942068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 152/308] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:10:03 2022] GET /identity/v3/users/bb116c714cde44329da8323fabd8b4ec => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:03.948117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f404c5-e8da-449b-a167-ac0f1d77fc73 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:03.956008 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dd8f6-d76e-406f-b16b-7821742cc22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:03.956606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dd8f6-d76e-406f-b16b-7821742cc22d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:03.956891 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dd8f6-d76e-406f-b16b-7821742cc22d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:03.957164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dd8f6-d76e-406f-b16b-7821742cc22d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:03.959118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dd8f6-d76e-406f-b16b-7821742cc22d None admin] RBAC: Adding query filter params (role.id=3d56d71a94cf4ce1887d1b743039657b, user.id=484016db325d4044957e3b81f330c206, scope.system=all) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:03.959118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dd8f6-d76e-406f-b16b-7821742cc22d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:03.960364 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dd8f6-d76e-406f-b16b-7821742cc22d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:03.967402 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 157/309] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Sep 27 17:10:03 2022] GET /identity/v3/role_assignments?user.id=484016db325d4044957e3b81f330c206&scope.system=all&role.id=3d56d71a94cf4ce1887d1b743039657b => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:04.055139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed8cbf-e73d-4b0d-9ce7-5098d4d1ba0f None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:04.055430 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed8cbf-e73d-4b0d-9ce7-5098d4d1ba0f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:04.055779 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed8cbf-e73d-4b0d-9ce7-5098d4d1ba0f None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:04.058886 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 158/310] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:04.064923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b7e38-2274-4fa2-9c9f-6cf0fa89cecd None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:04.065219 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b7e38-2274-4fa2-9c9f-6cf0fa89cecd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:04.065469 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b7e38-2274-4fa2-9c9f-6cf0fa89cecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:04.071676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f404c5-e8da-449b-a167-ac0f1d77fc73 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:04.085181 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-358b7e38-2274-4fa2-9c9f-6cf0fa89cecd None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:04.086681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-358b7e38-2274-4fa2-9c9f-6cf0fa89cecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:04.115220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2387f-0b27-4489-839c-98cb2128aed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:04.115969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2387f-0b27-4489-839c-98cb2128aed6 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:04.116251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2387f-0b27-4489-839c-98cb2128aed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:04.116526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2387f-0b27-4489-839c-98cb2128aed6 None admin] PATH_INFO: `/v3/system/users/bb116c714cde44329da8323fabd8b4ec/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:04.118266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2387f-0b27-4489-839c-98cb2128aed6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bb116c714cde44329da8323fabd8b4ec, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:04.119665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2387f-0b27-4489-839c-98cb2128aed6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:04.132742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 153/311] 10.222.0.57 () {58 vars in 1334 bytes} [Tue Sep 27 17:10:03 2022] PUT /identity/v3/system/users/bb116c714cde44329da8323fabd8b4ec/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:10:04.172156 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:04.180941 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 159/312] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:10:04.461928 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2387f-0b27-4489-839c-98cb2128aed6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:04.508050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:04.568230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2387f-0b27-4489-839c-98cb2128aed6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:04.604224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704af88-0b80-462b-b615-469b4d8598cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:04.605252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704af88-0b80-462b-b615-469b4d8598cb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:04.605791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704af88-0b80-462b-b615-469b4d8598cb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:04.606264 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704af88-0b80-462b-b615-469b4d8598cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:04.617885 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704af88-0b80-462b-b615-469b4d8598cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-d704af88-0b80-462b-b615-469b4d8598cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:04.623522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:04.624393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:04.625420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:04.625420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:04.625420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:04.625420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:04.625420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:04.625420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:04.625420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:04.625420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:04.625420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:04.625420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:04.625420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:10:04.625420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:04.627821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 154/313] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:04.634077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b7e38-2274-4fa2-9c9f-6cf0fa89cecd None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:04.739292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b7e38-2274-4fa2-9c9f-6cf0fa89cecd None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:04.775477 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa6e9-33d6-4417-972e-1ae6514f069a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:04.776083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa6e9-33d6-4417-972e-1ae6514f069a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:04.776416 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa6e9-33d6-4417-972e-1ae6514f069a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:04.776687 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa6e9-33d6-4417-972e-1ae6514f069a None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:04.777337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fa6e9-33d6-4417-972e-1ae6514f069a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:04.777635 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fa6e9-33d6-4417-972e-1ae6514f069a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:04.779070 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fa6e9-33d6-4417-972e-1ae6514f069a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:04.788092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 160/314] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:10:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:04.793911 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704af88-0b80-462b-b615-469b4d8598cb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:04.900404 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704af88-0b80-462b-b615-469b4d8598cb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:04.902408 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:04.936785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffcf24-ae57-4a7a-8eb4-034fee7f3d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:04.938438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffcf24-ae57-4a7a-8eb4-034fee7f3d85 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:04.938998 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffcf24-ae57-4a7a-8eb4-034fee7f3d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:04.939473 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffcf24-ae57-4a7a-8eb4-034fee7f3d85 None admin] PATH_INFO: `/v3/users/2d27e3c5a50847b2aa5e5dbc04c7bb6f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:04.940804 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffcf24-ae57-4a7a-8eb4-034fee7f3d85 None admin] RBAC: Authorizing `identity:get_user(user_id=2d27e3c5a50847b2aa5e5dbc04c7bb6f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:04.942505 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffcf24-ae57-4a7a-8eb4-034fee7f3d85 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:04.948890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 155/315] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:10:04 2022] GET /identity/v3/users/2d27e3c5a50847b2aa5e5dbc04c7bb6f => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:04.950474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa6e9-33d6-4417-972e-1ae6514f069a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:05.011837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:05.055161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa6e9-33d6-4417-972e-1ae6514f069a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:05.097880 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765884b5-4cb8-4497-a6b9-c659c3beb0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:05.098491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765884b5-4cb8-4497-a6b9-c659c3beb0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:05.098769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765884b5-4cb8-4497-a6b9-c659c3beb0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:05.099074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765884b5-4cb8-4497-a6b9-c659c3beb0c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:05.166922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765884b5-4cb8-4497-a6b9-c659c3beb0c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:05.168369 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765884b5-4cb8-4497-a6b9-c659c3beb0c1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:05.235817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:05.279824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 161/316] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:05.281569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffcf24-ae57-4a7a-8eb4-034fee7f3d85 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:05.386644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffcf24-ae57-4a7a-8eb4-034fee7f3d85 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:05.422732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d57b70-bd45-4bdb-9150-5b7c967038ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:05.423793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d57b70-bd45-4bdb-9150-5b7c967038ee None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:05.424273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d57b70-bd45-4bdb-9150-5b7c967038ee None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:05.424745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d57b70-bd45-4bdb-9150-5b7c967038ee None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:05.426140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d57b70-bd45-4bdb-9150-5b7c967038ee None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:05.427796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d57b70-bd45-4bdb-9150-5b7c967038ee None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:05.433818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 156/317] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:05 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:05.436200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765884b5-4cb8-4497-a6b9-c659c3beb0c1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:05.543083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765884b5-4cb8-4497-a6b9-c659c3beb0c1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:05.580231 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c36c4-94dd-488a-994a-a8d8867bd877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:05.580849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c36c4-94dd-488a-994a-a8d8867bd877 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:05.581131 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c36c4-94dd-488a-994a-a8d8867bd877 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:05.581406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c36c4-94dd-488a-994a-a8d8867bd877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:05.582164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c36c4-94dd-488a-994a-a8d8867bd877 None admin] RBAC: Adding query filter params (role.id=3d56d71a94cf4ce1887d1b743039657b, scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2, user.id=2d27e3c5a50847b2aa5e5dbc04c7bb6f) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:05.582475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c36c4-94dd-488a-994a-a8d8867bd877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:05.583926 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c36c4-94dd-488a-994a-a8d8867bd877 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:05.595176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 162/318] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:10:05 2022] GET /identity/v3/role_assignments?user.id=2d27e3c5a50847b2aa5e5dbc04c7bb6f&scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2&role.id=3d56d71a94cf4ce1887d1b743039657b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:06.067031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb06110-caca-4fb3-9a36-313947dec1ce None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:06.067542 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb06110-caca-4fb3-9a36-313947dec1ce None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:06.067542 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb06110-caca-4fb3-9a36-313947dec1ce None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:06.069070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 157/319] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:06.074156 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23647f30-aa4e-4a82-b362-b9cfa6c38640 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:06.074530 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23647f30-aa4e-4a82-b362-b9cfa6c38640 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:06.074705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23647f30-aa4e-4a82-b362-b9cfa6c38640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:06.093546 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-23647f30-aa4e-4a82-b362-b9cfa6c38640 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:06.094899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-23647f30-aa4e-4a82-b362-b9cfa6c38640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:06.113528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:06.168594 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 163/320] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:06.232254 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97137ceb-edfb-4e83-949c-fdf35f751c44 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:06.232537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97137ceb-edfb-4e83-949c-fdf35f751c44 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:06.232812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97137ceb-edfb-4e83-949c-fdf35f751c44 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:06.235299 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 158/321] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:06.239458 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffb844-4fda-4ed3-8713-07eaac227fa9 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:06.239753 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffb844-4fda-4ed3-8713-07eaac227fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:06.240046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffb844-4fda-4ed3-8713-07eaac227fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:06.258932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-39ffb844-4fda-4ed3-8713-07eaac227fa9 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:06.260143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-39ffb844-4fda-4ed3-8713-07eaac227fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:06.331059 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 164/322] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:06.385432 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bac18-bdb1-4cc4-b036-e69a4882d0ea None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:06.385753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bac18-bdb1-4cc4-b036-e69a4882d0ea None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:06.386020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bac18-bdb1-4cc4-b036-e69a4882d0ea None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:06.387480 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 159/323] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:06.393343 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57017e2-1cc6-4c0a-8d75-9b99254a667c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:06.393634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57017e2-1cc6-4c0a-8d75-9b99254a667c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:06.393939 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57017e2-1cc6-4c0a-8d75-9b99254a667c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:06.411970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b57017e2-1cc6-4c0a-8d75-9b99254a667c None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:06.413150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b57017e2-1cc6-4c0a-8d75-9b99254a667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:06.443553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bac18-bdb1-4cc4-b036-e69a4882d0ea None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:06.486371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:06.497737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 165/324] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:10:06.549456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bac18-bdb1-4cc4-b036-e69a4882d0ea None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:06.583900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35360b30-e200-4c7c-8dc1-4274984162cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:06.584461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35360b30-e200-4c7c-8dc1-4274984162cd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:06.584737 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35360b30-e200-4c7c-8dc1-4274984162cd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:06.585007 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35360b30-e200-4c7c-8dc1-4274984162cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:06.586372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35360b30-e200-4c7c-8dc1-4274984162cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:06.587819 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35360b30-e200-4c7c-8dc1-4274984162cd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:06.589564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 160/325] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:06.594976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57017e2-1cc6-4c0a-8d75-9b99254a667c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:06.601049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35360b30-e200-4c7c-8dc1-4274984162cd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:06.610469 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:06.702546 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57017e2-1cc6-4c0a-8d75-9b99254a667c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:06.713980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35360b30-e200-4c7c-8dc1-4274984162cd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:06.721883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:06.738296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28343766-1dd1-4bf3-969d-7d5e7460e700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:06.738907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28343766-1dd1-4bf3-969d-7d5e7460e700 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:06.739201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28343766-1dd1-4bf3-969d-7d5e7460e700 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:06.739446 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28343766-1dd1-4bf3-969d-7d5e7460e700 None admin] PATH_INFO: `/v3/groups` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:06.740134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28343766-1dd1-4bf3-969d-7d5e7460e700 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:06.741637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28343766-1dd1-4bf3-969d-7d5e7460e700 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:06.751999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab3a6b-66c2-42b7-b340-e36e817fe0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:06.752593 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab3a6b-66c2-42b7-b340-e36e817fe0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:06.752899 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab3a6b-66c2-42b7-b340-e36e817fe0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:06.753138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab3a6b-66c2-42b7-b340-e36e817fe0d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:06.758708 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 166/326] 10.222.0.57 () {60 vars in 1134 bytes} [Tue Sep 27 17:10:06 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:10:06.764939 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28343766-1dd1-4bf3-969d-7d5e7460e700 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:06.769717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab3a6b-66c2-42b7-b340-e36e817fe0d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-85ab3a6b-66c2-42b7-b340-e36e817fe0d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:06.775502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:06.776479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:06.777293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:06.777293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:06.777293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:06.777293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:06.777293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:06.777293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:06.777293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:06.777293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:06.777293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:06.777293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:06.777293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:10:06.777293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:06.782107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 161/327] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:06.783238 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab3a6b-66c2-42b7-b340-e36e817fe0d7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:06.852944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:06.891838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28343766-1dd1-4bf3-969d-7d5e7460e700 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:06.895785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab3a6b-66c2-42b7-b340-e36e817fe0d7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:06.930911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2cbfc-8d92-4ed4-8bc6-52cc82885280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:06.931558 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2cbfc-8d92-4ed4-8bc6-52cc82885280 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:06.931839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2cbfc-8d92-4ed4-8bc6-52cc82885280 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:06.932112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2cbfc-8d92-4ed4-8bc6-52cc82885280 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:06.934254 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b892b-8452-4b93-970b-705044dbe0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:06.934865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b892b-8452-4b93-970b-705044dbe0be None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:06.935145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b892b-8452-4b93-970b-705044dbe0be None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:06.935419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b892b-8452-4b93-970b-705044dbe0be None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:06.936084 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b892b-8452-4b93-970b-705044dbe0be None admin] RBAC: Adding query filter params (name=reader) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:06.936392 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b892b-8452-4b93-970b-705044dbe0be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:06.937965 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b892b-8452-4b93-970b-705044dbe0be None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:06.944150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2cbfc-8d92-4ed4-8bc6-52cc82885280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:06.947620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 162/328] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:10:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-f1b2cbfc-8d92-4ed4-8bc6-52cc82885280 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:06.950593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:06.951470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:06.952260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:06.952260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:06.952260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:06.952260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:06.952260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:06.952260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:06.952260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:06.952260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:06.952260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:06.952260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:06.952260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:06.952260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:06.952260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 167/329] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:06.954735 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b892b-8452-4b93-970b-705044dbe0be None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:06.957239 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2cbfc-8d92-4ed4-8bc6-52cc82885280 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:06.993213 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:07.069032 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2cbfc-8d92-4ed4-8bc6-52cc82885280 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:07.084068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b892b-8452-4b93-970b-705044dbe0be None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:07.104327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:07.110725 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133aef6-d3cb-4675-ba7b-ab1f13296af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:07.111579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133aef6-d3cb-4675-ba7b-ab1f13296af1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:07.112319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133aef6-d3cb-4675-ba7b-ab1f13296af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:07.112597 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133aef6-d3cb-4675-ba7b-ab1f13296af1 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:07.113274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133aef6-d3cb-4675-ba7b-ab1f13296af1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:07.113563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133aef6-d3cb-4675-ba7b-ab1f13296af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:07.114976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133aef6-d3cb-4675-ba7b-ab1f13296af1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:07.124855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 168/330] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:10:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:07.131198 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133aef6-d3cb-4675-ba7b-ab1f13296af1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:07.136904 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407deabe-0a3c-4e40-a272-3bf1620d42e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:07.137566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407deabe-0a3c-4e40-a272-3bf1620d42e7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:07.137877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407deabe-0a3c-4e40-a272-3bf1620d42e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:07.138154 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407deabe-0a3c-4e40-a272-3bf1620d42e7 None admin] PATH_INFO: `/v3/users/484016db325d4044957e3b81f330c206` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:07.139311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407deabe-0a3c-4e40-a272-3bf1620d42e7 None admin] RBAC: Authorizing `identity:get_user(user_id=484016db325d4044957e3b81f330c206)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:07.140992 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407deabe-0a3c-4e40-a272-3bf1620d42e7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:07.143338 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 163/331] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:10:06 2022] GET /identity/v3/users/484016db325d4044957e3b81f330c206 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:07.148831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407deabe-0a3c-4e40-a272-3bf1620d42e7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:07.275896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:07.277381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133aef6-d3cb-4675-ba7b-ab1f13296af1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:07.287671 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407deabe-0a3c-4e40-a272-3bf1620d42e7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:07.326338 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bdcab-ddd1-4c4e-b635-574564cbe011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:07.327089 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c8dff-7b29-495d-b993-2f3777492bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:07.327435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bdcab-ddd1-4c4e-b635-574564cbe011 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:07.327899 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bdcab-ddd1-4c4e-b635-574564cbe011 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:07.328593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8dff-7b29-495d-b993-2f3777492bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:07.328977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8dff-7b29-495d-b993-2f3777492bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:07.329102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bdcab-ddd1-4c4e-b635-574564cbe011 None admin] PATH_INFO: `/v3/system/users/484016db325d4044957e3b81f330c206/roles/3d56d71a94cf4ce1887d1b743039657b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:07.329428 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8dff-7b29-495d-b993-2f3777492bc7 None admin] PATH_INFO: `/v3/users/bb116c714cde44329da8323fabd8b4ec` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:07.330810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c8dff-7b29-495d-b993-2f3777492bc7 None admin] RBAC: Authorizing `identity:get_user(user_id=bb116c714cde44329da8323fabd8b4ec)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:07.331003 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bdcab-ddd1-4c4e-b635-574564cbe011 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=484016db325d4044957e3b81f330c206, role_id=3d56d71a94cf4ce1887d1b743039657b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:07.332457 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c8dff-7b29-495d-b993-2f3777492bc7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:07.332662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bdcab-ddd1-4c4e-b635-574564cbe011 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:07.336027 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 169/332] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:10:07 2022] GET /identity/v3/users/bb116c714cde44329da8323fabd8b4ec => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:07.340898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c8dff-7b29-495d-b993-2f3777492bc7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:07.342932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 164/333] 10.222.0.57 () {58 vars in 1334 bytes} [Tue Sep 27 17:10:07 2022] PUT /identity/v3/system/users/484016db325d4044957e3b81f330c206/roles/3d56d71a94cf4ce1887d1b743039657b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:10:07.444883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:07.492847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c8dff-7b29-495d-b993-2f3777492bc7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:07.534998 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416e7d6-5fab-4568-b659-b0abb6668e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:07.535718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416e7d6-5fab-4568-b659-b0abb6668e72 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:07.535998 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416e7d6-5fab-4568-b659-b0abb6668e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:07.536270 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416e7d6-5fab-4568-b659-b0abb6668e72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:07.537003 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416e7d6-5fab-4568-b659-b0abb6668e72 None admin] RBAC: Adding query filter params (role.id=1c0bdbdf6a98487cac86e3de530b11d2, user.id=bb116c714cde44329da8323fabd8b4ec, scope.system=all) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:07.537312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416e7d6-5fab-4568-b659-b0abb6668e72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:07.538765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416e7d6-5fab-4568-b659-b0abb6668e72 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:07.552642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 170/334] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Sep 27 17:10:07 2022] GET /identity/v3/role_assignments?user.id=bb116c714cde44329da8323fabd8b4ec&scope.system=all&role.id=1c0bdbdf6a98487cac86e3de530b11d2 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:09.258976 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904beec-a9e0-4600-83c9-17d95cf528fa None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:09.260005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904beec-a9e0-4600-83c9-17d95cf528fa None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:09.260507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904beec-a9e0-4600-83c9-17d95cf528fa None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:09.262365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 165/335] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:09.267562 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575ac3d-d896-4986-bbee-458b0e51a153 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:09.267976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575ac3d-d896-4986-bbee-458b0e51a153 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:09.268136 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575ac3d-d896-4986-bbee-458b0e51a153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:09.291953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-3575ac3d-d896-4986-bbee-458b0e51a153 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:09.293150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3575ac3d-d896-4986-bbee-458b0e51a153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:09.376886 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 171/336] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:09.805986 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc31d76-b356-4626-932b-704ebb95a223 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:09.806677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc31d76-b356-4626-932b-704ebb95a223 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:09.807173 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc31d76-b356-4626-932b-704ebb95a223 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:09.808715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 166/337] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:09.814104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f262c-e2a1-4515-bef8-a4493538ce05 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:09.814645 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f262c-e2a1-4515-bef8-a4493538ce05 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:09.815133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f262c-e2a1-4515-bef8-a4493538ce05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:09.838684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7b9f262c-e2a1-4515-bef8-a4493538ce05 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:09.840377 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7b9f262c-e2a1-4515-bef8-a4493538ce05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:09.893895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:09.922417 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 172/338] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:09.957529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc31d76-b356-4626-932b-704ebb95a223 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:10.077313 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc31d76-b356-4626-932b-704ebb95a223 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:10.117476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289fcbd-1949-4421-925e-117436d0846f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:10.118132 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289fcbd-1949-4421-925e-117436d0846f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:10.118408 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289fcbd-1949-4421-925e-117436d0846f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:10.118677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289fcbd-1949-4421-925e-117436d0846f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:10.131186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289fcbd-1949-4421-925e-117436d0846f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2289fcbd-1949-4421-925e-117436d0846f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:10.136026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:10.136913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:10.138111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:10.138111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:10.138111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:10.138111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:10.138111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:10.138111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:10.138111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:10.138111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:10.138111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:10.138111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:10.138111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:10.138111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:10.138111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 167/339] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:10.143433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f262c-e2a1-4515-bef8-a4493538ce05 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:10.253827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f262c-e2a1-4515-bef8-a4493538ce05 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:10.297398 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd077636-5786-4f63-93ce-36d55c1d4896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:10.298634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd077636-5786-4f63-93ce-36d55c1d4896 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:10.298918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd077636-5786-4f63-93ce-36d55c1d4896 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:10.299192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd077636-5786-4f63-93ce-36d55c1d4896 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:10.299856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd077636-5786-4f63-93ce-36d55c1d4896 None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:10.300159 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd077636-5786-4f63-93ce-36d55c1d4896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:10.301542 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd077636-5786-4f63-93ce-36d55c1d4896 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:10.314411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 173/340] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:10:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:10.320100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289fcbd-1949-4421-925e-117436d0846f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:10.344960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:10.455806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289fcbd-1949-4421-925e-117436d0846f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:10.493518 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaa0d4-763a-457a-8590-613409ef3a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:10.494197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaa0d4-763a-457a-8590-613409ef3a15 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:10.494475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaa0d4-763a-457a-8590-613409ef3a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:10.494750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaa0d4-763a-457a-8590-613409ef3a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:10.536359 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd077636-5786-4f63-93ce-36d55c1d4896 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:10.580381 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccaa0d4-763a-457a-8590-613409ef3a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:10.581914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccaa0d4-763a-457a-8590-613409ef3a15 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:10.610150 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:10.611784 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:10.696316 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd077636-5786-4f63-93ce-36d55c1d4896 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:10.728844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 168/341] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:10.730456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f9709-b5b7-40bc-a814-2b7c0ed2eb54 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:10.730815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f9709-b5b7-40bc-a814-2b7c0ed2eb54 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:10.731175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f9709-b5b7-40bc-a814-2b7c0ed2eb54 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:10.733026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 169/342] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:10.735800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f9709-b5b7-40bc-a814-2b7c0ed2eb54 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:10.738617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e93d61-4b73-4ceb-aca7-795c895fd405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:10.739264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e93d61-4b73-4ceb-aca7-795c895fd405 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:10.739539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e93d61-4b73-4ceb-aca7-795c895fd405 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:10.739806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e93d61-4b73-4ceb-aca7-795c895fd405 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:10.751104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e93d61-4b73-4ceb-aca7-795c895fd405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-72e93d61-4b73-4ceb-aca7-795c895fd405 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:10.757571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:10.758527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:10.759329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:10.759329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:10.759329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:10.759329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:10.759329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:10.759329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:10.759329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:10.759329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:10.759329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:10.759329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:10.759329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:10:10.759329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:10.759329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 174/343] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:10:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:10.760514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89ea7b-c241-4500-b0b1-788efb5b9ad3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:10.760679 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89ea7b-c241-4500-b0b1-788efb5b9ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:10.760956 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89ea7b-c241-4500-b0b1-788efb5b9ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:10.786797 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0d89ea7b-c241-4500-b0b1-788efb5b9ad3 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:10.787984 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0d89ea7b-c241-4500-b0b1-788efb5b9ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:10.874057 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f9709-b5b7-40bc-a814-2b7c0ed2eb54 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:10.878397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 175/344] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:10.879212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89ea7b-c241-4500-b0b1-788efb5b9ad3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:10.900640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:10.921991 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93535a-9f33-4a12-8f81-b42cbd32f228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:10.922633 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93535a-9f33-4a12-8f81-b42cbd32f228 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:10.922912 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93535a-9f33-4a12-8f81-b42cbd32f228 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:10.923181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93535a-9f33-4a12-8f81-b42cbd32f228 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:10.926186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:10.927379 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93535a-9f33-4a12-8f81-b42cbd32f228 None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:10.929442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93535a-9f33-4a12-8f81-b42cbd32f228 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:10.931308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 170/345] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:10 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:10.932289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e29b8-0f16-4a3e-b6b8-20b2d70480c4 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:10.934681 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e29b8-0f16-4a3e-b6b8-20b2d70480c4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:10.934681 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e29b8-0f16-4a3e-b6b8-20b2d70480c4 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:10.934681 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 171/346] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:10.945978 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c887c-4abb-4880-951d-025c84734827 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:10.946635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c887c-4abb-4880-951d-025c84734827 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:10.947101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c887c-4abb-4880-951d-025c84734827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:10.972828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5d6c887c-4abb-4880-951d-025c84734827 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:10.975012 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5d6c887c-4abb-4880-951d-025c84734827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:11.014656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89ea7b-c241-4500-b0b1-788efb5b9ad3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:11.058135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a7fd5-6e25-445e-b8b3-ffd8b5d3d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:11.058679 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a7fd5-6e25-445e-b8b3-ffd8b5d3d907 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:11.058960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a7fd5-6e25-445e-b8b3-ffd8b5d3d907 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:11.059228 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a7fd5-6e25-445e-b8b3-ffd8b5d3d907 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:11.059998 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a7fd5-6e25-445e-b8b3-ffd8b5d3d907 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:11.060243 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a7fd5-6e25-445e-b8b3-ffd8b5d3d907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:11.061663 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a7fd5-6e25-445e-b8b3-ffd8b5d3d907 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:11.068137 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 172/347] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:11.069492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c887c-4abb-4880-951d-025c84734827 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:11.070690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 176/348] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:11.076282 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a7fd5-6e25-445e-b8b3-ffd8b5d3d907 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:11.190673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c887c-4abb-4880-951d-025c84734827 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:11.215467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:11.237300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1d449-bf49-46fc-b1e7-221bb50c78a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:11.238395 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1d449-bf49-46fc-b1e7-221bb50c78a4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:11.238929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1d449-bf49-46fc-b1e7-221bb50c78a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:11.239396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1d449-bf49-46fc-b1e7-221bb50c78a4 None admin] PATH_INFO: `/v3/groups/c9d462221a84430887a2befb1eab3023` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:11.246154 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1d449-bf49-46fc-b1e7-221bb50c78a4 None admin] RBAC: Authorizing `identity:get_group(group_id=c9d462221a84430887a2befb1eab3023)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:11.247829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1d449-bf49-46fc-b1e7-221bb50c78a4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:11.250341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 173/349] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Sep 27 17:10:11 2022] GET /identity/v3/groups/c9d462221a84430887a2befb1eab3023 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:11.257252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1d449-bf49-46fc-b1e7-221bb50c78a4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:11.263282 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:11.277707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a7fd5-6e25-445e-b8b3-ffd8b5d3d907 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:11.347439 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae179d8d-4be0-41df-9467-e2783592f5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:11.348089 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae179d8d-4be0-41df-9467-e2783592f5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:11.348357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae179d8d-4be0-41df-9467-e2783592f5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:11.348875 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae179d8d-4be0-41df-9467-e2783592f5e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:11.401721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1d449-bf49-46fc-b1e7-221bb50c78a4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:11.455757 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c960751-986a-427e-8fb2-24765e62d3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:11.456295 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c960751-986a-427e-8fb2-24765e62d3de None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:11.456575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c960751-986a-427e-8fb2-24765e62d3de None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:11.456849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c960751-986a-427e-8fb2-24765e62d3de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:11.457598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c960751-986a-427e-8fb2-24765e62d3de None admin] RBAC: Adding query filter params (group.id=c9d462221a84430887a2befb1eab3023, role.id=1c0bdbdf6a98487cac86e3de530b11d2, scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:11.457966 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c960751-986a-427e-8fb2-24765e62d3de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:11.459457 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c960751-986a-427e-8fb2-24765e62d3de None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:11.461447 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae179d8d-4be0-41df-9467-e2783592f5e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:11.464226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae179d8d-4be0-41df-9467-e2783592f5e7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:11.466923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 174/350] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Sep 27 17:10:11 2022] GET /identity/v3/role_assignments?group.id=c9d462221a84430887a2befb1eab3023&scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f&role.id=1c0bdbdf6a98487cac86e3de530b11d2 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:11.467846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c960751-986a-427e-8fb2-24765e62d3de None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:11.591683 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:11.598709 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:11.604390 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 177/351] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 17:10:11.605550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae179d8d-4be0-41df-9467-e2783592f5e7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:11.673658 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c960751-986a-427e-8fb2-24765e62d3de None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:11.728441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e15c32-2504-40e1-b719-dcd1e9dd8b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:11.729410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e15c32-2504-40e1-b719-dcd1e9dd8b54 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:11.729934 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e15c32-2504-40e1-b719-dcd1e9dd8b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:11.730432 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e15c32-2504-40e1-b719-dcd1e9dd8b54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:11.743076 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae179d8d-4be0-41df-9467-e2783592f5e7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:11.743639 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e15c32-2504-40e1-b719-dcd1e9dd8b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-15e15c32-2504-40e1-b719-dcd1e9dd8b54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:11.749063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:11.750091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:11.750943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:11.750943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:11.750943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:11.750943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:11.750943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:11.750943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:11.750943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:11.750943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:11.750943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:11.750943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:11.750943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:11.750943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:11.750943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 175/352] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:11.751654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bf117-ab36-424c-8a54-ed46e8976e64 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:11.751724 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bf117-ab36-424c-8a54-ed46e8976e64 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:11.752286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bf117-ab36-424c-8a54-ed46e8976e64 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:11.754250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 176/353] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:11.754250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bf117-ab36-424c-8a54-ed46e8976e64 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:11.788570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d353d-ecd4-40f1-8392-a5192e0c3dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:11.789230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d353d-ecd4-40f1-8392-a5192e0c3dca None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:11.789548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d353d-ecd4-40f1-8392-a5192e0c3dca None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:11.789869 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d353d-ecd4-40f1-8392-a5192e0c3dca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:11.805567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d353d-ecd4-40f1-8392-a5192e0c3dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-ef1d353d-ecd4-40f1-8392-a5192e0c3dca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:11.811537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:11.812535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:11.813338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:11.813338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:11.813338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:11.813338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:11.813338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:11.813338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:11.813338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:11.813338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:11.813338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:11.813338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:11.813338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 17:10:11.813338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:11.813986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 178/354] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:11.814951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d353d-ecd4-40f1-8392-a5192e0c3dca None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:11.888270 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:11.919563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59bf117-ab36-424c-8a54-ed46e8976e64 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:11.931695 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:11.949319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d353d-ecd4-40f1-8392-a5192e0c3dca None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:11.974712 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f2a09-c444-479b-8afb-3da33884c031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:11.975728 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f2a09-c444-479b-8afb-3da33884c031 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:11.976269 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f2a09-c444-479b-8afb-3da33884c031 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:11.976810 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f2a09-c444-479b-8afb-3da33884c031 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:11.978977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f2a09-c444-479b-8afb-3da33884c031 None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:11.981050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f2a09-c444-479b-8afb-3da33884c031 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:11.983860 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 177/355] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:11 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:11.985468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0646e-355d-4391-b7cd-f7f28573a6a2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:11.985979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0646e-355d-4391-b7cd-f7f28573a6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:11.986429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0646e-355d-4391-b7cd-f7f28573a6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:12.000180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7676b-2b4f-4e15-8ce2-d2a31c903085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:12.000882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7676b-2b4f-4e15-8ce2-d2a31c903085 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:12.001228 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7676b-2b4f-4e15-8ce2-d2a31c903085 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:12.001569 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7676b-2b4f-4e15-8ce2-d2a31c903085 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:12.002427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7676b-2b4f-4e15-8ce2-d2a31c903085 None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:12.002799 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7676b-2b4f-4e15-8ce2-d2a31c903085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:12.004239 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7676b-2b4f-4e15-8ce2-d2a31c903085 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:12.009008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-79e0646e-355d-4391-b7cd-f7f28573a6a2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:12.011008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-79e0646e-355d-4391-b7cd-f7f28573a6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:12.014303 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 179/356] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:10:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:12.015854 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7676b-2b4f-4e15-8ce2-d2a31c903085 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:12.105788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 178/357] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:12.106507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0646e-355d-4391-b7cd-f7f28573a6a2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:12.139543 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7676b-2b4f-4e15-8ce2-d2a31c903085 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:12.161103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:12.182002 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47623d-7eb7-437a-80a5-01f32411613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:12.182911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47623d-7eb7-437a-80a5-01f32411613b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:12.183207 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47623d-7eb7-437a-80a5-01f32411613b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:12.183480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47623d-7eb7-437a-80a5-01f32411613b None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:12.184240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47623d-7eb7-437a-80a5-01f32411613b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:12.184547 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47623d-7eb7-437a-80a5-01f32411613b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:12.186018 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47623d-7eb7-437a-80a5-01f32411613b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:12.197595 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 180/358] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:10:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:12.198796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47623d-7eb7-437a-80a5-01f32411613b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:12.236283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0646e-355d-4391-b7cd-f7f28573a6a2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:12.238687 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:12.277281 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cf88a-d471-4ffc-922e-033b60992c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:12.278080 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cf88a-d471-4ffc-922e-033b60992c8a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:12.278286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cf88a-d471-4ffc-922e-033b60992c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:12.278610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cf88a-d471-4ffc-922e-033b60992c8a None admin] PATH_INFO: `/v3/groups/c9d462221a84430887a2befb1eab3023` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:12.279716 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cf88a-d471-4ffc-922e-033b60992c8a None admin] RBAC: Authorizing `identity:get_group(group_id=c9d462221a84430887a2befb1eab3023)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:12.281245 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cf88a-d471-4ffc-922e-033b60992c8a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:12.282867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 179/359] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Sep 27 17:10:12 2022] GET /identity/v3/groups/c9d462221a84430887a2befb1eab3023 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:12.283993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef8207-2373-49b2-9cae-5876b8bcd2a5 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:12.284274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef8207-2373-49b2-9cae-5876b8bcd2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:12.284545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef8207-2373-49b2-9cae-5876b8bcd2a5 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:12.292331 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 180/360] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:12.293350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef8207-2373-49b2-9cae-5876b8bcd2a5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:12.323123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47623d-7eb7-437a-80a5-01f32411613b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:12.367414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794461bd-2a07-48f4-b836-2fd13166ce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:12.368046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794461bd-2a07-48f4-b836-2fd13166ce32 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:12.368309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794461bd-2a07-48f4-b836-2fd13166ce32 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:12.368793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794461bd-2a07-48f4-b836-2fd13166ce32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:12.411849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef8207-2373-49b2-9cae-5876b8bcd2a5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:12.431272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:12.477797 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acafa9b-da5a-4ea0-8def-7b3478697ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:12.478435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794461bd-2a07-48f4-b836-2fd13166ce32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:12.478553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acafa9b-da5a-4ea0-8def-7b3478697ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:12.478722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acafa9b-da5a-4ea0-8def-7b3478697ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:12.478991 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acafa9b-da5a-4ea0-8def-7b3478697ad4 None admin] PATH_INFO: `/v3/users/484016db325d4044957e3b81f330c206` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:12.480105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acafa9b-da5a-4ea0-8def-7b3478697ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=484016db325d4044957e3b81f330c206)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:12.480593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794461bd-2a07-48f4-b836-2fd13166ce32 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:12.481525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acafa9b-da5a-4ea0-8def-7b3478697ad4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:12.483597 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 181/361] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:10:12 2022] GET /identity/v3/users/484016db325d4044957e3b81f330c206 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:12.486915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e4968-cc16-4b13-af4f-f3a77321ff25 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:12.487189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e4968-cc16-4b13-af4f-f3a77321ff25 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:12.487465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e4968-cc16-4b13-af4f-f3a77321ff25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:12.512784 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-307e4968-cc16-4b13-af4f-f3a77321ff25 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:12.513990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-307e4968-cc16-4b13-af4f-f3a77321ff25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:12.554920 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:12.607301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 182/362] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:12.607301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e4968-cc16-4b13-af4f-f3a77321ff25 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:12.620592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 181/363] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:12.621866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794461bd-2a07-48f4-b836-2fd13166ce32 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:12.714530 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:12.725074 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e4968-cc16-4b13-af4f-f3a77321ff25 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:12.741715 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794461bd-2a07-48f4-b836-2fd13166ce32 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:12.760435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ac5f6-43c3-4f87-a358-2d11e2f9e8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:12.761364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ac5f6-43c3-4f87-a358-2d11e2f9e8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:12.761888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ac5f6-43c3-4f87-a358-2d11e2f9e8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:12.762372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ac5f6-43c3-4f87-a358-2d11e2f9e8b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:12.763324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ac5f6-43c3-4f87-a358-2d11e2f9e8b8 None admin] RBAC: Adding query filter params (group.id=c9d462221a84430887a2befb1eab3023, role.id=a1b50a29e5e4419db517dfaf3d70c19f, scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:12.763843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ac5f6-43c3-4f87-a358-2d11e2f9e8b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:12.766055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ac5f6-43c3-4f87-a358-2d11e2f9e8b8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:12.772299 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 183/364] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Sep 27 17:10:12 2022] GET /identity/v3/role_assignments?group.id=c9d462221a84430887a2befb1eab3023&scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f&role.id=a1b50a29e5e4419db517dfaf3d70c19f => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:12.773308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ac5f6-43c3-4f87-a358-2d11e2f9e8b8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:12.787402 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe484ec9-462a-465a-9aed-73edfcaefd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:12.787770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe484ec9-462a-465a-9aed-73edfcaefd26 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:12.788027 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe484ec9-462a-465a-9aed-73edfcaefd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:12.788296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe484ec9-462a-465a-9aed-73edfcaefd26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:12.811921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe484ec9-462a-465a-9aed-73edfcaefd26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:12.822145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-fe484ec9-462a-465a-9aed-73edfcaefd26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:12.826647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:12.827573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:12.828975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:12.828975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:12.828975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:12.828975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:12.828975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:12.828975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:12.828975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:12.828975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:12.828975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:12.828975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:12.828975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:10:12.828975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:12.828975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 182/365] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:10:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:12.829656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe484ec9-462a-465a-9aed-73edfcaefd26 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:12.892224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ac5f6-43c3-4f87-a358-2d11e2f9e8b8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:12.931183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11be394-c1b3-4372-ad71-e2fd106c3648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:12.932179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11be394-c1b3-4372-ad71-e2fd106c3648 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:12.932698 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11be394-c1b3-4372-ad71-e2fd106c3648 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:12.933167 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11be394-c1b3-4372-ad71-e2fd106c3648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:12.934171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11be394-c1b3-4372-ad71-e2fd106c3648 None admin] RBAC: Adding query filter params (role.id=3d56d71a94cf4ce1887d1b743039657b, user.id=484016db325d4044957e3b81f330c206, scope.system=all) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:12.934736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11be394-c1b3-4372-ad71-e2fd106c3648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:12.936461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11be394-c1b3-4372-ad71-e2fd106c3648 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:12.950506 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 184/366] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Sep 27 17:10:12 2022] GET /identity/v3/role_assignments?user.id=484016db325d4044957e3b81f330c206&scope.system=all&role.id=3d56d71a94cf4ce1887d1b743039657b => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:12.951637 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11be394-c1b3-4372-ad71-e2fd106c3648 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:12.984487 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe484ec9-462a-465a-9aed-73edfcaefd26 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:13.061336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab92c5d-82bd-423e-b0ad-cd3dcfcb000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:13.062105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab92c5d-82bd-423e-b0ad-cd3dcfcb000e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:13.063080 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab92c5d-82bd-423e-b0ad-cd3dcfcb000e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:13.063365 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab92c5d-82bd-423e-b0ad-cd3dcfcb000e None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:13.064689 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab92c5d-82bd-423e-b0ad-cd3dcfcb000e None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:13.066774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab92c5d-82bd-423e-b0ad-cd3dcfcb000e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:13.068561 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 183/367] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:12 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:13.071637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab92c5d-82bd-423e-b0ad-cd3dcfcb000e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:13.086600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:13.113471 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:13.122726 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11be394-c1b3-4372-ad71-e2fd106c3648 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:13.197022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9ff53-45d9-4209-bdc5-5ca2242a60d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:13.197839 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9ff53-45d9-4209-bdc5-5ca2242a60d9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:13.198130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9ff53-45d9-4209-bdc5-5ca2242a60d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:13.198407 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9ff53-45d9-4209-bdc5-5ca2242a60d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:13.199924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9ff53-45d9-4209-bdc5-5ca2242a60d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:13.200230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9ff53-45d9-4209-bdc5-5ca2242a60d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:13.201634 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9ff53-45d9-4209-bdc5-5ca2242a60d9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:13.224356 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 185/368] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:13.225286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9ff53-45d9-4209-bdc5-5ca2242a60d9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:13.244280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab92c5d-82bd-423e-b0ad-cd3dcfcb000e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:13.313048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84075c2-2ea2-4943-bf35-e6ea4f569c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:13.314153 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84075c2-2ea2-4943-bf35-e6ea4f569c3d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:13.314640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84075c2-2ea2-4943-bf35-e6ea4f569c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:13.315103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84075c2-2ea2-4943-bf35-e6ea4f569c3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:13.333148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84075c2-2ea2-4943-bf35-e6ea4f569c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-b84075c2-2ea2-4943-bf35-e6ea4f569c3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:13.340333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:13.341200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:13.342044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:13.342044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:13.342044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:13.342044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:13.342044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:13.342044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:13.342044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:13.342044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:13.342044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:13.342044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:13.342044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:10:13.342044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:13.343157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 184/369] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:10:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:13.343912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84075c2-2ea2-4943-bf35-e6ea4f569c3d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:13.381280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9ff53-45d9-4209-bdc5-5ca2242a60d9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:13.435034 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:13.441428 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519850e0-40eb-4ef4-a8cf-271a42cbaba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:13.442121 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519850e0-40eb-4ef4-a8cf-271a42cbaba6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:13.442412 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519850e0-40eb-4ef4-a8cf-271a42cbaba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:13.442669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519850e0-40eb-4ef4-a8cf-271a42cbaba6 None admin] PATH_INFO: `/v3/groups/c9d462221a84430887a2befb1eab3023` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:13.444790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519850e0-40eb-4ef4-a8cf-271a42cbaba6 None admin] RBAC: Authorizing `identity:get_group(group_id=c9d462221a84430887a2befb1eab3023)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:13.446277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519850e0-40eb-4ef4-a8cf-271a42cbaba6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:13.448012 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 186/370] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Sep 27 17:10:13 2022] GET /identity/v3/groups/c9d462221a84430887a2befb1eab3023 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:13.448595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519850e0-40eb-4ef4-a8cf-271a42cbaba6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:13.485991 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:13.497724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84075c2-2ea2-4943-bf35-e6ea4f569c3d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:13.542688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e4203-ce41-4379-8f63-32bbf0be6277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:13.543652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e4203-ce41-4379-8f63-32bbf0be6277 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:13.544172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e4203-ce41-4379-8f63-32bbf0be6277 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:13.544981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e4203-ce41-4379-8f63-32bbf0be6277 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:13.598594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519850e0-40eb-4ef4-a8cf-271a42cbaba6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:13.638730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e4203-ce41-4379-8f63-32bbf0be6277 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:13.640716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e4203-ce41-4379-8f63-32bbf0be6277 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:13.651634 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2297d49-ac6e-4d66-9d3a-30341c506f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:13.652247 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2297d49-ac6e-4d66-9d3a-30341c506f88 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:13.652522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2297d49-ac6e-4d66-9d3a-30341c506f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:13.652794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2297d49-ac6e-4d66-9d3a-30341c506f88 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:13.653462 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2297d49-ac6e-4d66-9d3a-30341c506f88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:13.653807 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2297d49-ac6e-4d66-9d3a-30341c506f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:13.656316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2297d49-ac6e-4d66-9d3a-30341c506f88 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:13.668352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 187/371] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:13.669188 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2297d49-ac6e-4d66-9d3a-30341c506f88 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:13.728287 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:13.769189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 185/372] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:13.769896 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e4203-ce41-4379-8f63-32bbf0be6277 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:13.787421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:13.806661 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2297d49-ac6e-4d66-9d3a-30341c506f88 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:13.862324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528cca7-61e7-4f45-9870-edb07b608b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:13.863118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528cca7-61e7-4f45-9870-edb07b608b89 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:13.863402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528cca7-61e7-4f45-9870-edb07b608b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:13.863673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528cca7-61e7-4f45-9870-edb07b608b89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:13.865295 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528cca7-61e7-4f45-9870-edb07b608b89 None admin] RBAC: Adding query filter params (group.id=c9d462221a84430887a2befb1eab3023, role.id=1c0bdbdf6a98487cac86e3de530b11d2, scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:13.865610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528cca7-61e7-4f45-9870-edb07b608b89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:13.867099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528cca7-61e7-4f45-9870-edb07b608b89 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:13.874085 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 188/373] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Sep 27 17:10:13 2022] GET /identity/v3/role_assignments?group.id=c9d462221a84430887a2befb1eab3023&scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2&role.id=1c0bdbdf6a98487cac86e3de530b11d2 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:13.877708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528cca7-61e7-4f45-9870-edb07b608b89 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:13.930020 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e4203-ce41-4379-8f63-32bbf0be6277 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:14.016512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ba7bd-c5f9-4a8e-9edb-bf77956010f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:14.017528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ba7bd-c5f9-4a8e-9edb-bf77956010f9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:14.018049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ba7bd-c5f9-4a8e-9edb-bf77956010f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:14.018512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ba7bd-c5f9-4a8e-9edb-bf77956010f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:14.075787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528cca7-61e7-4f45-9870-edb07b608b89 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:14.088434 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:14.126296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ba7bd-c5f9-4a8e-9edb-bf77956010f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:14.128328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ba7bd-c5f9-4a8e-9edb-bf77956010f9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:14.142004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44585f6a-1c17-406d-bf8e-5926105abea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:14.143017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44585f6a-1c17-406d-bf8e-5926105abea2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:14.143489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44585f6a-1c17-406d-bf8e-5926105abea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:14.143952 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44585f6a-1c17-406d-bf8e-5926105abea2 None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:14.149002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44585f6a-1c17-406d-bf8e-5926105abea2 None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:14.150806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44585f6a-1c17-406d-bf8e-5926105abea2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:14.153064 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 189/374] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:13 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:14.158823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44585f6a-1c17-406d-bf8e-5926105abea2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:14.193907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:14.244459 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 186/375] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:14.246052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65e570-535c-4b77-808a-c303da1b46ea None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:14.246334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65e570-535c-4b77-808a-c303da1b46ea None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:14.246965 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65e570-535c-4b77-808a-c303da1b46ea None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:14.248036 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 187/376] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:14.254479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5f553-d9da-4935-81a9-95635d5f2703 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:14.254479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5f553-d9da-4935-81a9-95635d5f2703 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:14.254809 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5f553-d9da-4935-81a9-95635d5f2703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:14.276270 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-99e5f553-d9da-4935-81a9-95635d5f2703 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:14.277484 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-99e5f553-d9da-4935-81a9-95635d5f2703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:14.309577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44585f6a-1c17-406d-bf8e-5926105abea2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:14.356857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b90ba-ed62-4b4a-b07b-bd26e398e9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:14.357815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b90ba-ed62-4b4a-b07b-bd26e398e9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:14.358145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b90ba-ed62-4b4a-b07b-bd26e398e9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:14.358418 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b90ba-ed62-4b4a-b07b-bd26e398e9d6 None admin] PATH_INFO: `/v3/groups/c9d462221a84430887a2befb1eab3023` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:14.361852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b90ba-ed62-4b4a-b07b-bd26e398e9d6 None admin] RBAC: Authorizing `identity:get_group(group_id=c9d462221a84430887a2befb1eab3023)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:14.362260 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b90ba-ed62-4b4a-b07b-bd26e398e9d6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:14.364456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 190/377] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Sep 27 17:10:14 2022] GET /identity/v3/groups/c9d462221a84430887a2befb1eab3023 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:14.365267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b90ba-ed62-4b4a-b07b-bd26e398e9d6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:14.366357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:14.374803 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 188/378] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:10:14.376206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5f553-d9da-4935-81a9-95635d5f2703 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:14.474364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:14.482900 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5f553-d9da-4935-81a9-95635d5f2703 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:14.492196 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b90ba-ed62-4b4a-b07b-bd26e398e9d6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:14.522158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670fb4f-7839-43d0-9149-f3fa450b1e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:14.523147 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670fb4f-7839-43d0-9149-f3fa450b1e6b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:14.523626 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670fb4f-7839-43d0-9149-f3fa450b1e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:14.524096 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670fb4f-7839-43d0-9149-f3fa450b1e6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:14.525032 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670fb4f-7839-43d0-9149-f3fa450b1e6b None admin] RBAC: Adding query filter params (group.id=c9d462221a84430887a2befb1eab3023, role.id=a1b50a29e5e4419db517dfaf3d70c19f, scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:14.525545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670fb4f-7839-43d0-9149-f3fa450b1e6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:14.527510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670fb4f-7839-43d0-9149-f3fa450b1e6b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:14.529957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968030c3-c450-44f4-9ac6-2612c7c717d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:14.530673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968030c3-c450-44f4-9ac6-2612c7c717d8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:14.531168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968030c3-c450-44f4-9ac6-2612c7c717d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:14.531871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968030c3-c450-44f4-9ac6-2612c7c717d8 None admin] PATH_INFO: `/v3/projects/0f246d966d6f4376a724440b0dff9304` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:14.532796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968030c3-c450-44f4-9ac6-2612c7c717d8 None admin] RBAC: Authorizing `identity:get_project(project_id=0f246d966d6f4376a724440b0dff9304)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:14.534322 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968030c3-c450-44f4-9ac6-2612c7c717d8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:14.535644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 189/379] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Sep 27 17:10:14 2022] GET /identity/v3/role_assignments?group.id=c9d462221a84430887a2befb1eab3023&scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2&role.id=a1b50a29e5e4419db517dfaf3d70c19f => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:14.536315 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 191/380] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:14 2022] GET /identity/v3/projects/0f246d966d6f4376a724440b0dff9304 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:14.545723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670fb4f-7839-43d0-9149-f3fa450b1e6b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:14.626714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:14.692441 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670fb4f-7839-43d0-9149-f3fa450b1e6b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:14.733140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6438e5-5be4-47ab-ac28-84850acc0613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:14.734375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6438e5-5be4-47ab-ac28-84850acc0613 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:14.734664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6438e5-5be4-47ab-ac28-84850acc0613 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:14.734922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6438e5-5be4-47ab-ac28-84850acc0613 None admin] PATH_INFO: `/v3/groups/f23387f9450d4457aa1b369e5b37ec5d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:14.741553 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6438e5-5be4-47ab-ac28-84850acc0613 None admin] RBAC: Authorizing `identity:get_group(group_id=f23387f9450d4457aa1b369e5b37ec5d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:14.743042 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6438e5-5be4-47ab-ac28-84850acc0613 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:14.745000 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 190/381] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Sep 27 17:10:14 2022] GET /identity/v3/groups/f23387f9450d4457aa1b369e5b37ec5d => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:14.750908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968030c3-c450-44f4-9ac6-2612c7c717d8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:14.770851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6438e5-5be4-47ab-ac28-84850acc0613 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:14.918218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968030c3-c450-44f4-9ac6-2612c7c717d8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:14.941192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6438e5-5be4-47ab-ac28-84850acc0613 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:14.977451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:14.979442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511508b8-7c75-401f-884a-bcae07c08f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:14.980134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511508b8-7c75-401f-884a-bcae07c08f67 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:14.980413 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511508b8-7c75-401f-884a-bcae07c08f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:14.980764 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511508b8-7c75-401f-884a-bcae07c08f67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:14.981477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511508b8-7c75-401f-884a-bcae07c08f67 None admin] RBAC: Adding query filter params (group.id=f23387f9450d4457aa1b369e5b37ec5d, role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=0f246d966d6f4376a724440b0dff9304) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:14.981807 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511508b8-7c75-401f-884a-bcae07c08f67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:14.983403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511508b8-7c75-401f-884a-bcae07c08f67 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:14.990138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 192/382] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Sep 27 17:10:14 2022] GET /identity/v3/role_assignments?group.id=f23387f9450d4457aa1b369e5b37ec5d&scope.project.id=0f246d966d6f4376a724440b0dff9304&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:15.003502 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015eca5-e5db-4d07-be06-2b939711448f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:15.004154 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015eca5-e5db-4d07-be06-2b939711448f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:15.004430 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015eca5-e5db-4d07-be06-2b939711448f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:15.004699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015eca5-e5db-4d07-be06-2b939711448f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:15.017386 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015eca5-e5db-4d07-be06-2b939711448f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-5015eca5-e5db-4d07-be06-2b939711448f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:15.023055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:15.024041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:15.024829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:15.024829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:15.024829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:15.024829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:15.024829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:15.024829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:15.024829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:15.024829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:15.024829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:15.024829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:15.024829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:15.024829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:15.024829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 191/383] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:15.035318 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511508b8-7c75-401f-884a-bcae07c08f67 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:15.061162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:15.183460 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511508b8-7c75-401f-884a-bcae07c08f67 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:15.232078 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d589a-c555-4aec-b732-b2f9cc62f847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:15.232619 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d589a-c555-4aec-b732-b2f9cc62f847 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:15.232897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d589a-c555-4aec-b732-b2f9cc62f847 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:15.233167 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d589a-c555-4aec-b732-b2f9cc62f847 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:15.233988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d589a-c555-4aec-b732-b2f9cc62f847 None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:15.234503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d589a-c555-4aec-b732-b2f9cc62f847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:15.235808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d589a-c555-4aec-b732-b2f9cc62f847 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:15.247551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 193/384] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:10:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:15.253527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015eca5-e5db-4d07-be06-2b939711448f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:15.398901 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015eca5-e5db-4d07-be06-2b939711448f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:15.445999 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eb617-ae30-4968-b2c4-998e86ed0194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:15.446647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eb617-ae30-4968-b2c4-998e86ed0194 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:15.446924 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eb617-ae30-4968-b2c4-998e86ed0194 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:15.447196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3eb617-ae30-4968-b2c4-998e86ed0194 None admin] PATH_INFO: `/v3/groups/c9d462221a84430887a2befb1eab3023` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:15.448308 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3eb617-ae30-4968-b2c4-998e86ed0194 None admin] RBAC: Authorizing `identity:get_group(group_id=c9d462221a84430887a2befb1eab3023)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:15.449773 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3eb617-ae30-4968-b2c4-998e86ed0194 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:15.452780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 192/385] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Sep 27 17:10:15 2022] GET /identity/v3/groups/c9d462221a84430887a2befb1eab3023 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:15.458798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d589a-c555-4aec-b732-b2f9cc62f847 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:15.556875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:15.589516 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d589a-c555-4aec-b732-b2f9cc62f847 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:15.638758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539faad8-7ebf-4b44-9656-3b1936bb3401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:15.639398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539faad8-7ebf-4b44-9656-3b1936bb3401 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:15.639680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539faad8-7ebf-4b44-9656-3b1936bb3401 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:15.640489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539faad8-7ebf-4b44-9656-3b1936bb3401 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:15.641785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539faad8-7ebf-4b44-9656-3b1936bb3401 None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:15.643305 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539faad8-7ebf-4b44-9656-3b1936bb3401 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:15.646289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 194/386] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:15 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:15.651531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eb617-ae30-4968-b2c4-998e86ed0194 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:15.663217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad56b12-6184-43fc-ab40-410531464d4b None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:15.663515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad56b12-6184-43fc-ab40-410531464d4b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:15.663760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad56b12-6184-43fc-ab40-410531464d4b None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:15.665355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 195/387] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:15.670376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c293-f551-4efc-808d-e432c97169a4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:15.670655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c293-f551-4efc-808d-e432c97169a4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:15.670929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c293-f551-4efc-808d-e432c97169a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:15.699263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4566c293-f551-4efc-808d-e432c97169a4 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:15.700817 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4566c293-f551-4efc-808d-e432c97169a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:15.727940 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:15.786648 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3eb617-ae30-4968-b2c4-998e86ed0194 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:15.825965 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 196/388] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:10:15.826298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35544d40-ecc2-4626-8861-d6a0d7174ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:15.826982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35544d40-ecc2-4626-8861-d6a0d7174ad0 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:15.827309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35544d40-ecc2-4626-8861-d6a0d7174ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:15.827592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35544d40-ecc2-4626-8861-d6a0d7174ad0 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f/groups/c9d462221a84430887a2befb1eab3023/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:15.829678 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35544d40-ecc2-4626-8861-d6a0d7174ad0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f, group_id=c9d462221a84430887a2befb1eab3023, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:15.831145 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35544d40-ecc2-4626-8861-d6a0d7174ad0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:15.852230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 193/389] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Sep 27 17:10:15 2022] PUT /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f/groups/c9d462221a84430887a2befb1eab3023/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:10:16.128184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566c293-f551-4efc-808d-e432c97169a4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:16.224758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:16.252305 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566c293-f551-4efc-808d-e432c97169a4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:16.294392 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4665c-7543-4421-8d19-67cf85e2e10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:16.295032 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4665c-7543-4421-8d19-67cf85e2e10c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:16.295364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4665c-7543-4421-8d19-67cf85e2e10c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:16.295645 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4665c-7543-4421-8d19-67cf85e2e10c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:16.308309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4665c-7543-4421-8d19-67cf85e2e10c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-08d4665c-7543-4421-8d19-67cf85e2e10c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:16.314047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:16.315031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:16.315837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:16.315837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:16.315837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:16.315837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:16.315837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:16.315837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:16.315837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:16.315837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:16.315837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:16.315837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:16.315837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:10:16.315837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:16.317300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 197/390] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:10:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:16.321142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35544d40-ecc2-4626-8861-d6a0d7174ad0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:16.494577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35544d40-ecc2-4626-8861-d6a0d7174ad0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:16.511370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:16.533951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6f331-5cc4-4213-9cac-213371fb1068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:16.534565 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6f331-5cc4-4213-9cac-213371fb1068 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:16.534841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6f331-5cc4-4213-9cac-213371fb1068 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:16.535107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6f331-5cc4-4213-9cac-213371fb1068 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:16.535766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6f331-5cc4-4213-9cac-213371fb1068 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:16.536062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6f331-5cc4-4213-9cac-213371fb1068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:16.537403 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6f331-5cc4-4213-9cac-213371fb1068 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:16.549673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 194/391] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:16.555194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4665c-7543-4421-8d19-67cf85e2e10c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:16.718753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4665c-7543-4421-8d19-67cf85e2e10c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:16.764806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f90e8d-9abb-426d-9259-d7f9d1d6f1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:16.765426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f90e8d-9abb-426d-9259-d7f9d1d6f1db None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:16.765871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f90e8d-9abb-426d-9259-d7f9d1d6f1db None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:16.765991 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f90e8d-9abb-426d-9259-d7f9d1d6f1db None admin] PATH_INFO: `/v3/groups/c9d462221a84430887a2befb1eab3023` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:16.767178 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f90e8d-9abb-426d-9259-d7f9d1d6f1db None admin] RBAC: Authorizing `identity:get_group(group_id=c9d462221a84430887a2befb1eab3023)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:16.768630 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f90e8d-9abb-426d-9259-d7f9d1d6f1db None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:16.770573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 198/392] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Sep 27 17:10:16 2022] GET /identity/v3/groups/c9d462221a84430887a2befb1eab3023 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:16.776001 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6f331-5cc4-4213-9cac-213371fb1068 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:16.777929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daba47d-75e7-49da-a35b-5cc7b836d9c0 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:16.778362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daba47d-75e7-49da-a35b-5cc7b836d9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:16.778850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daba47d-75e7-49da-a35b-5cc7b836d9c0 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:16.781139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 199/393] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:10:16.786384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202008ab-f496-4c24-8024-f4929d23fd9d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:16.786905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202008ab-f496-4c24-8024-f4929d23fd9d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:16.787326 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202008ab-f496-4c24-8024-f4929d23fd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:16.794806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:16.808908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-202008ab-f496-4c24-8024-f4929d23fd9d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:16.810335 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-202008ab-f496-4c24-8024-f4929d23fd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:16.916158 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 200/394] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:10:16.960392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6f331-5cc4-4213-9cac-213371fb1068 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:17.010184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7f875-8d44-4e02-b7c2-86c93de39118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:17.010743 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7f875-8d44-4e02-b7c2-86c93de39118 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:17.011019 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7f875-8d44-4e02-b7c2-86c93de39118 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:17.011289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7f875-8d44-4e02-b7c2-86c93de39118 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:17.018461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7f875-8d44-4e02-b7c2-86c93de39118 None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:17.019925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7f875-8d44-4e02-b7c2-86c93de39118 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:17.021615 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 195/395] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:16 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:17.027363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202008ab-f496-4c24-8024-f4929d23fd9d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:17.193806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202008ab-f496-4c24-8024-f4929d23fd9d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:17.239740 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a0d7b-c0f5-4a17-b3c2-e230db5324ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:17.240418 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a0d7b-c0f5-4a17-b3c2-e230db5324ae None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:17.240690 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a0d7b-c0f5-4a17-b3c2-e230db5324ae None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:17.240961 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a0d7b-c0f5-4a17-b3c2-e230db5324ae None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f/groups/c9d462221a84430887a2befb1eab3023/roles/a1b50a29e5e4419db517dfaf3d70c19f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:17.247464 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a0d7b-c0f5-4a17-b3c2-e230db5324ae None admin] RBAC: Authorizing `identity:create_grant(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f, group_id=c9d462221a84430887a2befb1eab3023, role_id=a1b50a29e5e4419db517dfaf3d70c19f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:17.248924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a0d7b-c0f5-4a17-b3c2-e230db5324ae None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:17.251623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:17.268336 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 201/396] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Sep 27 17:10:17 2022] PUT /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f/groups/c9d462221a84430887a2befb1eab3023/roles/a1b50a29e5e4419db517dfaf3d70c19f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:10:17.279924 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7f875-8d44-4e02-b7c2-86c93de39118 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:17.356538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:17.423459 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7f875-8d44-4e02-b7c2-86c93de39118 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:17.463465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409ab04-e554-4b98-92cd-2b137ca3afee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:17.464112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409ab04-e554-4b98-92cd-2b137ca3afee None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:17.464395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409ab04-e554-4b98-92cd-2b137ca3afee None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:17.464669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409ab04-e554-4b98-92cd-2b137ca3afee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:17.477529 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409ab04-e554-4b98-92cd-2b137ca3afee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-9409ab04-e554-4b98-92cd-2b137ca3afee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:17.485144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:17.486184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:17.486983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:17.486983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:17.486983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:17.486983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:17.486983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:17.486983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:17.486983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:17.486983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:17.486983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:17.486983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:17.486983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:17.486983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:17.486983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 196/397] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:17.495005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a0d7b-c0f5-4a17-b3c2-e230db5324ae None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:17.631451 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a0d7b-c0f5-4a17-b3c2-e230db5324ae None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:17.674572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907dc0e-378f-4a1c-8c50-eb8783282b65 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:17.674931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907dc0e-378f-4a1c-8c50-eb8783282b65 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:17.675210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907dc0e-378f-4a1c-8c50-eb8783282b65 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:17.680883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 197/398] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:17.681961 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d9cae-246f-4d39-b35a-f2100eb04958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:17.682836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d9cae-246f-4d39-b35a-f2100eb04958 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:17.683320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d9cae-246f-4d39-b35a-f2100eb04958 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:17.683835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d9cae-246f-4d39-b35a-f2100eb04958 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:17.684782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d9cae-246f-4d39-b35a-f2100eb04958 None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:17.685027 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e361f-218b-4068-85fd-44389f94c2a1 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:17.685312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e361f-218b-4068-85fd-44389f94c2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:17.685586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e361f-218b-4068-85fd-44389f94c2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:17.685879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d9cae-246f-4d39-b35a-f2100eb04958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:17.687696 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d9cae-246f-4d39-b35a-f2100eb04958 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:17.697307 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 202/399] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:10:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:17.702592 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d9cae-246f-4d39-b35a-f2100eb04958 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:17.731635 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ab3e361f-218b-4068-85fd-44389f94c2a1 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:17.731936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ab3e361f-218b-4068-85fd-44389f94c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:17.768755 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:17.824770 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d9cae-246f-4d39-b35a-f2100eb04958 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:17.878197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 198/400] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:17.915034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5782cb-61bf-4729-9857-cd4fedd1d71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:17.916368 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5782cb-61bf-4729-9857-cd4fedd1d71b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:17.916911 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5782cb-61bf-4729-9857-cd4fedd1d71b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:17.917404 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5782cb-61bf-4729-9857-cd4fedd1d71b None admin] PATH_INFO: `/v3/groups/c9d462221a84430887a2befb1eab3023` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:17.922175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5782cb-61bf-4729-9857-cd4fedd1d71b None admin] RBAC: Authorizing `identity:get_group(group_id=c9d462221a84430887a2befb1eab3023)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:17.923913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5782cb-61bf-4729-9857-cd4fedd1d71b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:17.925736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 203/401] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Sep 27 17:10:17 2022] GET /identity/v3/groups/c9d462221a84430887a2befb1eab3023 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:17.931365 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e361f-218b-4068-85fd-44389f94c2a1 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:17.977376 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:18.073981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e361f-218b-4068-85fd-44389f94c2a1 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:18.114598 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939ef0e-2eaf-4bf0-a7ff-7f215c66b4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:18.115242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939ef0e-2eaf-4bf0-a7ff-7f215c66b4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:18.115522 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939ef0e-2eaf-4bf0-a7ff-7f215c66b4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:18.115797 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939ef0e-2eaf-4bf0-a7ff-7f215c66b4c2 None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:18.116910 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939ef0e-2eaf-4bf0-a7ff-7f215c66b4c2 None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:18.118389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939ef0e-2eaf-4bf0-a7ff-7f215c66b4c2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:18.120170 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 199/402] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:17 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:18.125900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5782cb-61bf-4729-9857-cd4fedd1d71b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:18.147755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3958-0a47-40d0-852a-0b49f97cd611 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:18.148049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3958-0a47-40d0-852a-0b49f97cd611 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:18.148324 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3958-0a47-40d0-852a-0b49f97cd611 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:18.149986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 200/403] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:10:18.155096 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cdc19-feb0-4947-9f45-7fc054fa71a7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:18.155936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cdc19-feb0-4947-9f45-7fc054fa71a7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:18.156219 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cdc19-feb0-4947-9f45-7fc054fa71a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:18.178469 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2d3cdc19-feb0-4947-9f45-7fc054fa71a7 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:18.179571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2d3cdc19-feb0-4947-9f45-7fc054fa71a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:18.277721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5782cb-61bf-4729-9857-cd4fedd1d71b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:18.298111 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 201/404] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:10:18.299288 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cdc19-feb0-4947-9f45-7fc054fa71a7 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:18.304282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:18.323045 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6e219-c9b7-4c5e-ba7f-0a754660cc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:18.323715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6e219-c9b7-4c5e-ba7f-0a754660cc82 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:18.324002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6e219-c9b7-4c5e-ba7f-0a754660cc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:18.324280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6e219-c9b7-4c5e-ba7f-0a754660cc82 None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2/groups/c9d462221a84430887a2befb1eab3023/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:18.326648 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6e219-c9b7-4c5e-ba7f-0a754660cc82 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad3b24197d4b3b8d9880cb3f4241e2, group_id=c9d462221a84430887a2befb1eab3023, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:18.334772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6e219-c9b7-4c5e-ba7f-0a754660cc82 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:18.335803 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:18.361385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 204/405] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Sep 27 17:10:18 2022] PUT /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2/groups/c9d462221a84430887a2befb1eab3023/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:10:18.416980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cdc19-feb0-4947-9f45-7fc054fa71a7 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:18.457848 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4112d6-4580-4473-8bc1-f200b38b42de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:18.458886 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4112d6-4580-4473-8bc1-f200b38b42de None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:18.459376 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4112d6-4580-4473-8bc1-f200b38b42de None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:18.459853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4112d6-4580-4473-8bc1-f200b38b42de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:18.473219 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4112d6-4580-4473-8bc1-f200b38b42de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-5c4112d6-4580-4473-8bc1-f200b38b42de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:18.478852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:18.479810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:18.480605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:18.480605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:18.480605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:18.480605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:18.480605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:18.480605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:18.480605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:18.480605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:18.480605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:18.480605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:18.480605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:10:18.480605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:18.483401 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 202/406] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:10:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:18.489221 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6e219-c9b7-4c5e-ba7f-0a754660cc82 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:18.627535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6e219-c9b7-4c5e-ba7f-0a754660cc82 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:18.664477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330d7c-9a31-4e5b-8c85-31e5c77c87db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:18.665090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330d7c-9a31-4e5b-8c85-31e5c77c87db None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:18.665482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330d7c-9a31-4e5b-8c85-31e5c77c87db None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:18.665792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330d7c-9a31-4e5b-8c85-31e5c77c87db None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:18.666514 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83330d7c-9a31-4e5b-8c85-31e5c77c87db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:18.666824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83330d7c-9a31-4e5b-8c85-31e5c77c87db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:18.668193 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83330d7c-9a31-4e5b-8c85-31e5c77c87db None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:18.677597 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 205/407] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:18.682876 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4112d6-4580-4473-8bc1-f200b38b42de None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:18.740335 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330d7c-9a31-4e5b-8c85-31e5c77c87db None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:18.822401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:18.847581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:18.876180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4112d6-4580-4473-8bc1-f200b38b42de None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:18.913113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330d7c-9a31-4e5b-8c85-31e5c77c87db None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:18.950468 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d98c3c-9d28-4d93-80fe-d01eafb34647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:18.951115 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d98c3c-9d28-4d93-80fe-d01eafb34647 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:18.951306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d98c3c-9d28-4d93-80fe-d01eafb34647 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:18.951581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d98c3c-9d28-4d93-80fe-d01eafb34647 None admin] PATH_INFO: `/v3/groups/c9d462221a84430887a2befb1eab3023` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:18.953636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d98c3c-9d28-4d93-80fe-d01eafb34647 None admin] RBAC: Authorizing `identity:get_group(group_id=c9d462221a84430887a2befb1eab3023)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:18.955140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d98c3c-9d28-4d93-80fe-d01eafb34647 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:18.958454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 203/408] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Sep 27 17:10:18 2022] GET /identity/v3/groups/c9d462221a84430887a2befb1eab3023 => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:18.964620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d98c3c-9d28-4d93-80fe-d01eafb34647 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:18.990152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6b740-a987-40a2-895b-0abfc95dd90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:18.990791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6b740-a987-40a2-895b-0abfc95dd90b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:18.991070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6b740-a987-40a2-895b-0abfc95dd90b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:18.991344 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6b740-a987-40a2-895b-0abfc95dd90b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:19.005728 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6b740-a987-40a2-895b-0abfc95dd90b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2ae6b740-a987-40a2-895b-0abfc95dd90b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:19.012969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:19.013910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:19.014785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:19.014785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:19.014785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:19.014785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:19.014785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:19.014785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:19.014785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:19.014785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:19.014785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:19.014785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:19.014785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:10:19.014785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:19.014785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 206/409] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:10:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:19.015945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b1b7d-1f81-48d5-8e90-048b173ac13d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:19.016219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b1b7d-1f81-48d5-8e90-048b173ac13d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:19.016495 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b1b7d-1f81-48d5-8e90-048b173ac13d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:19.018284 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 207/410] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:19.023049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b1b7d-1f81-48d5-8e90-048b173ac13d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:19.096401 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d98c3c-9d28-4d93-80fe-d01eafb34647 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:19.131737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864eeb9e-9759-40d6-a897-ed84f44c622b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:19.132759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eeb9e-9759-40d6-a897-ed84f44c622b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:19.133296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eeb9e-9759-40d6-a897-ed84f44c622b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:19.133572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eeb9e-9759-40d6-a897-ed84f44c622b None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:19.134719 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864eeb9e-9759-40d6-a897-ed84f44c622b None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:19.136132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864eeb9e-9759-40d6-a897-ed84f44c622b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:19.142607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 204/411] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:18 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:19.142607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbaab3e-a818-493f-b49e-2aef0d9ebd32 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:19.142607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbaab3e-a818-493f-b49e-2aef0d9ebd32 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:19.142607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbaab3e-a818-493f-b49e-2aef0d9ebd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:19.157593 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b1b7d-1f81-48d5-8e90-048b173ac13d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:19.159498 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-dcbaab3e-a818-493f-b49e-2aef0d9ebd32 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:19.160788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-dcbaab3e-a818-493f-b49e-2aef0d9ebd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:19.166308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:19.190119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:19.203157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c3e91-22db-4850-b8aa-566781959e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:19.204059 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c3e91-22db-4850-b8aa-566781959e08 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:19.204537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c3e91-22db-4850-b8aa-566781959e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:19.205411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c3e91-22db-4850-b8aa-566781959e08 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:19.206373 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c3e91-22db-4850-b8aa-566781959e08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:19.207293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c3e91-22db-4850-b8aa-566781959e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:19.209551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c3e91-22db-4850-b8aa-566781959e08 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:19.222142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 208/412] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:19.223114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c3e91-22db-4850-b8aa-566781959e08 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:19.238337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 205/413] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:19.239558 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbaab3e-a818-493f-b49e-2aef0d9ebd32 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:19.352810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbaab3e-a818-493f-b49e-2aef0d9ebd32 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:19.427586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479951ba-9ab8-4697-a1d3-8614499730c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:19.429719 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479951ba-9ab8-4697-a1d3-8614499730c9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:19.430242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479951ba-9ab8-4697-a1d3-8614499730c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:19.430749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479951ba-9ab8-4697-a1d3-8614499730c9 None admin] PATH_INFO: `/v3/groups/f23387f9450d4457aa1b369e5b37ec5d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:19.432116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479951ba-9ab8-4697-a1d3-8614499730c9 None admin] RBAC: Authorizing `identity:get_group(group_id=f23387f9450d4457aa1b369e5b37ec5d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:19.433788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479951ba-9ab8-4697-a1d3-8614499730c9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:19.436871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 206/414] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Sep 27 17:10:19 2022] GET /identity/v3/groups/f23387f9450d4457aa1b369e5b37ec5d => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:19.443033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479951ba-9ab8-4697-a1d3-8614499730c9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:19.448972 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c3e91-22db-4850-b8aa-566781959e08 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:19.474376 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:19.537405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a81f3-ec7a-48dc-9646-3c92fdad99fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:19.538198 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a81f3-ec7a-48dc-9646-3c92fdad99fe None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:19.538403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a81f3-ec7a-48dc-9646-3c92fdad99fe None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:19.538662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a81f3-ec7a-48dc-9646-3c92fdad99fe None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2/groups/c9d462221a84430887a2befb1eab3023/roles/a1b50a29e5e4419db517dfaf3d70c19f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:19.544926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a81f3-ec7a-48dc-9646-3c92fdad99fe None admin] RBAC: Authorizing `identity:create_grant(project_id=3bad3b24197d4b3b8d9880cb3f4241e2, group_id=c9d462221a84430887a2befb1eab3023, role_id=a1b50a29e5e4419db517dfaf3d70c19f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:19.546926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a81f3-ec7a-48dc-9646-3c92fdad99fe None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:19.561925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479951ba-9ab8-4697-a1d3-8614499730c9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:19.569605 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 209/415] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Sep 27 17:10:19 2022] PUT /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2/groups/c9d462221a84430887a2befb1eab3023/roles/a1b50a29e5e4419db517dfaf3d70c19f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:10:19.577712 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a81f3-ec7a-48dc-9646-3c92fdad99fe None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:19.643187 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cb686-2e83-4985-9567-fa0fb361d510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:19.645586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cb686-2e83-4985-9567-fa0fb361d510 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:19.645900 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cb686-2e83-4985-9567-fa0fb361d510 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:19.646179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cb686-2e83-4985-9567-fa0fb361d510 None admin] PATH_INFO: `/v3/projects/0f246d966d6f4376a724440b0dff9304` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:19.646558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:19.649843 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2cb686-2e83-4985-9567-fa0fb361d510 None admin] RBAC: Authorizing `identity:get_project(project_id=0f246d966d6f4376a724440b0dff9304)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:19.651386 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2cb686-2e83-4985-9567-fa0fb361d510 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:19.659345 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 207/416] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:19 2022] GET /identity/v3/projects/0f246d966d6f4376a724440b0dff9304 => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:19.662618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cb686-2e83-4985-9567-fa0fb361d510 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:19.802608 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a81f3-ec7a-48dc-9646-3c92fdad99fe None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:19.811928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:19.823190 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cb686-2e83-4985-9567-fa0fb361d510 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:19.844447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f1d0b-2483-4aa4-b155-d7511f1f4fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:19.845801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f1d0b-2483-4aa4-b155-d7511f1f4fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:19.846307 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f1d0b-2483-4aa4-b155-d7511f1f4fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:19.847309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f1d0b-2483-4aa4-b155-d7511f1f4fc2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:19.861584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f1d0b-2483-4aa4-b155-d7511f1f4fc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:19.863562 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdb40a-045d-48b7-ba88-f3556857c19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:19.864712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdb40a-045d-48b7-ba88-f3556857c19f None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:19.865000 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdb40a-045d-48b7-ba88-f3556857c19f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:19.865277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdb40a-045d-48b7-ba88-f3556857c19f None admin] PATH_INFO: `/v3/projects/0f246d966d6f4376a724440b0dff9304/groups/f23387f9450d4457aa1b369e5b37ec5d/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:19.867269 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdb40a-045d-48b7-ba88-f3556857c19f None admin] RBAC: Authorizing `identity:create_grant(project_id=0f246d966d6f4376a724440b0dff9304, group_id=f23387f9450d4457aa1b369e5b37ec5d, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:19.868710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdb40a-045d-48b7-ba88-f3556857c19f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-299f1d0b-2483-4aa4-b155-d7511f1f4fc2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:19.869055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:19.869923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:19.870761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:19.870761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:19.870761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:19.870761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:19.870761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:19.870761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:19.870761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:19.870761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:19.870761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:19.870761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:19.870761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:19.870761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:19.873655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 210/417] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:19.880263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f1d0b-2483-4aa4-b155-d7511f1f4fc2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:19.888899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 208/418] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Sep 27 17:10:19 2022] PUT /identity/v3/projects/0f246d966d6f4376a724440b0dff9304/groups/f23387f9450d4457aa1b369e5b37ec5d/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:10:19.913829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007270ae-195b-4a25-a252-1080b4ada89c None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:19.914380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007270ae-195b-4a25-a252-1080b4ada89c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:19.914658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007270ae-195b-4a25-a252-1080b4ada89c None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:19.916175 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 209/419] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:10:19.923250 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67311-09b6-47e9-b2b6-bf9af79c938c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:19.923531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67311-09b6-47e9-b2b6-bf9af79c938c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:19.923813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67311-09b6-47e9-b2b6-bf9af79c938c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:19.960810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-5ec67311-09b6-47e9-b2b6-bf9af79c938c None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:19.967042 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5ec67311-09b6-47e9-b2b6-bf9af79c938c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:20.038828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:20.057069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f1d0b-2483-4aa4-b155-d7511f1f4fc2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:20.110319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 210/420] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:20.124476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df83c5a-f7b2-4e88-9e86-56669e49dbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:20.125302 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df83c5a-f7b2-4e88-9e86-56669e49dbcc None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:20.125705 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df83c5a-f7b2-4e88-9e86-56669e49dbcc None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:20.126226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df83c5a-f7b2-4e88-9e86-56669e49dbcc None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:20.127037 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df83c5a-f7b2-4e88-9e86-56669e49dbcc None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:20.127444 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df83c5a-f7b2-4e88-9e86-56669e49dbcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:20.128966 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df83c5a-f7b2-4e88-9e86-56669e49dbcc None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:20.140415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 211/421] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:10:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:20.145840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec67311-09b6-47e9-b2b6-bf9af79c938c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:20.246714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:20.272038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec67311-09b6-47e9-b2b6-bf9af79c938c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:20.313603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1096ba3-025b-4777-bd10-1556f6c26c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:20.314307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1096ba3-025b-4777-bd10-1556f6c26c53 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:20.314702 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1096ba3-025b-4777-bd10-1556f6c26c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:20.315074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1096ba3-025b-4777-bd10-1556f6c26c53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:20.393136 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1096ba3-025b-4777-bd10-1556f6c26c53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:20.394653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1096ba3-025b-4777-bd10-1556f6c26c53 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:20.497820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:20.524336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 211/422] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 17:10:20.529932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df83c5a-f7b2-4e88-9e86-56669e49dbcc None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:20.574556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1096ba3-025b-4777-bd10-1556f6c26c53 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:20.708676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1096ba3-025b-4777-bd10-1556f6c26c53 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:20.727434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df83c5a-f7b2-4e88-9e86-56669e49dbcc None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:20.771581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeb0ee-1e50-4df1-b366-e972c5e3c90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:20.772228 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeb0ee-1e50-4df1-b366-e972c5e3c90f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:20.772507 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeb0ee-1e50-4df1-b366-e972c5e3c90f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:20.772778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeb0ee-1e50-4df1-b366-e972c5e3c90f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:20.798747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daeb0ee-1e50-4df1-b366-e972c5e3c90f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:20.798957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0724aa6-fcf9-48ce-be80-98522bc35551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:20.799434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0724aa6-fcf9-48ce-be80-98522bc35551 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:20.799716 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0724aa6-fcf9-48ce-be80-98522bc35551 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:20.799990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0724aa6-fcf9-48ce-be80-98522bc35551 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:20.801137 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0724aa6-fcf9-48ce-be80-98522bc35551 None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:20.802617 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0724aa6-fcf9-48ce-be80-98522bc35551 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:20.804638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 212/423] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:20 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-8daeb0ee-1e50-4df1-b366-e972c5e3c90f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:20.805711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:20.806580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:20.807425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:20.807425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:20.807425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:20.807425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:20.807425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:20.807425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:20.807425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:20.807425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:20.807425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:20.807425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:20.807425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:10:20.807425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:20.814879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 212/424] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:10:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:20.815604 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0724aa6-fcf9-48ce-be80-98522bc35551 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:20.823883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeb0ee-1e50-4df1-b366-e972c5e3c90f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:20.862499 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:20.894237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:20.977146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeb0ee-1e50-4df1-b366-e972c5e3c90f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:20.977782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0724aa6-fcf9-48ce-be80-98522bc35551 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:21.017343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1f8df-9a02-4fd9-96b5-edcbfa4aa28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:21.018007 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1f8df-9a02-4fd9-96b5-edcbfa4aa28b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:21.018292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1f8df-9a02-4fd9-96b5-edcbfa4aa28b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:21.018569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1f8df-9a02-4fd9-96b5-edcbfa4aa28b None admin] PATH_INFO: `/v3/groups/c9d462221a84430887a2befb1eab3023` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:21.019547 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2611d-20e0-418c-878c-b150cd53f181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:21.019690 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1f8df-9a02-4fd9-96b5-edcbfa4aa28b None admin] RBAC: Authorizing `identity:get_group(group_id=c9d462221a84430887a2befb1eab3023)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:21.020435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2611d-20e0-418c-878c-b150cd53f181 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:21.020861 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2611d-20e0-418c-878c-b150cd53f181 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:21.021153 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1f8df-9a02-4fd9-96b5-edcbfa4aa28b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:21.021433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2611d-20e0-418c-878c-b150cd53f181 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:21.022268 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2611d-20e0-418c-878c-b150cd53f181 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:21.022733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2611d-20e0-418c-878c-b150cd53f181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:21.027654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 213/425] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Sep 27 17:10:20 2022] GET /identity/v3/groups/c9d462221a84430887a2befb1eab3023 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:21.027654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae42c9-b5c1-44b0-902c-837d6fc60aa6 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:21.027654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae42c9-b5c1-44b0-902c-837d6fc60aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:21.027654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae42c9-b5c1-44b0-902c-837d6fc60aa6 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:21.029252 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2611d-20e0-418c-878c-b150cd53f181 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:21.029820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 214/426] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:21.031346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae42c9-b5c1-44b0-902c-837d6fc60aa6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:21.043340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 213/427] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:21.045547 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa003b-9298-47b2-99ca-0e192e98a936 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:21.046806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa003b-9298-47b2-99ca-0e192e98a936 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:21.047434 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa003b-9298-47b2-99ca-0e192e98a936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:21.069661 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-66fa003b-9298-47b2-99ca-0e192e98a936 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:21.070884 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-66fa003b-9298-47b2-99ca-0e192e98a936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:21.147243 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 214/428] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:21.148240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa003b-9298-47b2-99ca-0e192e98a936 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:21.161641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:21.189547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae42c9-b5c1-44b0-902c-837d6fc60aa6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:21.211960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:21.252509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3dc58-cc3f-435d-abb7-7675e51b1a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:21.253185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3dc58-cc3f-435d-abb7-7675e51b1a3a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:21.253472 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3dc58-cc3f-435d-abb7-7675e51b1a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:21.253770 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3dc58-cc3f-435d-abb7-7675e51b1a3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:21.254553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3dc58-cc3f-435d-abb7-7675e51b1a3a None admin] RBAC: Adding query filter params (group.id=c9d462221a84430887a2befb1eab3023, role.id=1c0bdbdf6a98487cac86e3de530b11d2, scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:21.254865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3dc58-cc3f-435d-abb7-7675e51b1a3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:21.256292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3dc58-cc3f-435d-abb7-7675e51b1a3a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:21.268477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 215/429] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Sep 27 17:10:21 2022] GET /identity/v3/role_assignments?group.id=c9d462221a84430887a2befb1eab3023&scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f&role.id=1c0bdbdf6a98487cac86e3de530b11d2 => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:21.312677 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa003b-9298-47b2-99ca-0e192e98a936 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:21.351691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c0273-63ef-46fb-9cc5-010d20143373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:21.352701 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c0273-63ef-46fb-9cc5-010d20143373 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:21.353193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c0273-63ef-46fb-9cc5-010d20143373 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:21.353716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c0273-63ef-46fb-9cc5-010d20143373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:21.429837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c0273-63ef-46fb-9cc5-010d20143373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:21.431613 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c0273-63ef-46fb-9cc5-010d20143373 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:21.447127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3dc58-cc3f-435d-abb7-7675e51b1a3a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:21.470210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:21.578440 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 215/430] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:21.579045 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3dc58-cc3f-435d-abb7-7675e51b1a3a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:21.586236 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c0273-63ef-46fb-9cc5-010d20143373 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:21.629203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c00a4-40a8-4199-bdea-241d8d0a527f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:21.630666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c00a4-40a8-4199-bdea-241d8d0a527f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:21.631145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c00a4-40a8-4199-bdea-241d8d0a527f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:21.632626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c00a4-40a8-4199-bdea-241d8d0a527f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:21.648343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c00a4-40a8-4199-bdea-241d8d0a527f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1e4c00a4-40a8-4199-bdea-241d8d0a527f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:21.653620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:21.654529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:21.658387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:21.658387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:21.658387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:21.658387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:21.658387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:21.658387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:21.658387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:21.658387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:21.658387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:21.658387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:21.658387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 27 17:10:21.658387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:21.658387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 216/431] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:21.665600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c00a4-40a8-4199-bdea-241d8d0a527f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:21.682332 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:21.723094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c0273-63ef-46fb-9cc5-010d20143373 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:21.758836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30ca87-d3ec-4afd-bc5b-2c4bcfb976e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:21.759472 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30ca87-d3ec-4afd-bc5b-2c4bcfb976e7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:21.759753 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30ca87-d3ec-4afd-bc5b-2c4bcfb976e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:21.760024 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30ca87-d3ec-4afd-bc5b-2c4bcfb976e7 None admin] PATH_INFO: `/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:21.761279 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30ca87-d3ec-4afd-bc5b-2c4bcfb976e7 None admin] RBAC: Authorizing `identity:get_project(project_id=3cc6dacdc31040ed891cfd9be2b4ef8f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:21.762614 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30ca87-d3ec-4afd-bc5b-2c4bcfb976e7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:21.765323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 216/432] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:21 2022] GET /identity/v3/projects/3cc6dacdc31040ed891cfd9be2b4ef8f => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:21.770787 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30ca87-d3ec-4afd-bc5b-2c4bcfb976e7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:21.775315 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:21.791749 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c00a4-40a8-4199-bdea-241d8d0a527f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:21.830494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a38d1-7135-4b06-91d0-1cee21b0d7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:21.831473 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a38d1-7135-4b06-91d0-1cee21b0d7be None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:21.832015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a38d1-7135-4b06-91d0-1cee21b0d7be None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:21.832480 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a38d1-7135-4b06-91d0-1cee21b0d7be None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:21.833344 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a38d1-7135-4b06-91d0-1cee21b0d7be None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:21.833961 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a38d1-7135-4b06-91d0-1cee21b0d7be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:21.836068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a38d1-7135-4b06-91d0-1cee21b0d7be None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:21.849865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 217/433] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:10:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:21.852110 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a38d1-7135-4b06-91d0-1cee21b0d7be None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:21.881818 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30ca87-d3ec-4afd-bc5b-2c4bcfb976e7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:21.919541 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd5348-6b1c-498b-8ea5-3819dd42d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:21.920178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd5348-6b1c-498b-8ea5-3819dd42d421 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:21.920508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd5348-6b1c-498b-8ea5-3819dd42d421 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:21.921452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd5348-6b1c-498b-8ea5-3819dd42d421 None admin] PATH_INFO: `/v3/groups/c9d462221a84430887a2befb1eab3023` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:21.922975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd5348-6b1c-498b-8ea5-3819dd42d421 None admin] RBAC: Authorizing `identity:get_group(group_id=c9d462221a84430887a2befb1eab3023)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:21.925180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd5348-6b1c-498b-8ea5-3819dd42d421 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:21.926806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 217/434] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Sep 27 17:10:21 2022] GET /identity/v3/groups/c9d462221a84430887a2befb1eab3023 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:21.933316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:21.934566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd5348-6b1c-498b-8ea5-3819dd42d421 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:21.970736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a38d1-7135-4b06-91d0-1cee21b0d7be None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:22.010802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2f82e-a754-4ec7-a140-0f16c369f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:22.011798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2f82e-a754-4ec7-a140-0f16c369f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:22.012358 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2f82e-a754-4ec7-a140-0f16c369f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:22.012922 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2f82e-a754-4ec7-a140-0f16c369f4a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:22.025932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:22.065932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd5348-6b1c-498b-8ea5-3819dd42d421 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:22.095996 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2f82e-a754-4ec7-a140-0f16c369f4a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:22.097971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2f82e-a754-4ec7-a140-0f16c369f4a0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:22.104620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd0eee-61f3-42c1-8f2b-4e12358937ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:22.105236 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd0eee-61f3-42c1-8f2b-4e12358937ea None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:22.105517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd0eee-61f3-42c1-8f2b-4e12358937ea None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:22.105840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd0eee-61f3-42c1-8f2b-4e12358937ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:22.106572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd0eee-61f3-42c1-8f2b-4e12358937ea None admin] RBAC: Adding query filter params (group.id=c9d462221a84430887a2befb1eab3023, role.id=a1b50a29e5e4419db517dfaf3d70c19f, scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:22.106882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd0eee-61f3-42c1-8f2b-4e12358937ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:22.109114 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd0eee-61f3-42c1-8f2b-4e12358937ea None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:22.115484 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 218/435] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Sep 27 17:10:21 2022] GET /identity/v3/role_assignments?group.id=c9d462221a84430887a2befb1eab3023&scope.project.id=3cc6dacdc31040ed891cfd9be2b4ef8f&role.id=a1b50a29e5e4419db517dfaf3d70c19f => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:22.184127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:22.227213 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 218/436] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:22.229345 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd0eee-61f3-42c1-8f2b-4e12358937ea None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:22.364867 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd0eee-61f3-42c1-8f2b-4e12358937ea None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:22.384020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d38997-2b05-48c0-a452-5e30f0320827 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:22.384333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d38997-2b05-48c0-a452-5e30f0320827 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:22.384571 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d38997-2b05-48c0-a452-5e30f0320827 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:22.385935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 219/437] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:22.391196 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae1cb6-1d9e-4e74-86a1-2b60d8a41635 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:22.391479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae1cb6-1d9e-4e74-86a1-2b60d8a41635 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:22.391756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae1cb6-1d9e-4e74-86a1-2b60d8a41635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:22.413574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1beec23-5198-4da8-a9d0-fc23902a4e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:22.414281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1beec23-5198-4da8-a9d0-fc23902a4e1f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:22.414564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1beec23-5198-4da8-a9d0-fc23902a4e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:22.414837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1beec23-5198-4da8-a9d0-fc23902a4e1f None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:22.415989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1beec23-5198-4da8-a9d0-fc23902a4e1f None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:22.417415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1beec23-5198-4da8-a9d0-fc23902a4e1f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:22.421838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 219/438] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:22 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:22.423144 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-40ae1cb6-1d9e-4e74-86a1-2b60d8a41635 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:22.424523 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-40ae1cb6-1d9e-4e74-86a1-2b60d8a41635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:22.425703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1beec23-5198-4da8-a9d0-fc23902a4e1f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:22.428657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:22.520686 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 220/439] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:22.522271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbcff1-f835-4a15-9ea9-b541eeb4725f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:22.522730 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbcff1-f835-4a15-9ea9-b541eeb4725f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:22.523184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbcff1-f835-4a15-9ea9-b541eeb4725f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:22.524678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 221/440] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:22.530110 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88f3a1-302b-4f40-8d5d-e82241bc7084 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:22.530541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88f3a1-302b-4f40-8d5d-e82241bc7084 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:22.530698 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88f3a1-302b-4f40-8d5d-e82241bc7084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:22.552941 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9e88f3a1-302b-4f40-8d5d-e82241bc7084 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:22.553942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1beec23-5198-4da8-a9d0-fc23902a4e1f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:22.554176 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9e88f3a1-302b-4f40-8d5d-e82241bc7084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:22.596278 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51f202-0800-49e5-9418-a1643d1785ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:22.596982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51f202-0800-49e5-9418-a1643d1785ad None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:22.597383 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51f202-0800-49e5-9418-a1643d1785ad None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:22.597658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51f202-0800-49e5-9418-a1643d1785ad None admin] PATH_INFO: `/v3/groups/c9d462221a84430887a2befb1eab3023` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:22.599580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51f202-0800-49e5-9418-a1643d1785ad None admin] RBAC: Authorizing `identity:get_group(group_id=c9d462221a84430887a2befb1eab3023)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:22.601036 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51f202-0800-49e5-9418-a1643d1785ad None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:22.602807 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 220/441] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Sep 27 17:10:22 2022] GET /identity/v3/groups/c9d462221a84430887a2befb1eab3023 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:22.609109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51f202-0800-49e5-9418-a1643d1785ad None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:22.645711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 222/442] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:10:22.693549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:22.726839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51f202-0800-49e5-9418-a1643d1785ad None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:22.760471 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def34fa4-7dc9-48a0-9c14-de430633c892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:22.761079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def34fa4-7dc9-48a0-9c14-de430633c892 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:22.761359 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def34fa4-7dc9-48a0-9c14-de430633c892 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:22.761634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def34fa4-7dc9-48a0-9c14-de430633c892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:22.762378 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def34fa4-7dc9-48a0-9c14-de430633c892 None admin] RBAC: Adding query filter params (group.id=c9d462221a84430887a2befb1eab3023, role.id=1c0bdbdf6a98487cac86e3de530b11d2, scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:22.762742 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def34fa4-7dc9-48a0-9c14-de430633c892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:22.764204 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def34fa4-7dc9-48a0-9c14-de430633c892 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:22.774045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 221/443] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Sep 27 17:10:22 2022] GET /identity/v3/role_assignments?group.id=c9d462221a84430887a2befb1eab3023&scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2&role.id=1c0bdbdf6a98487cac86e3de530b11d2 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:22.794559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88f3a1-302b-4f40-8d5d-e82241bc7084 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:22.826582 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:22.899850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88f3a1-302b-4f40-8d5d-e82241bc7084 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:22.919985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def34fa4-7dc9-48a0-9c14-de430633c892 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:22.943039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d43c-f01a-4c93-84a8-15c3070baba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:22.943809 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d43c-f01a-4c93-84a8-15c3070baba9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:22.943974 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d43c-f01a-4c93-84a8-15c3070baba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:22.944219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d43c-f01a-4c93-84a8-15c3070baba9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:22.956417 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5d43c-f01a-4c93-84a8-15c3070baba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1cb5d43c-f01a-4c93-84a8-15c3070baba9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:22.961750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:22.962659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:22.963455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:22.963455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:22.963455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:22.963455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:22.963455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:22.963455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:22.963455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:22.963455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:22.963455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:22.963455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:22.963455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:10:22.963455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:22.964063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 223/444] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:10:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:22.970475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d43c-f01a-4c93-84a8-15c3070baba9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:23.041213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def34fa4-7dc9-48a0-9c14-de430633c892 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:23.072556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:23.082266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d43c-f01a-4c93-84a8-15c3070baba9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:23.083106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f2a69-5a58-4831-bf0e-e587f48be883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:23.083749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f2a69-5a58-4831-bf0e-e587f48be883 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:23.084037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f2a69-5a58-4831-bf0e-e587f48be883 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:23.084317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f2a69-5a58-4831-bf0e-e587f48be883 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:23.086530 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:23.097581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f2a69-5a58-4831-bf0e-e587f48be883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-084f2a69-5a58-4831-bf0e-e587f48be883 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:23.103352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:23.104292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:23.105251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:23.105251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:23.105251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:23.105251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:23.105251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:23.105251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:23.105251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:23.105251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:23.105251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:23.105251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:23.105251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:10:23.105251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:23.105251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 222/445] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:10:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:23.111367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f2a69-5a58-4831-bf0e-e587f48be883 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:23.126277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deca6f5-2149-4e4f-ad2a-263c8a8013ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:23.126919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deca6f5-2149-4e4f-ad2a-263c8a8013ec None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:23.127192 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deca6f5-2149-4e4f-ad2a-263c8a8013ec None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:23.127459 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deca6f5-2149-4e4f-ad2a-263c8a8013ec None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:23.128291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deca6f5-2149-4e4f-ad2a-263c8a8013ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:23.128987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deca6f5-2149-4e4f-ad2a-263c8a8013ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:23.130380 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deca6f5-2149-4e4f-ad2a-263c8a8013ec None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:23.138990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 224/446] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:23.145636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deca6f5-2149-4e4f-ad2a-263c8a8013ec None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:23.221858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f2a69-5a58-4831-bf0e-e587f48be883 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:23.250357 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deca6f5-2149-4e4f-ad2a-263c8a8013ec None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:23.254202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f737990-6d6c-4c30-a22f-d1dc11d589a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:23.254811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f737990-6d6c-4c30-a22f-d1dc11d589a0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:23.255090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f737990-6d6c-4c30-a22f-d1dc11d589a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:23.255362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f737990-6d6c-4c30-a22f-d1dc11d589a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:23.256019 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f737990-6d6c-4c30-a22f-d1dc11d589a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:23.256323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f737990-6d6c-4c30-a22f-d1dc11d589a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:23.257745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f737990-6d6c-4c30-a22f-d1dc11d589a0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:23.266819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 223/447] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:23.272464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f737990-6d6c-4c30-a22f-d1dc11d589a0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:23.284215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd6bc5-ce65-480c-b194-f682e21a2213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:23.284812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd6bc5-ce65-480c-b194-f682e21a2213 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:23.285085 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd6bc5-ce65-480c-b194-f682e21a2213 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:23.285351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd6bc5-ce65-480c-b194-f682e21a2213 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:23.308840 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:23.329164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:23.354261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd6bc5-ce65-480c-b194-f682e21a2213 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:23.355705 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd6bc5-ce65-480c-b194-f682e21a2213 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:23.372669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f737990-6d6c-4c30-a22f-d1dc11d589a0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:23.406045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe57413-f5ff-4e66-9095-39c6c12256cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:23.406645 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe57413-f5ff-4e66-9095-39c6c12256cf None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:23.406918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe57413-f5ff-4e66-9095-39c6c12256cf None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:23.407183 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe57413-f5ff-4e66-9095-39c6c12256cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:23.455404 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 225/448] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:23.461206 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd6bc5-ce65-480c-b194-f682e21a2213 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:23.473343 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe57413-f5ff-4e66-9095-39c6c12256cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:23.474867 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe57413-f5ff-4e66-9095-39c6c12256cf None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:23.515350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:23.529272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:23.557867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd6bc5-ce65-480c-b194-f682e21a2213 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:23.574475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 224/449] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 17:10:23.580737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe57413-f5ff-4e66-9095-39c6c12256cf None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:23.592229 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1045078-4d35-428d-8295-8f5e6d28e022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:23.593210 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1045078-4d35-428d-8295-8f5e6d28e022 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:23.593493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1045078-4d35-428d-8295-8f5e6d28e022 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:23.593801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1045078-4d35-428d-8295-8f5e6d28e022 None admin] PATH_INFO: `/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:23.594939 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1045078-4d35-428d-8295-8f5e6d28e022 None admin] RBAC: Authorizing `identity:get_project(project_id=3bad3b24197d4b3b8d9880cb3f4241e2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:23.596446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1045078-4d35-428d-8295-8f5e6d28e022 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:23.598095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 226/450] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:23 2022] GET /identity/v3/projects/3bad3b24197d4b3b8d9880cb3f4241e2 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:23.603412 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1045078-4d35-428d-8295-8f5e6d28e022 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:23.678459 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe57413-f5ff-4e66-9095-39c6c12256cf None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:23.702682 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1045078-4d35-428d-8295-8f5e6d28e022 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:23.711557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b49a6-387c-4f5f-b02e-669ed7296fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:23.712182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b49a6-387c-4f5f-b02e-669ed7296fac None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:23.712454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b49a6-387c-4f5f-b02e-669ed7296fac None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:23.712719 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b49a6-387c-4f5f-b02e-669ed7296fac None admin] PATH_INFO: `/v3/projects/0f246d966d6f4376a724440b0dff9304` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:23.713844 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b49a6-387c-4f5f-b02e-669ed7296fac None admin] RBAC: Authorizing `identity:get_project(project_id=0f246d966d6f4376a724440b0dff9304)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:23.715277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b49a6-387c-4f5f-b02e-669ed7296fac None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:23.716868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 225/451] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:10:23 2022] GET /identity/v3/projects/0f246d966d6f4376a724440b0dff9304 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:23.722329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b49a6-387c-4f5f-b02e-669ed7296fac None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:23.725319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:23.737701 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d4f82-9576-447e-94ac-7a9359eb4960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:23.738330 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d4f82-9576-447e-94ac-7a9359eb4960 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:23.738608 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d4f82-9576-447e-94ac-7a9359eb4960 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:23.738881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d4f82-9576-447e-94ac-7a9359eb4960 None admin] PATH_INFO: `/v3/groups/c9d462221a84430887a2befb1eab3023` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:23.739985 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d4f82-9576-447e-94ac-7a9359eb4960 None admin] RBAC: Authorizing `identity:get_group(group_id=c9d462221a84430887a2befb1eab3023)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:23.741428 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d4f82-9576-447e-94ac-7a9359eb4960 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:23.743090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 227/452] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Sep 27 17:10:23 2022] GET /identity/v3/groups/c9d462221a84430887a2befb1eab3023 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:23.746827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:23.749564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d4f82-9576-447e-94ac-7a9359eb4960 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:23.821006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b49a6-387c-4f5f-b02e-669ed7296fac None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:23.847228 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d4f82-9576-447e-94ac-7a9359eb4960 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:23.853780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbf7e1-acff-49ee-88f8-ce57e9852a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:23.854409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbf7e1-acff-49ee-88f8-ce57e9852a09 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:23.854688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbf7e1-acff-49ee-88f8-ce57e9852a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:23.854959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbf7e1-acff-49ee-88f8-ce57e9852a09 None admin] PATH_INFO: `/v3/groups/f23387f9450d4457aa1b369e5b37ec5d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:23.856061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbf7e1-acff-49ee-88f8-ce57e9852a09 None admin] RBAC: Authorizing `identity:get_group(group_id=f23387f9450d4457aa1b369e5b37ec5d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:23.857480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbf7e1-acff-49ee-88f8-ce57e9852a09 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:23.859103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 226/453] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Sep 27 17:10:23 2022] GET /identity/v3/groups/f23387f9450d4457aa1b369e5b37ec5d => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:23.864922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbf7e1-acff-49ee-88f8-ce57e9852a09 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:23.880303 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2882d-921b-4832-9cb1-ecc6bf37f584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:23.880902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2882d-921b-4832-9cb1-ecc6bf37f584 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:23.881183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2882d-921b-4832-9cb1-ecc6bf37f584 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:23.881454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2882d-921b-4832-9cb1-ecc6bf37f584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:23.882203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2882d-921b-4832-9cb1-ecc6bf37f584 None admin] RBAC: Adding query filter params (group.id=c9d462221a84430887a2befb1eab3023, role.id=a1b50a29e5e4419db517dfaf3d70c19f, scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:23.882510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2882d-921b-4832-9cb1-ecc6bf37f584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:23.883927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2882d-921b-4832-9cb1-ecc6bf37f584 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:23.890578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 228/454] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Sep 27 17:10:23 2022] GET /identity/v3/role_assignments?group.id=c9d462221a84430887a2befb1eab3023&scope.project.id=3bad3b24197d4b3b8d9880cb3f4241e2&role.id=a1b50a29e5e4419db517dfaf3d70c19f => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:23.960094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:23.970323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbf7e1-acff-49ee-88f8-ce57e9852a09 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:24.005056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207fce9-a969-44de-ace6-fd8d99587728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:24.005589 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207fce9-a969-44de-ace6-fd8d99587728 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:24.005907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207fce9-a969-44de-ace6-fd8d99587728 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:24.006180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207fce9-a969-44de-ace6-fd8d99587728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:24.006916 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207fce9-a969-44de-ace6-fd8d99587728 None admin] RBAC: Adding query filter params (group.id=f23387f9450d4457aa1b369e5b37ec5d, role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=0f246d966d6f4376a724440b0dff9304) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:24.007228 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207fce9-a969-44de-ace6-fd8d99587728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:24.008668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207fce9-a969-44de-ace6-fd8d99587728 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:24.015727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 227/455] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Sep 27 17:10:23 2022] GET /identity/v3/role_assignments?group.id=f23387f9450d4457aa1b369e5b37ec5d&scope.project.id=0f246d966d6f4376a724440b0dff9304&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:26.607936 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4ce70-7f61-4b17-90e6-724ef17ee096 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:26.608951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4ce70-7f61-4b17-90e6-724ef17ee096 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:26.609426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4ce70-7f61-4b17-90e6-724ef17ee096 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:26.611425 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 229/456] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:26.617067 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574b9c8-c5e4-4d38-8a60-5a1afb5fbc27 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:26.617905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574b9c8-c5e4-4d38-8a60-5a1afb5fbc27 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:26.618373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574b9c8-c5e4-4d38-8a60-5a1afb5fbc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:26.643953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-3574b9c8-c5e4-4d38-8a60-5a1afb5fbc27 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:26.645473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3574b9c8-c5e4-4d38-8a60-5a1afb5fbc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:26.739300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 228/457] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:10:27.047903 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e475ae8-ebd7-4b68-8a5c-f5deef378818 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:27.048239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e475ae8-ebd7-4b68-8a5c-f5deef378818 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:27.048453 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e475ae8-ebd7-4b68-8a5c-f5deef378818 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:27.051588 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 230/458] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:10:27.056938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fd9a8-85e8-4156-a21c-0b97955b2bab None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:27.057454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fd9a8-85e8-4156-a21c-0b97955b2bab None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:27.058003 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fd9a8-85e8-4156-a21c-0b97955b2bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:27.083206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-830fd9a8-85e8-4156-a21c-0b97955b2bab None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:27.085085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-830fd9a8-85e8-4156-a21c-0b97955b2bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:27.176086 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 229/459] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:27.232334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e475ae8-ebd7-4b68-8a5c-f5deef378818 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:27.274319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e624-2956-4750-b29b-d8058c5b8516 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:27.275106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e624-2956-4750-b29b-d8058c5b8516 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:27.276948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e624-2956-4750-b29b-d8058c5b8516 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:27.278957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 230/460] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:10:27.285652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a1844-8998-4646-9b88-31b79c1209e5 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:27.286021 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a1844-8998-4646-9b88-31b79c1209e5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:27.286266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a1844-8998-4646-9b88-31b79c1209e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:27.322577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-946a1844-8998-4646-9b88-31b79c1209e5 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:27.324081 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-946a1844-8998-4646-9b88-31b79c1209e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:27.346051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:27.356966 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:27.440119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e475ae8-ebd7-4b68-8a5c-f5deef378818 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:27.456832 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 231/461] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:10:27.458205 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d08a6-f851-45fb-8d3d-a6259b402cfc None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:27.458488 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d08a6-f851-45fb-8d3d-a6259b402cfc None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:27.458757 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d08a6-f851-45fb-8d3d-a6259b402cfc None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:27.460257 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 232/462] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:27.470677 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833835-5fb1-42b4-99b9-4639d1107702 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:27.470677 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833835-5fb1-42b4-99b9-4639d1107702 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:27.470677 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833835-5fb1-42b4-99b9-4639d1107702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:27.507045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-49833835-5fb1-42b4-99b9-4639d1107702 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:27.508306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-49833835-5fb1-42b4-99b9-4639d1107702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:27.524239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71605a3e-ef06-42b0-b55b-58bd06810c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:27.524986 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71605a3e-ef06-42b0-b55b-58bd06810c20 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:27.525263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71605a3e-ef06-42b0-b55b-58bd06810c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:27.525585 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71605a3e-ef06-42b0-b55b-58bd06810c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:27.538832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71605a3e-ef06-42b0-b55b-58bd06810c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:27.540360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71605a3e-ef06-42b0-b55b-58bd06810c20 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-71605a3e-ef06-42b0-b55b-58bd06810c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:27.558452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:27.559415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:27.560272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:27.560272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:27.560272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:27.560272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 231/463] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:27.561232 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71605a3e-ef06-42b0-b55b-58bd06810c20 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:27.599678 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 233/464] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:27.600602 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49833835-5fb1-42b4-99b9-4639d1107702 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:27.765925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71605a3e-ef06-42b0-b55b-58bd06810c20 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:27.773566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:27.776314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:27.801529 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49833835-5fb1-42b4-99b9-4639d1107702 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:27.805327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8c63b-8bb8-4e10-967b-6cc90d4b93d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:27.806357 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c63b-8bb8-4e10-967b-6cc90d4b93d4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:27.806785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c63b-8bb8-4e10-967b-6cc90d4b93d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:27.807201 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c63b-8bb8-4e10-967b-6cc90d4b93d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:27.821227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8c63b-8bb8-4e10-967b-6cc90d4b93d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:27.822727 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8c63b-8bb8-4e10-967b-6cc90d4b93d4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-d5d8c63b-8bb8-4e10-967b-6cc90d4b93d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:27.839759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:27.840888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:27.842091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:27.842091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:27.842091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:27.844217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 232/465] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:27.845637 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8c63b-8bb8-4e10-967b-6cc90d4b93d4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:27.867799 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d817c7-9dd7-45ce-a8ce-14c88ce96696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:27.868500 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d817c7-9dd7-45ce-a8ce-14c88ce96696 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:27.868876 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d817c7-9dd7-45ce-a8ce-14c88ce96696 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:27.869246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d817c7-9dd7-45ce-a8ce-14c88ce96696 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:27.870129 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d817c7-9dd7-45ce-a8ce-14c88ce96696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:27.870618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d817c7-9dd7-45ce-a8ce-14c88ce96696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:27.872716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d817c7-9dd7-45ce-a8ce-14c88ce96696 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:27.899293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 234/466] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:27.900361 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d817c7-9dd7-45ce-a8ce-14c88ce96696 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:27.992930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8c63b-8bb8-4e10-967b-6cc90d4b93d4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:28.027915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d817c7-9dd7-45ce-a8ce-14c88ce96696 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:28.040969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e33a42-f859-41f6-aa48-c05323ada391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:28.041616 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e33a42-f859-41f6-aa48-c05323ada391 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:28.041932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e33a42-f859-41f6-aa48-c05323ada391 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:28.042231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e33a42-f859-41f6-aa48-c05323ada391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:28.055682 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e33a42-f859-41f6-aa48-c05323ada391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:28.057436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e33a42-f859-41f6-aa48-c05323ada391 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:28.067516 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a069a-ce10-4984-8072-a2f8a3ff0973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:28.068691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a069a-ce10-4984-8072-a2f8a3ff0973 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:28.069023 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a069a-ce10-4984-8072-a2f8a3ff0973 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:28.069567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a069a-ce10-4984-8072-a2f8a3ff0973 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:28.070283 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a069a-ce10-4984-8072-a2f8a3ff0973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:28.070600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a069a-ce10-4984-8072-a2f8a3ff0973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:28.072059 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a069a-ce10-4984-8072-a2f8a3ff0973 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c4e33a42-f859-41f6-aa48-c05323ada391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:28.074496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:28.075400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:28.076451 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:28.076451 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:28.076451 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:28.076451 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 233/467] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:28.082707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e33a42-f859-41f6-aa48-c05323ada391 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:28.083879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:28.091995 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 235/468] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:28.095584 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a069a-ce10-4984-8072-a2f8a3ff0973 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:28.101287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:28.197972 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e33a42-f859-41f6-aa48-c05323ada391 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:28.225094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a069a-ce10-4984-8072-a2f8a3ff0973 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:28.231152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc83539-60aa-4b36-aea8-a96db87bb85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:28.231754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc83539-60aa-4b36-aea8-a96db87bb85c None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:28.232045 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc83539-60aa-4b36-aea8-a96db87bb85c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:28.232323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc83539-60aa-4b36-aea8-a96db87bb85c None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:28.233056 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc83539-60aa-4b36-aea8-a96db87bb85c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:28.234522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc83539-60aa-4b36-aea8-a96db87bb85c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:28.255734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 234/469] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:10:28 2022] POST /identity/v3/users => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:10:28.256539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc83539-60aa-4b36-aea8-a96db87bb85c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:28.258775 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f849f-cf7b-490a-8981-162b964d265b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:28.259412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f849f-cf7b-490a-8981-162b964d265b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:28.259692 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f849f-cf7b-490a-8981-162b964d265b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:28.259961 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f849f-cf7b-490a-8981-162b964d265b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:28.277202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f849f-cf7b-490a-8981-162b964d265b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:28.280155 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f849f-cf7b-490a-8981-162b964d265b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-c72f849f-cf7b-490a-8981-162b964d265b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:28.299780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:28.300755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:28.301625 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:28.301625 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:28.301625 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:28.301815 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 236/470] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:28.303657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f849f-cf7b-490a-8981-162b964d265b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:28.345087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:28.366323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:28.386259 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc83539-60aa-4b36-aea8-a96db87bb85c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:28.435817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f849f-cf7b-490a-8981-162b964d265b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:28.440722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fddad3-94c0-4b63-a39e-4ae7464a4a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:28.441340 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fddad3-94c0-4b63-a39e-4ae7464a4a37 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:28.441620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fddad3-94c0-4b63-a39e-4ae7464a4a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:28.441943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fddad3-94c0-4b63-a39e-4ae7464a4a37 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:28.442588 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fddad3-94c0-4b63-a39e-4ae7464a4a37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:28.442895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fddad3-94c0-4b63-a39e-4ae7464a4a37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:28.444538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fddad3-94c0-4b63-a39e-4ae7464a4a37 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:28.465914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 235/471] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:28.467184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7588ed-b9f9-44ae-836f-48205f28414d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:28.467617 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7588ed-b9f9-44ae-836f-48205f28414d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:28.467895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7588ed-b9f9-44ae-836f-48205f28414d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:28.469150 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 236/472] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:28.470607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7588ed-b9f9-44ae-836f-48205f28414d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:28.483321 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13662187-dcd2-43a1-8e71-3c0bc3385bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:28.484053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13662187-dcd2-43a1-8e71-3c0bc3385bef None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:28.484346 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13662187-dcd2-43a1-8e71-3c0bc3385bef None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:28.484621 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13662187-dcd2-43a1-8e71-3c0bc3385bef None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:28.485273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13662187-dcd2-43a1-8e71-3c0bc3385bef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:28.486747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13662187-dcd2-43a1-8e71-3c0bc3385bef None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:28.510099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 237/473] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:10:28 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:10:28.511227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13662187-dcd2-43a1-8e71-3c0bc3385bef None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:28.606221 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7588ed-b9f9-44ae-836f-48205f28414d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:28.644671 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c5380-2b6f-427d-b844-f40ee624149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:28.645407 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c5380-2b6f-427d-b844-f40ee624149e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:28.645809 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c5380-2b6f-427d-b844-f40ee624149e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:28.646163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c5380-2b6f-427d-b844-f40ee624149e None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:28.646896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c5380-2b6f-427d-b844-f40ee624149e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:28.647273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c5380-2b6f-427d-b844-f40ee624149e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:28.648108 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13662187-dcd2-43a1-8e71-3c0bc3385bef None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:28.648896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c5380-2b6f-427d-b844-f40ee624149e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:28.652057 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:28.659956 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:28.663338 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 237/474] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:28.668799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9462d-8a34-4d45-9b1d-94b7ad0079ae None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:28.669166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9462d-8a34-4d45-9b1d-94b7ad0079ae None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:28.669554 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9462d-8a34-4d45-9b1d-94b7ad0079ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:28.692219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-85f9462d-8a34-4d45-9b1d-94b7ad0079ae None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:28.693981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-85f9462d-8a34-4d45-9b1d-94b7ad0079ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:28.701929 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa0266-d512-4b9f-8d17-2d0981825518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:28.702683 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa0266-d512-4b9f-8d17-2d0981825518 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:28.702973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa0266-d512-4b9f-8d17-2d0981825518 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:28.703230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa0266-d512-4b9f-8d17-2d0981825518 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:28.703882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa0266-d512-4b9f-8d17-2d0981825518 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:28.705317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa0266-d512-4b9f-8d17-2d0981825518 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:28.731096 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 238/475] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:10:28 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:10:28.735215 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa0266-d512-4b9f-8d17-2d0981825518 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:28.784458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 238/476] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:28.878891 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa0266-d512-4b9f-8d17-2d0981825518 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:28.919592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea4abb-9a78-4eed-bb6c-2286e9dd7bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:28.920517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea4abb-9a78-4eed-bb6c-2286e9dd7bd2 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:28.920808 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea4abb-9a78-4eed-bb6c-2286e9dd7bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:28.921079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea4abb-9a78-4eed-bb6c-2286e9dd7bd2 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:28.921812 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea4abb-9a78-4eed-bb6c-2286e9dd7bd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:28.923294 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea4abb-9a78-4eed-bb6c-2286e9dd7bd2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:28.949460 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 239/477] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:10:28 2022] POST /identity/v3/users => generated 249 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:10:29.098572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9462d-8a34-4d45-9b1d-94b7ad0079ae None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:29.211825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9462d-8a34-4d45-9b1d-94b7ad0079ae None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:29.231307 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:29.253837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ee737-8773-4ddd-843b-a614b5ae4007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:29.254731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ee737-8773-4ddd-843b-a614b5ae4007 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:29.255180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ee737-8773-4ddd-843b-a614b5ae4007 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:29.255618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ee737-8773-4ddd-843b-a614b5ae4007 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:29.256449 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ee737-8773-4ddd-843b-a614b5ae4007 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:29.258081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ee737-8773-4ddd-843b-a614b5ae4007 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:29.270048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.sql.core [None req-658ee737-8773-4ddd-843b-a614b5ae4007 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 27 17:10:29.270048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 27 17:10:29.270048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [parameters: {'id': '2f436a95fb214223808fbaa334f61b69', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 27 17:10:29.270048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81379) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 27 17:10:29.286489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-658ee737-8773-4ddd-843b-a614b5ae4007 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 27 17:10:29.286489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:29.286489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 17:10:29.286489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 17:10:29.286489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 17:10:29.286489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 17:10:29.286489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 17:10:29.286489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 17:10:29.286489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 17:10:29.286489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application conn.query(q) Sep 27 17:10:29.286489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 17:10:29.286489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 17:10:29.286489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 17:10:29.286489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result.read() Sep 27 17:10:29.286489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return ref.to_dict() Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 17:10:29.287606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application next(self.gen) Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application yield resource Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application next(self.gen) Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.session.rollback() Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.force_reraise() Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise self.value Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application session.commit() Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 27 17:10:29.288713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._prepare_impl() Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.session.flush() Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._flush(objects) Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application compat.raise_( Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application flush_context.execute() Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rec.execute(self) Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 27 17:10:29.289823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 17:10:29.290688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application conn.query(q) Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result.read() Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 17:10:29.291563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [parameters: {'id': '2f436a95fb214223808fbaa334f61b69', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:29.292429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 27 17:10:29.293468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:29.296793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 239/478] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Sep 27 17:10:29 2022] POST /identity/v3/roles => generated 144 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:29.303009 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea4abb-9a78-4eed-bb6c-2286e9dd7bd2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:29.327552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:29.471617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea4abb-9a78-4eed-bb6c-2286e9dd7bd2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:29.516709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb048a6e-e5af-47e9-9329-40be48b769cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:29.517654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb048a6e-e5af-47e9-9329-40be48b769cb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:29.518134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb048a6e-e5af-47e9-9329-40be48b769cb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:29.518585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb048a6e-e5af-47e9-9329-40be48b769cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:29.534428 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb048a6e-e5af-47e9-9329-40be48b769cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-fb048a6e-e5af-47e9-9329-40be48b769cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:29.540015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:29.540895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:29.541883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:29.541883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:29.541883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:29.541883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:29.541883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:29.541883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:29.541883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:29.541883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:29.541883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:29.541883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:29.541883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 17:10:29.541883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:29.544122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 240/479] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:10:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:29.549823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ee737-8773-4ddd-843b-a614b5ae4007 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:29.712438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ee737-8773-4ddd-843b-a614b5ae4007 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:29.757079 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5dea1-87fa-42b3-84ef-f9a316a7c721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:29.757715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5dea1-87fa-42b3-84ef-f9a316a7c721 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:29.757987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5dea1-87fa-42b3-84ef-f9a316a7c721 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:29.758257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5dea1-87fa-42b3-84ef-f9a316a7c721 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:29.758922 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5dea1-87fa-42b3-84ef-f9a316a7c721 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:29.759227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5dea1-87fa-42b3-84ef-f9a316a7c721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:29.760619 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5dea1-87fa-42b3-84ef-f9a316a7c721 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:29.773850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 240/480] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:30.809522 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c947e8-1af4-480a-8a22-c76aa66ca6a0 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:30.810067 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c947e8-1af4-480a-8a22-c76aa66ca6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:30.810172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c947e8-1af4-480a-8a22-c76aa66ca6a0 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:30.811895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 241/481] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:30.817287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada068e1-2854-495d-9eb9-c6dc985d84f5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:30.817703 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada068e1-2854-495d-9eb9-c6dc985d84f5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:30.817892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada068e1-2854-495d-9eb9-c6dc985d84f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:30.840877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ada068e1-2854-495d-9eb9-c6dc985d84f5 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:30.842388 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ada068e1-2854-495d-9eb9-c6dc985d84f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:30.892888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:30.936717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 241/482] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:31.229282 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5062a0-de11-411d-bf2d-0e0ef3ee09f2 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:31.229653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5062a0-de11-411d-bf2d-0e0ef3ee09f2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:31.229879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5062a0-de11-411d-bf2d-0e0ef3ee09f2 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:31.231391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 242/483] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:31.240228 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a84432-df8a-4178-9300-e34cf128e697 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:31.240515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a84432-df8a-4178-9300-e34cf128e697 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:31.240792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a84432-df8a-4178-9300-e34cf128e697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:31.261654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b7a84432-df8a-4178-9300-e34cf128e697 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:31.262863 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b7a84432-df8a-4178-9300-e34cf128e697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:31.286131 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5062a0-de11-411d-bf2d-0e0ef3ee09f2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:31.352988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 242/484] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:31.432031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:31.474917 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5062a0-de11-411d-bf2d-0e0ef3ee09f2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:31.510850 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced661bf-7879-4046-ae69-cc0c5ba37fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:31.511769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced661bf-7879-4046-ae69-cc0c5ba37fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:31.512245 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced661bf-7879-4046-ae69-cc0c5ba37fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:31.512690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced661bf-7879-4046-ae69-cc0c5ba37fc4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:31.528408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced661bf-7879-4046-ae69-cc0c5ba37fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-ced661bf-7879-4046-ae69-cc0c5ba37fc4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:31.533531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:31.534454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:31.535247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:31.535247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:31.535247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:31.535247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:31.535247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:31.535247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:31.535247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:31.535247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:31.535247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:31.535247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:31.535247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:31.535247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:31.537837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 243/485] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:31.545729 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a84432-df8a-4178-9300-e34cf128e697 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:31.632066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced661bf-7879-4046-ae69-cc0c5ba37fc4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:31.696723 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a84432-df8a-4178-9300-e34cf128e697 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:31.699112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:31.764381 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c00a6-3165-46c6-ae90-b2e32ca687ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:31.765382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c00a6-3165-46c6-ae90-b2e32ca687ec None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:31.765869 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c00a6-3165-46c6-ae90-b2e32ca687ec None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:31.766309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c00a6-3165-46c6-ae90-b2e32ca687ec None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:31.767853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c00a6-3165-46c6-ae90-b2e32ca687ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:31.769425 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c00a6-3165-46c6-ae90-b2e32ca687ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:31.772004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c00a6-3165-46c6-ae90-b2e32ca687ec None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:31.789196 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 243/486] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:31.795119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b79cad-9e24-42f1-a1f5-6542769654b3 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:31.795119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b79cad-9e24-42f1-a1f5-6542769654b3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:31.795599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b79cad-9e24-42f1-a1f5-6542769654b3 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:31.797181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 244/487] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:31.798422 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b79cad-9e24-42f1-a1f5-6542769654b3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:31.821298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced661bf-7879-4046-ae69-cc0c5ba37fc4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:31.864476 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2045f-23c1-4c09-b1a2-4a613215a63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:31.865631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2045f-23c1-4c09-b1a2-4a613215a63c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:31.866053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2045f-23c1-4c09-b1a2-4a613215a63c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:31.866327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2045f-23c1-4c09-b1a2-4a613215a63c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:31.870245 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:31.880523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2045f-23c1-4c09-b1a2-4a613215a63c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-f6b2045f-23c1-4c09-b1a2-4a613215a63c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:31.885629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:31.886556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:31.887367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:31.887367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:31.887367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:31.887367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:31.887367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:31.887367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:31.887367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:31.887367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:31.887367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:31.887367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:31.887367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:31.887367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:31.887367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 244/488] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:31.888803 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf925b-999d-46af-ab3b-76e09672d49b None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:31.888803 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf925b-999d-46af-ab3b-76e09672d49b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:31.889021 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf925b-999d-46af-ab3b-76e09672d49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:31.908208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e5bf925b-999d-46af-ab3b-76e09672d49b None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:31.909476 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e5bf925b-999d-46af-ab3b-76e09672d49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:31.925401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b79cad-9e24-42f1-a1f5-6542769654b3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:31.960617 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2246a0-6013-4e77-b945-d464698a2e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:31.961230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2246a0-6013-4e77-b945-d464698a2e16 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:31.961500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2246a0-6013-4e77-b945-d464698a2e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:31.961805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2246a0-6013-4e77-b945-d464698a2e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:31.977194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2246a0-6013-4e77-b945-d464698a2e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:31.978659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2246a0-6013-4e77-b945-d464698a2e16 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:31.988195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 245/489] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:31.988195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331ca89-c26b-4f75-81dd-4765bbcb268a None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:31.988195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331ca89-c26b-4f75-81dd-4765bbcb268a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:31.988195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331ca89-c26b-4f75-81dd-4765bbcb268a None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:31.988195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 246/490] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:31.988195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331ca89-c26b-4f75-81dd-4765bbcb268a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2b2246a0-6013-4e77-b945-d464698a2e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:31.993642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:31.994544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:31.995375 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:31.995375 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:31.995375 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:31.999347 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 245/491] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:32.000728 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf3b91-7428-41a6-8cd3-76a5b905e9ae None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:32.000857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf3b91-7428-41a6-8cd3-76a5b905e9ae None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:32.001108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf3b91-7428-41a6-8cd3-76a5b905e9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:32.020112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b4bf3b91-7428-41a6-8cd3-76a5b905e9ae None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:32.021287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b4bf3b91-7428-41a6-8cd3-76a5b905e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:32.034406 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:32.096892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 246/492] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:32.097615 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf3b91-7428-41a6-8cd3-76a5b905e9ae None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:32.124861 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331ca89-c26b-4f75-81dd-4765bbcb268a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:32.157647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:32.170467 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba7ab2-659e-4833-80b4-374921024f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:32.171200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba7ab2-659e-4833-80b4-374921024f2f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:32.171479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba7ab2-659e-4833-80b4-374921024f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:32.171758 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba7ab2-659e-4833-80b4-374921024f2f None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:32.172999 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba7ab2-659e-4833-80b4-374921024f2f None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:32.173347 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba7ab2-659e-4833-80b4-374921024f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:32.174968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba7ab2-659e-4833-80b4-374921024f2f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:32.185469 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 247/493] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:32.191662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba7ab2-659e-4833-80b4-374921024f2f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:32.220750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf3b91-7428-41a6-8cd3-76a5b905e9ae None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:32.261761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d266898-44fa-437b-ab89-71d30cf832f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:32.262399 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266898-44fa-437b-ab89-71d30cf832f6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:32.262676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266898-44fa-437b-ab89-71d30cf832f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:32.262939 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266898-44fa-437b-ab89-71d30cf832f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:32.264648 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d266898-44fa-437b-ab89-71d30cf832f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:32.265163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d266898-44fa-437b-ab89-71d30cf832f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:32.266770 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d266898-44fa-437b-ab89-71d30cf832f6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:32.285796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 247/494] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:32.285796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d266898-44fa-437b-ab89-71d30cf832f6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:32.296960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:32.396712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba7ab2-659e-4833-80b4-374921024f2f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:32.406300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d266898-44fa-437b-ab89-71d30cf832f6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:32.458435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc80da3-d152-4c28-9b0e-1b5fbc035366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:32.459075 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc80da3-d152-4c28-9b0e-1b5fbc035366 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:32.459662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc80da3-d152-4c28-9b0e-1b5fbc035366 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:32.459937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc80da3-d152-4c28-9b0e-1b5fbc035366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:32.461979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00949d4-db4a-40ee-bf81-6fb46c870f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:32.462600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00949d4-db4a-40ee-bf81-6fb46c870f3d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:32.462878 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00949d4-db4a-40ee-bf81-6fb46c870f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:32.463147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00949d4-db4a-40ee-bf81-6fb46c870f3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:32.471784 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc80da3-d152-4c28-9b0e-1b5fbc035366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:32.472329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00949d4-db4a-40ee-bf81-6fb46c870f3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:32.473225 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc80da3-d152-4c28-9b0e-1b5fbc035366 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:32.473811 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00949d4-db4a-40ee-bf81-6fb46c870f3d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-a00949d4-db4a-40ee-bf81-6fb46c870f3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:32.486579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:32.487482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:32.488385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:32.488385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:32.488385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:32.488385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:32.488385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:32.488385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:32.488385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:32.488385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:32.488385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:10:32.488385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-fdc80da3-d152-4c28-9b0e-1b5fbc035366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:32.488888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:32.489716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:32.490566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:32.490566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:32.490566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:32.491699 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 248/495] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Sep 27 17:10:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:32.492748 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00949d4-db4a-40ee-bf81-6fb46c870f3d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:32.493385 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 248/496] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:32.494228 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc80da3-d152-4c28-9b0e-1b5fbc035366 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:32.539031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:32.564402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:32.604905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc80da3-d152-4c28-9b0e-1b5fbc035366 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:32.609151 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00949d4-db4a-40ee-bf81-6fb46c870f3d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:32.640690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400583b-6d85-4262-b825-d02f2ba912ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:32.641321 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400583b-6d85-4262-b825-d02f2ba912ed None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:32.641596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400583b-6d85-4262-b825-d02f2ba912ed None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:32.641903 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400583b-6d85-4262-b825-d02f2ba912ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:32.646070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1c406-6b2c-4a7a-b05c-fbcb86fa075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:32.646695 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1c406-6b2c-4a7a-b05c-fbcb86fa075d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:32.646971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1c406-6b2c-4a7a-b05c-fbcb86fa075d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:32.647237 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1c406-6b2c-4a7a-b05c-fbcb86fa075d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:32.652298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400583b-6d85-4262-b825-d02f2ba912ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:32.658397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1c406-6b2c-4a7a-b05c-fbcb86fa075d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-3400583b-6d85-4262-b825-d02f2ba912ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:32.658688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:32.659559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:32.660340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:32.660340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:32.660340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:32.660340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:32.660340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:32.660340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:32.660340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:32.660340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:32.660340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:32.660340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:32.660340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:32.660340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:32.660340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 249/497] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:32.660993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400583b-6d85-4262-b825-d02f2ba912ed None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-3de1c406-6b2c-4a7a-b05c-fbcb86fa075d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:32.663559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:32.664398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:32.665171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:32.665171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:32.665171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:32.665171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:32.665171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:32.665171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:32.665171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:32.665171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:32.665171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:32.665171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:32.665171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:32.665171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:32.669320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 249/498] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:32.670921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1c406-6b2c-4a7a-b05c-fbcb86fa075d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:32.763231 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:32.767626 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400583b-6d85-4262-b825-d02f2ba912ed None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:32.771486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1c406-6b2c-4a7a-b05c-fbcb86fa075d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:32.796586 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:32.801782 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f287a9e-b617-406d-8854-38fb3413537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:32.802386 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f287a9e-b617-406d-8854-38fb3413537d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:32.802666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f287a9e-b617-406d-8854-38fb3413537d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:32.802964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f287a9e-b617-406d-8854-38fb3413537d None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:32.803682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f287a9e-b617-406d-8854-38fb3413537d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:32.803992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f287a9e-b617-406d-8854-38fb3413537d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:32.805076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21813332-b368-403a-bb75-ca5a28add501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:32.805435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f287a9e-b617-406d-8854-38fb3413537d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:32.805669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21813332-b368-403a-bb75-ca5a28add501 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:32.805984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21813332-b368-403a-bb75-ca5a28add501 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:32.806253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21813332-b368-403a-bb75-ca5a28add501 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:32.806880 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21813332-b368-403a-bb75-ca5a28add501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:32.807187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21813332-b368-403a-bb75-ca5a28add501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:32.808537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21813332-b368-403a-bb75-ca5a28add501 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:32.820086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 250/499] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:32.820871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21813332-b368-403a-bb75-ca5a28add501 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:32.846050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 250/500] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Sep 27 17:10:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:32.846050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f287a9e-b617-406d-8854-38fb3413537d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:32.923295 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21813332-b368-403a-bb75-ca5a28add501 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:32.945437 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f287a9e-b617-406d-8854-38fb3413537d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:32.955954 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b497c7-21c4-4e35-b6f4-3e6f45069792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:32.956550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b497c7-21c4-4e35-b6f4-3e6f45069792 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:32.956826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b497c7-21c4-4e35-b6f4-3e6f45069792 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:32.957097 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b497c7-21c4-4e35-b6f4-3e6f45069792 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:32.957843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b497c7-21c4-4e35-b6f4-3e6f45069792 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:32.958148 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b497c7-21c4-4e35-b6f4-3e6f45069792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:32.959757 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b497c7-21c4-4e35-b6f4-3e6f45069792 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:32.967738 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 251/501] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:32.968908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3962061-93e0-45ed-9d3f-4624baeb583a None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:32.969190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3962061-93e0-45ed-9d3f-4624baeb583a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:32.969462 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3962061-93e0-45ed-9d3f-4624baeb583a None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:32.970833 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 252/502] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:32.971378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3962061-93e0-45ed-9d3f-4624baeb583a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:32.979180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d57c2-e335-4b31-a268-74a21c1dd865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:32.979787 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d57c2-e335-4b31-a268-74a21c1dd865 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:32.980066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d57c2-e335-4b31-a268-74a21c1dd865 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:32.980335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d57c2-e335-4b31-a268-74a21c1dd865 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:32.980994 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d57c2-e335-4b31-a268-74a21c1dd865 None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:32.981295 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d57c2-e335-4b31-a268-74a21c1dd865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:32.983352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d57c2-e335-4b31-a268-74a21c1dd865 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:32.991620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 251/503] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:32.993713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d57c2-e335-4b31-a268-74a21c1dd865 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:33.016824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:33.023949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:33.077535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3962061-93e0-45ed-9d3f-4624baeb583a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:33.094754 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d57c2-e335-4b31-a268-74a21c1dd865 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:33.109967 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59125d96-52d7-4ce3-ac95-407ba45e4a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:33.110584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59125d96-52d7-4ce3-ac95-407ba45e4a7c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:33.110883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59125d96-52d7-4ce3-ac95-407ba45e4a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:33.111149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59125d96-52d7-4ce3-ac95-407ba45e4a7c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:33.118241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59125d96-52d7-4ce3-ac95-407ba45e4a7c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:33.119671 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59125d96-52d7-4ce3-ac95-407ba45e4a7c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:33.127574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e20d46-6702-4051-9bcc-f0ac35fe1f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:33.128233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e20d46-6702-4051-9bcc-f0ac35fe1f22 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:33.128513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e20d46-6702-4051-9bcc-f0ac35fe1f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:33.128784 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e20d46-6702-4051-9bcc-f0ac35fe1f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-59125d96-52d7-4ce3-ac95-407ba45e4a7c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:33.131102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:33.132175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:33.133207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:33.133207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:33.133207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:33.133207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:33.133207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:33.133207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:33.133207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:33.133207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:33.133207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 27 17:10:33.133207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:33.133207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 253/504] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:33.133207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59125d96-52d7-4ce3-ac95-407ba45e4a7c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:33.197933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e20d46-6702-4051-9bcc-f0ac35fe1f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:33.199383 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e20d46-6702-4051-9bcc-f0ac35fe1f22 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:33.220004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:33.234366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59125d96-52d7-4ce3-ac95-407ba45e4a7c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:33.243698 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:33.268280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8d0d0-1c54-4555-8d62-a089e13085b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:33.268933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d0d0-1c54-4555-8d62-a089e13085b1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:33.269207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d0d0-1c54-4555-8d62-a089e13085b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:33.269477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d0d0-1c54-4555-8d62-a089e13085b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:33.280173 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8d0d0-1c54-4555-8d62-a089e13085b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:33.281632 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8d0d0-1c54-4555-8d62-a089e13085b1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-7ef8d0d0-1c54-4555-8d62-a089e13085b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:33.295841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:33.296818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:33.298132 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:33.298132 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:33.298132 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:33.298132 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 254/505] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:33.298346 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 252/506] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:33.298417 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaab568-6add-49dd-b213-30b9d90e55be None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:33.298417 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaab568-6add-49dd-b213-30b9d90e55be None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:33.298626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaab568-6add-49dd-b213-30b9d90e55be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:33.298815 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e20d46-6702-4051-9bcc-f0ac35fe1f22 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:33.316641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1aaab568-6add-49dd-b213-30b9d90e55be None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:33.317867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1aaab568-6add-49dd-b213-30b9d90e55be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:33.383931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 255/507] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:33.384679 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaab568-6add-49dd-b213-30b9d90e55be None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:33.397047 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e20d46-6702-4051-9bcc-f0ac35fe1f22 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:33.423940 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:33.443227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d092389-271a-4683-aaae-5c21c37748d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:33.443868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d092389-271a-4683-aaae-5c21c37748d2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:33.444577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d092389-271a-4683-aaae-5c21c37748d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:33.444856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d092389-271a-4683-aaae-5c21c37748d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:33.455090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d092389-271a-4683-aaae-5c21c37748d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:33.456532 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d092389-271a-4683-aaae-5c21c37748d2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-7d092389-271a-4683-aaae-5c21c37748d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:33.477128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:33.478090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:33.478977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:33.478977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:33.478977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:33.478977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 253/508] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:33.479763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d092389-271a-4683-aaae-5c21c37748d2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:33.489972 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:33.500718 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaab568-6add-49dd-b213-30b9d90e55be None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:33.538018 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c081a-89dc-43f4-b5ca-7c2c0a5df26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:33.538869 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c081a-89dc-43f4-b5ca-7c2c0a5df26a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:33.539150 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c081a-89dc-43f4-b5ca-7c2c0a5df26a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:33.539432 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c081a-89dc-43f4-b5ca-7c2c0a5df26a None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:33.540160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c081a-89dc-43f4-b5ca-7c2c0a5df26a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:33.540464 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c081a-89dc-43f4-b5ca-7c2c0a5df26a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:33.541916 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c081a-89dc-43f4-b5ca-7c2c0a5df26a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:33.582182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 256/509] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Sep 27 17:10:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:33.582182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c081a-89dc-43f4-b5ca-7c2c0a5df26a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:33.593280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d092389-271a-4683-aaae-5c21c37748d2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:33.631297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac373-9941-4fcc-9a62-320e16fa39a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:33.632197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac373-9941-4fcc-9a62-320e16fa39a4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:33.632477 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac373-9941-4fcc-9a62-320e16fa39a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:33.632750 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac373-9941-4fcc-9a62-320e16fa39a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:33.643493 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ac373-9941-4fcc-9a62-320e16fa39a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:33.644872 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ac373-9941-4fcc-9a62-320e16fa39a4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-6b0ac373-9941-4fcc-9a62-320e16fa39a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:33.660452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:33.661389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:33.662989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:33.662989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:33.662989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:33.662989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 254/510] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:33.662989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac373-9941-4fcc-9a62-320e16fa39a4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:33.682048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c081a-89dc-43f4-b5ca-7c2c0a5df26a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:33.688451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:33.715853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a4c69-8d36-4b51-8934-fa00e9765498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:33.716458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a4c69-8d36-4b51-8934-fa00e9765498 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:33.717297 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a4c69-8d36-4b51-8934-fa00e9765498 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:33.717569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a4c69-8d36-4b51-8934-fa00e9765498 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:33.718234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a4c69-8d36-4b51-8934-fa00e9765498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:33.718533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a4c69-8d36-4b51-8934-fa00e9765498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:33.719911 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a4c69-8d36-4b51-8934-fa00e9765498 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:33.732219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 257/511] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:33.733329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a4c69-8d36-4b51-8934-fa00e9765498 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:33.747005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:33.764833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac373-9941-4fcc-9a62-320e16fa39a4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:33.797811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ce60-3627-4963-96e8-1a5cce6226d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:33.798440 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ce60-3627-4963-96e8-1a5cce6226d6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:33.798889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ce60-3627-4963-96e8-1a5cce6226d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:33.799164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ce60-3627-4963-96e8-1a5cce6226d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:33.800140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379ce60-3627-4963-96e8-1a5cce6226d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:33.800448 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379ce60-3627-4963-96e8-1a5cce6226d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:33.801833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379ce60-3627-4963-96e8-1a5cce6226d6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:33.814139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 255/512] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:33.814936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ce60-3627-4963-96e8-1a5cce6226d6 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:33.841273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a4c69-8d36-4b51-8934-fa00e9765498 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:33.875416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5efbdb-e252-44be-b664-4891d7c58c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:33.876021 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5efbdb-e252-44be-b664-4891d7c58c33 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:33.876298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5efbdb-e252-44be-b664-4891d7c58c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:33.876563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5efbdb-e252-44be-b664-4891d7c58c33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:33.900248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:33.921169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ce60-3627-4963-96e8-1a5cce6226d6 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:33.944053 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5efbdb-e252-44be-b664-4891d7c58c33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:33.945514 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5efbdb-e252-44be-b664-4891d7c58c33 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:33.954494 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4e2e2-7e65-432c-a5a4-aca57f2632bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:33.955131 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4e2e2-7e65-432c-a5a4-aca57f2632bb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:33.955601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4e2e2-7e65-432c-a5a4-aca57f2632bb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:33.955714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:33.955816 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4e2e2-7e65-432c-a5a4-aca57f2632bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:33.966015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4e2e2-7e65-432c-a5a4-aca57f2632bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:33.968119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4e2e2-7e65-432c-a5a4-aca57f2632bb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-64a4e2e2-7e65-432c-a5a4-aca57f2632bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:33.982930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:33.983921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:33.984763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:33.984763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:33.984763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:33.984763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 256/513] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:33.984984 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4e2e2-7e65-432c-a5a4-aca57f2632bb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:34.044491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 258/514] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:34.045494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5efbdb-e252-44be-b664-4891d7c58c33 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:34.088262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4e2e2-7e65-432c-a5a4-aca57f2632bb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:34.121694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249d2a4-4b2b-44ea-80dc-7242b7b6a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:34.122312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249d2a4-4b2b-44ea-80dc-7242b7b6a6aa None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:34.122587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249d2a4-4b2b-44ea-80dc-7242b7b6a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:34.123563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249d2a4-4b2b-44ea-80dc-7242b7b6a6aa None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:34.124198 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249d2a4-4b2b-44ea-80dc-7242b7b6a6aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:34.124502 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249d2a4-4b2b-44ea-80dc-7242b7b6a6aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:34.125874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249d2a4-4b2b-44ea-80dc-7242b7b6a6aa None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:34.128036 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:34.138230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 257/515] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:34.139833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249d2a4-4b2b-44ea-80dc-7242b7b6a6aa None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:34.146081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5efbdb-e252-44be-b664-4891d7c58c33 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:34.155659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:34.180857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551bb00-c390-4eee-800a-621a3077928b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:34.181483 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551bb00-c390-4eee-800a-621a3077928b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:34.181796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551bb00-c390-4eee-800a-621a3077928b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:34.182068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551bb00-c390-4eee-800a-621a3077928b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:34.189967 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551bb00-c390-4eee-800a-621a3077928b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:34.191753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551bb00-c390-4eee-800a-621a3077928b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8551bb00-c390-4eee-800a-621a3077928b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:34.203105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:34.204169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:34.205202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:34.205202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:34.205202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:34.205202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:34.205202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:34.205202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:34.205202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:34.205202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:34.205202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 17:10:34.205202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:34.205202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 259/516] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:34.205202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551bb00-c390-4eee-800a-621a3077928b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:34.242352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249d2a4-4b2b-44ea-80dc-7242b7b6a6aa None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:34.276281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db968b23-bfff-4d4d-824a-e90af71915f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:34.276904 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db968b23-bfff-4d4d-824a-e90af71915f2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:34.277185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db968b23-bfff-4d4d-824a-e90af71915f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:34.277459 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db968b23-bfff-4d4d-824a-e90af71915f2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:34.284455 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db968b23-bfff-4d4d-824a-e90af71915f2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:34.285923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db968b23-bfff-4d4d-824a-e90af71915f2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-db968b23-bfff-4d4d-824a-e90af71915f2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:34.300480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:34.301367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:34.302691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:34.302691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:34.302691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:34.302691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:34.302691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:34.302691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:34.302691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:34.302691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:34.302691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 17:10:34.302691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:34.302691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 258/517] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:34.302691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db968b23-bfff-4d4d-824a-e90af71915f2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:34.303933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551bb00-c390-4eee-800a-621a3077928b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:34.338912 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f26d8b-2049-408d-a2b5-e81c27ceb4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:34.339512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f26d8b-2049-408d-a2b5-e81c27ceb4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:34.339785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f26d8b-2049-408d-a2b5-e81c27ceb4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:34.340050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f26d8b-2049-408d-a2b5-e81c27ceb4c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:34.340679 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f26d8b-2049-408d-a2b5-e81c27ceb4c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:34.340975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f26d8b-2049-408d-a2b5-e81c27ceb4c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:34.342570 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f26d8b-2049-408d-a2b5-e81c27ceb4c7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:34.353730 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 260/518] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:34.354498 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f26d8b-2049-408d-a2b5-e81c27ceb4c7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:34.360174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:34.382859 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:34.404269 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db968b23-bfff-4d4d-824a-e90af71915f2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:34.441199 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cb791-2a95-4d61-ab21-32424fecc102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:34.441868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cb791-2a95-4d61-ab21-32424fecc102 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:34.442148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cb791-2a95-4d61-ab21-32424fecc102 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:34.442421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cb791-2a95-4d61-ab21-32424fecc102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:34.453043 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cb791-2a95-4d61-ab21-32424fecc102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:34.454535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cb791-2a95-4d61-ab21-32424fecc102 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:34.456089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f26d8b-2049-408d-a2b5-e81c27ceb4c7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-412cb791-2a95-4d61-ab21-32424fecc102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:34.468764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:34.469756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:34.470620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:34.470620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:34.470620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:34.470620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 259/519] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:34.470832 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cb791-2a95-4d61-ab21-32424fecc102 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:34.493111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d9d3f-6f21-402b-a74d-703822ecdd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:34.493765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d9d3f-6f21-402b-a74d-703822ecdd85 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:34.494042 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d9d3f-6f21-402b-a74d-703822ecdd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:34.494308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d9d3f-6f21-402b-a74d-703822ecdd85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:34.501461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d9d3f-6f21-402b-a74d-703822ecdd85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:34.502953 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d9d3f-6f21-402b-a74d-703822ecdd85 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:34.516736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-822d9d3f-6f21-402b-a74d-703822ecdd85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:34.516736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:34.516736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:34.516736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:34.516736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:34.516736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:34.516736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:34.516736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:34.516736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:34.516736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:34.516736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:34.516736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:34.516736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:34.516736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:34.516736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:34.517675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:34.518775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:34.518775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:34.518775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:34.518775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:34.518775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:34.518775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:34.518775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:34.518775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:34.518775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 261/520] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:34.518775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d9d3f-6f21-402b-a74d-703822ecdd85 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:34.571813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cb791-2a95-4d61-ab21-32424fecc102 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:34.580913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:34.603999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:34.606138 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369ed1b-95dc-48a1-8fe2-84de0cd403fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:34.606749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369ed1b-95dc-48a1-8fe2-84de0cd403fb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:34.607030 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369ed1b-95dc-48a1-8fe2-84de0cd403fb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:34.607816 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369ed1b-95dc-48a1-8fe2-84de0cd403fb None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:34.608638 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369ed1b-95dc-48a1-8fe2-84de0cd403fb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:34.608941 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369ed1b-95dc-48a1-8fe2-84de0cd403fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:34.610399 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369ed1b-95dc-48a1-8fe2-84de0cd403fb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:34.616954 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d9d3f-6f21-402b-a74d-703822ecdd85 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:34.627582 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 260/521] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Sep 27 17:10:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:34.628361 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369ed1b-95dc-48a1-8fe2-84de0cd403fb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:34.651076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078598e-ff58-4cc6-b962-3cdd6c052ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:34.651678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078598e-ff58-4cc6-b962-3cdd6c052ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:34.651963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078598e-ff58-4cc6-b962-3cdd6c052ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:34.652241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078598e-ff58-4cc6-b962-3cdd6c052ab6 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:34.652960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078598e-ff58-4cc6-b962-3cdd6c052ab6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:34.653267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078598e-ff58-4cc6-b962-3cdd6c052ab6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:34.655774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078598e-ff58-4cc6-b962-3cdd6c052ab6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:34.672363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 262/522] 10.222.0.57 () {56 vars in 1139 bytes} [Tue Sep 27 17:10:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:34.673154 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078598e-ff58-4cc6-b962-3cdd6c052ab6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:34.727709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369ed1b-95dc-48a1-8fe2-84de0cd403fb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:34.762017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81ba10-ee98-4dcb-953e-115491ff80fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:34.762874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81ba10-ee98-4dcb-953e-115491ff80fd None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:34.762874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81ba10-ee98-4dcb-953e-115491ff80fd None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:34.763127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81ba10-ee98-4dcb-953e-115491ff80fd None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:34.764415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81ba10-ee98-4dcb-953e-115491ff80fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:34.765844 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81ba10-ee98-4dcb-953e-115491ff80fd None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:34.771649 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078598e-ff58-4cc6-b962-3cdd6c052ab6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:34.797718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 261/523] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:10:34 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:10:34.797718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81ba10-ee98-4dcb-953e-115491ff80fd None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:34.807241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e30434-afba-4b16-b436-9c92fcf57943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:34.807981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e30434-afba-4b16-b436-9c92fcf57943 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:34.808337 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e30434-afba-4b16-b436-9c92fcf57943 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:34.808617 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e30434-afba-4b16-b436-9c92fcf57943 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:34.809282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e30434-afba-4b16-b436-9c92fcf57943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:34.809589 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e30434-afba-4b16-b436-9c92fcf57943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:34.811878 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e30434-afba-4b16-b436-9c92fcf57943 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:34.824090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 263/524] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:34.824959 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e30434-afba-4b16-b436-9c92fcf57943 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:34.832962 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:34.836040 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:34.927509 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81ba10-ee98-4dcb-953e-115491ff80fd None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:34.933873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e30434-afba-4b16-b436-9c92fcf57943 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:34.969966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e67361-265b-44ae-896c-5c7a9e649c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:34.970339 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96deb37c-afe3-47d6-8d42-5ce9dcae3520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:34.970817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e67361-265b-44ae-896c-5c7a9e649c98 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:34.970934 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deb37c-afe3-47d6-8d42-5ce9dcae3520 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:34.971106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e67361-265b-44ae-896c-5c7a9e649c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:34.971201 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deb37c-afe3-47d6-8d42-5ce9dcae3520 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:34.971361 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e67361-265b-44ae-896c-5c7a9e649c98 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:34.971472 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96deb37c-afe3-47d6-8d42-5ce9dcae3520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:34.972144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e67361-265b-44ae-896c-5c7a9e649c98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:34.972444 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e67361-265b-44ae-896c-5c7a9e649c98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:34.974908 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e67361-265b-44ae-896c-5c7a9e649c98 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:34.996440 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 262/525] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:34.997297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e67361-265b-44ae-896c-5c7a9e649c98 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:35.056142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96deb37c-afe3-47d6-8d42-5ce9dcae3520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:35.058091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96deb37c-afe3-47d6-8d42-5ce9dcae3520 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:35.066698 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:35.095358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:35.116827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e67361-265b-44ae-896c-5c7a9e649c98 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:35.152396 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb00ec2-1c88-4f4d-982d-50ff4623a5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:35.152997 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb00ec2-1c88-4f4d-982d-50ff4623a5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:35.153281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb00ec2-1c88-4f4d-982d-50ff4623a5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:35.153552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb00ec2-1c88-4f4d-982d-50ff4623a5e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:35.179950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 264/526] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:35.179950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96deb37c-afe3-47d6-8d42-5ce9dcae3520 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:35.234452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb00ec2-1c88-4f4d-982d-50ff4623a5e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:35.235921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb00ec2-1c88-4f4d-982d-50ff4623a5e4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:35.284619 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96deb37c-afe3-47d6-8d42-5ce9dcae3520 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:35.292721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:35.317941 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:35.323448 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa0927-ee20-4327-907c-3937fb94fd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:35.324069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa0927-ee20-4327-907c-3937fb94fd26 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:35.324342 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa0927-ee20-4327-907c-3937fb94fd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:35.324607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa0927-ee20-4327-907c-3937fb94fd26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:35.332112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa0927-ee20-4327-907c-3937fb94fd26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:35.333550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa0927-ee20-4327-907c-3937fb94fd26 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:35.342903 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 263/527] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:35.342903 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb00ec2-1c88-4f4d-982d-50ff4623a5e4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:35.349095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-aaaa0927-ee20-4327-907c-3937fb94fd26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:35.349095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:35.349095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:35.349095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:35.349095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:35.349095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:35.349095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:35.349095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:35.349095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:35.349095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:35.349095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:35.349095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:35.349095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:35.349095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:35.349095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:35.350066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:35.350914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:35.350914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:35.350914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:35.350914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:35.350914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:35.350914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:35.350914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:35.350914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:35.350914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 265/528] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:35.351372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa0927-ee20-4327-907c-3937fb94fd26 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:35.455347 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb00ec2-1c88-4f4d-982d-50ff4623a5e4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:35.463398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa0927-ee20-4327-907c-3937fb94fd26 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:35.492333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70984526-b0c6-4efb-9072-08d720972884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:35.493211 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70984526-b0c6-4efb-9072-08d720972884 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:35.493493 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70984526-b0c6-4efb-9072-08d720972884 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:35.493794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70984526-b0c6-4efb-9072-08d720972884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:35.494522 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70984526-b0c6-4efb-9072-08d720972884 None admin] RBAC: Adding query filter params (role.id=f384ed869fc647d9b0187a4d586cd119, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=e75b03fde75e411bace8d406237a7e50) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:35.494836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70984526-b0c6-4efb-9072-08d720972884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:35.496256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70984526-b0c6-4efb-9072-08d720972884 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:35.500199 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425e067-45b4-4806-a006-41af7658890f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:35.501031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425e067-45b4-4806-a006-41af7658890f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:35.501476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425e067-45b4-4806-a006-41af7658890f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:35.501937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425e067-45b4-4806-a006-41af7658890f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:35.502281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 264/529] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:10:35 2022] GET /identity/v3/role_assignments?user.id=e75b03fde75e411bace8d406237a7e50&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f384ed869fc647d9b0187a4d586cd119 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:35.503065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70984526-b0c6-4efb-9072-08d720972884 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:35.521729 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425e067-45b4-4806-a006-41af7658890f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:35.524188 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425e067-45b4-4806-a006-41af7658890f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-0425e067-45b4-4806-a006-41af7658890f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:35.547248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:35.548175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:35.549013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:35.549013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:35.549013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:35.551011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 266/530] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:35.552435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425e067-45b4-4806-a006-41af7658890f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:35.570626 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:35.580891 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:35.639708 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70984526-b0c6-4efb-9072-08d720972884 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:35.678285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc8ba6-4eee-4608-929b-555e18243678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:35.678933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc8ba6-4eee-4608-929b-555e18243678 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:35.679209 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc8ba6-4eee-4608-929b-555e18243678 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:35.679480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc8ba6-4eee-4608-929b-555e18243678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:35.693852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc8ba6-4eee-4608-929b-555e18243678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:35.695397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc8ba6-4eee-4608-929b-555e18243678 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:35.703815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425e067-45b4-4806-a006-41af7658890f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-abcc8ba6-4eee-4608-929b-555e18243678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:35.711337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:35.712298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:35.713144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:35.713144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:35.713144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:35.713144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 265/531] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:35.713357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc8ba6-4eee-4608-929b-555e18243678 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:35.753241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf635b-66af-4a34-bab4-349988a4f2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:35.754393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf635b-66af-4a34-bab4-349988a4f2eb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:35.755129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf635b-66af-4a34-bab4-349988a4f2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:35.755867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf635b-66af-4a34-bab4-349988a4f2eb None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:35.756811 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf635b-66af-4a34-bab4-349988a4f2eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:35.757466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf635b-66af-4a34-bab4-349988a4f2eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:35.759734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf635b-66af-4a34-bab4-349988a4f2eb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:35.789941 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 267/532] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:35.790679 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf635b-66af-4a34-bab4-349988a4f2eb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:35.849319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:35.855240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc8ba6-4eee-4608-929b-555e18243678 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:35.896273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:35.910896 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13784d9c-db1d-443f-bd55-23805093a681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:35.911623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13784d9c-db1d-443f-bd55-23805093a681 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:35.911915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13784d9c-db1d-443f-bd55-23805093a681 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:35.912191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13784d9c-db1d-443f-bd55-23805093a681 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:35.912844 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13784d9c-db1d-443f-bd55-23805093a681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:35.913410 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13784d9c-db1d-443f-bd55-23805093a681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:35.915444 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13784d9c-db1d-443f-bd55-23805093a681 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:35.924506 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf635b-66af-4a34-bab4-349988a4f2eb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:35.933827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 266/533] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:35.935335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13784d9c-db1d-443f-bd55-23805093a681 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:35.965481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7e787-75d8-49e0-9d04-6dd9a75f544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:35.967147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7e787-75d8-49e0-9d04-6dd9a75f544d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:35.967933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7e787-75d8-49e0-9d04-6dd9a75f544d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:35.968424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7e787-75d8-49e0-9d04-6dd9a75f544d None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:35.969266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7e787-75d8-49e0-9d04-6dd9a75f544d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:35.969785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7e787-75d8-49e0-9d04-6dd9a75f544d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:35.971344 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7e787-75d8-49e0-9d04-6dd9a75f544d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:35.984320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 268/534] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:35.985397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7e787-75d8-49e0-9d04-6dd9a75f544d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:36.075278 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13784d9c-db1d-443f-bd55-23805093a681 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:36.098764 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7e787-75d8-49e0-9d04-6dd9a75f544d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:36.118911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b52633-4b73-473b-ada2-ccb1d197b912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:36.119838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b52633-4b73-473b-ada2-ccb1d197b912 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:36.120130 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b52633-4b73-473b-ada2-ccb1d197b912 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:36.120409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b52633-4b73-473b-ada2-ccb1d197b912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:36.121142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b52633-4b73-473b-ada2-ccb1d197b912 None admin] RBAC: Adding query filter params (role.id=f384ed869fc647d9b0187a4d586cd119, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=2a6c4a886aec4dd290b13118e2528fb4) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:36.121457 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b52633-4b73-473b-ada2-ccb1d197b912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:36.123164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b52633-4b73-473b-ada2-ccb1d197b912 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:36.137722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 267/535] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:10:35 2022] GET /identity/v3/role_assignments?user.id=2a6c4a886aec4dd290b13118e2528fb4&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f384ed869fc647d9b0187a4d586cd119 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:36.137722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b52633-4b73-473b-ada2-ccb1d197b912 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:36.151032 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb131dd-e7bc-4526-9c94-a4c03f61adc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:36.151906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb131dd-e7bc-4526-9c94-a4c03f61adc2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:36.152322 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb131dd-e7bc-4526-9c94-a4c03f61adc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:36.152821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb131dd-e7bc-4526-9c94-a4c03f61adc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:36.160939 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:36.175226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb131dd-e7bc-4526-9c94-a4c03f61adc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:36.176977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb131dd-e7bc-4526-9c94-a4c03f61adc2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:36.180281 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:36.204799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ddb131dd-e7bc-4526-9c94-a4c03f61adc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:36.204799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:36.204799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:36.204799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:36.204799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:36.204799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:36.204799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:36.204799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:36.204799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:36.204799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:36.204799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:36.204799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:36.204799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:36.204799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:36.204799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:36.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:36.206963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:36.206963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:36.206963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:36.206963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:36.206963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:36.206963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:36.206963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:36.206963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:36.211120 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 269/536] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:36.216943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb131dd-e7bc-4526-9c94-a4c03f61adc2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:36.306439 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b52633-4b73-473b-ada2-ccb1d197b912 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:36.376483 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ca5d9-99bd-442a-a165-88aba0186e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:36.377373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ca5d9-99bd-442a-a165-88aba0186e5b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:36.377652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ca5d9-99bd-442a-a165-88aba0186e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:36.377942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ca5d9-99bd-442a-a165-88aba0186e5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:36.390271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ca5d9-99bd-442a-a165-88aba0186e5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:36.391738 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ca5d9-99bd-442a-a165-88aba0186e5b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:36.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-e42ca5d9-99bd-442a-a165-88aba0186e5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:36.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:36.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:36.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:36.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:36.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:36.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:36.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:36.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:36.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:36.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:36.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:36.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:36.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:36.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:36.410435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:36.411485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:36.411485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:36.411485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:36.411485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:36.411485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:36.411485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:36.411485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:36.411485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:36.417524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 268/537] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:36.423825 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ca5d9-99bd-442a-a165-88aba0186e5b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:36.441478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb131dd-e7bc-4526-9c94-a4c03f61adc2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:36.514472 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee02db3-a093-4efe-ac58-d7356f596cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:36.515085 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee02db3-a093-4efe-ac58-d7356f596cca None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:36.515365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee02db3-a093-4efe-ac58-d7356f596cca None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:36.515638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee02db3-a093-4efe-ac58-d7356f596cca None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:36.517176 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee02db3-a093-4efe-ac58-d7356f596cca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:36.517490 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee02db3-a093-4efe-ac58-d7356f596cca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:36.518965 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee02db3-a093-4efe-ac58-d7356f596cca None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:36.539833 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 270/538] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:36.546306 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee02db3-a093-4efe-ac58-d7356f596cca None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:36.572049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:36.594076 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ca5d9-99bd-442a-a165-88aba0186e5b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:36.629746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009cf31-4ab4-417c-9229-514f58ebdae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:36.630283 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009cf31-4ab4-417c-9229-514f58ebdae2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:36.630563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009cf31-4ab4-417c-9229-514f58ebdae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:36.630832 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009cf31-4ab4-417c-9229-514f58ebdae2 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:36.631521 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009cf31-4ab4-417c-9229-514f58ebdae2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:36.631821 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009cf31-4ab4-417c-9229-514f58ebdae2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:36.633236 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009cf31-4ab4-417c-9229-514f58ebdae2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:36.640300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:36.647189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 269/539] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:36.654628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009cf31-4ab4-417c-9229-514f58ebdae2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:36.759920 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee02db3-a093-4efe-ac58-d7356f596cca None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:36.777667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009cf31-4ab4-417c-9229-514f58ebdae2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:36.819855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116ba7f-2503-4ff2-9d37-f93eb75ca188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:36.820462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116ba7f-2503-4ff2-9d37-f93eb75ca188 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:36.820741 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116ba7f-2503-4ff2-9d37-f93eb75ca188 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:36.821016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116ba7f-2503-4ff2-9d37-f93eb75ca188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:36.821749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116ba7f-2503-4ff2-9d37-f93eb75ca188 None admin] RBAC: Adding query filter params (role.id=f384ed869fc647d9b0187a4d586cd119, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=008cfc0b27d7448b9c84f8087c969e55) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:36.822058 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116ba7f-2503-4ff2-9d37-f93eb75ca188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:36.823480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116ba7f-2503-4ff2-9d37-f93eb75ca188 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:36.831063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 270/540] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:10:36 2022] GET /identity/v3/role_assignments?user.id=008cfc0b27d7448b9c84f8087c969e55&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f384ed869fc647d9b0187a4d586cd119 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:36.849429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd99afe-2110-4df2-8c3e-4051a8454206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:36.850094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd99afe-2110-4df2-8c3e-4051a8454206 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:36.850371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd99afe-2110-4df2-8c3e-4051a8454206 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:36.850641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd99afe-2110-4df2-8c3e-4051a8454206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:36.851390 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd99afe-2110-4df2-8c3e-4051a8454206 None admin] RBAC: Adding query filter params (role.id=f384ed869fc647d9b0187a4d586cd119, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=2c57bac4e0f54d2596fe1fda9a7dfc76) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:36.851694 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd99afe-2110-4df2-8c3e-4051a8454206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:36.853166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd99afe-2110-4df2-8c3e-4051a8454206 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:36.861038 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 271/541] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:10:36 2022] GET /identity/v3/role_assignments?user.id=2c57bac4e0f54d2596fe1fda9a7dfc76&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f384ed869fc647d9b0187a4d586cd119 => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:37.188770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56ab2a-3247-4774-a713-157f65cb3cae None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:37.189302 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56ab2a-3247-4774-a713-157f65cb3cae None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:37.189302 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56ab2a-3247-4774-a713-157f65cb3cae None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:37.191121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 271/542] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:37.197268 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bbc33-9583-4162-a668-436032c9b69b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:37.197815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bbc33-9583-4162-a668-436032c9b69b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:37.197921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bbc33-9583-4162-a668-436032c9b69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:37.219568 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7b0bbc33-9583-4162-a668-436032c9b69b None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:37.220763 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7b0bbc33-9583-4162-a668-436032c9b69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:37.304329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 272/543] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:10:37.724372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56ab2a-3247-4774-a713-157f65cb3cae None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:37.735567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:37.849731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da58dc0-2ea1-47d2-aaaf-942075cf72d5 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:37.850093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da58dc0-2ea1-47d2-aaaf-942075cf72d5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:37.850290 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da58dc0-2ea1-47d2-aaaf-942075cf72d5 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:37.851637 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 273/544] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:10:37.865208 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3e60f-12ee-46f5-ba44-29a57a0ca54c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:37.865509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3e60f-12ee-46f5-ba44-29a57a0ca54c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:37.865796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3e60f-12ee-46f5-ba44-29a57a0ca54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:37.870968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56ab2a-3247-4774-a713-157f65cb3cae None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:37.898949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d0a3e60f-12ee-46f5-ba44-29a57a0ca54c None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:37.900149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d0a3e60f-12ee-46f5-ba44-29a57a0ca54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:37.929474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff109e-5f4a-43cc-a352-2e424b3b4ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:37.930150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff109e-5f4a-43cc-a352-2e424b3b4ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:37.930437 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff109e-5f4a-43cc-a352-2e424b3b4ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:37.930717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff109e-5f4a-43cc-a352-2e424b3b4ee7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:37.951162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff109e-5f4a-43cc-a352-2e424b3b4ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-59ff109e-5f4a-43cc-a352-2e424b3b4ee7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:37.956587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:37.957465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:37.958290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:37.958290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:37.958290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:37.958290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:37.958290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:37.958290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:37.958290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:37.958290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:37.958290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:37.958290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:37.958290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:37.958290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:37.958883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 272/545] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:37.965593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff109e-5f4a-43cc-a352-2e424b3b4ee7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:37.998911 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:38.056641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 274/546] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:38.178050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:38.242483 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff109e-5f4a-43cc-a352-2e424b3b4ee7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:38.303783 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5b605-3f56-45e5-8c34-733864c58032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:38.304322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5b605-3f56-45e5-8c34-733864c58032 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:38.304609 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5b605-3f56-45e5-8c34-733864c58032 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:38.304888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5b605-3f56-45e5-8c34-733864c58032 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:38.305554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5b605-3f56-45e5-8c34-733864c58032 None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:38.309853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5b605-3f56-45e5-8c34-733864c58032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:38.311419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5b605-3f56-45e5-8c34-733864c58032 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:38.331846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 273/547] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:38.333504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3e60f-12ee-46f5-ba44-29a57a0ca54c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:38.422176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5b605-3f56-45e5-8c34-733864c58032 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:38.532564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3e60f-12ee-46f5-ba44-29a57a0ca54c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:38.633216 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f4ff3-c644-4adb-8e2e-31a792df99e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:38.633898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4ff3-c644-4adb-8e2e-31a792df99e5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:38.634168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4ff3-c644-4adb-8e2e-31a792df99e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:38.634445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4ff3-c644-4adb-8e2e-31a792df99e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:38.656056 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f4ff3-c644-4adb-8e2e-31a792df99e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:38.657552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f4ff3-c644-4adb-8e2e-31a792df99e5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:38.683341 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5b605-3f56-45e5-8c34-733864c58032 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-dc0f4ff3-c644-4adb-8e2e-31a792df99e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:38.705438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:38.706405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:38.707222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:38.707222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:38.707222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:38.707222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 275/548] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:38.713626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f4ff3-c644-4adb-8e2e-31a792df99e5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:38.750526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:38.764012 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:38.770363 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dafaf-6d41-4445-b3e8-70121c52fd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:38.771006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dafaf-6d41-4445-b3e8-70121c52fd01 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:38.771286 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dafaf-6d41-4445-b3e8-70121c52fd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:38.771554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dafaf-6d41-4445-b3e8-70121c52fd01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:38.790316 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340dafaf-6d41-4445-b3e8-70121c52fd01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-340dafaf-6d41-4445-b3e8-70121c52fd01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:38.803285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:38.804681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:38.805644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:38.805644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:38.805644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:38.805644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:38.805644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:38.805644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:38.805644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:38.805644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:38.805644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:38.805644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:38.805644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:38.805644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:38.806310 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 274/549] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:38.812681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dafaf-6d41-4445-b3e8-70121c52fd01 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:38.879833 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f4ff3-c644-4adb-8e2e-31a792df99e5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:38.925326 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bb707-5ba8-4256-8a98-8ead672b817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:38.925884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bb707-5ba8-4256-8a98-8ead672b817b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:38.926162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bb707-5ba8-4256-8a98-8ead672b817b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:38.926430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bb707-5ba8-4256-8a98-8ead672b817b None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:38.927068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bb707-5ba8-4256-8a98-8ead672b817b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:38.927368 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bb707-5ba8-4256-8a98-8ead672b817b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:38.928730 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bb707-5ba8-4256-8a98-8ead672b817b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:38.958312 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 276/550] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:38.964325 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bb707-5ba8-4256-8a98-8ead672b817b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:39.019864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dafaf-6d41-4445-b3e8-70121c52fd01 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:39.062855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1386c-a774-4d44-a5d4-021b5616d595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:39.063470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1386c-a774-4d44-a5d4-021b5616d595 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:39.063752 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1386c-a774-4d44-a5d4-021b5616d595 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:39.064017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1386c-a774-4d44-a5d4-021b5616d595 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:39.065000 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1386c-a774-4d44-a5d4-021b5616d595 None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:39.065718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1386c-a774-4d44-a5d4-021b5616d595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:39.067086 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1386c-a774-4d44-a5d4-021b5616d595 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:39.074365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:39.079304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 275/551] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:39.084366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bb707-5ba8-4256-8a98-8ead672b817b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:39.086689 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13ca77-b9e9-47ce-9013-c37b38874b1d None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:39.086979 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13ca77-b9e9-47ce-9013-c37b38874b1d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:39.087256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13ca77-b9e9-47ce-9013-c37b38874b1d None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:39.088676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 276/552] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:39.093820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13ca77-b9e9-47ce-9013-c37b38874b1d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:39.130807 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d44216-1898-45a4-a82a-400fd9868888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:39.132522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d44216-1898-45a4-a82a-400fd9868888 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:39.132999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d44216-1898-45a4-a82a-400fd9868888 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:39.133461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d44216-1898-45a4-a82a-400fd9868888 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:39.143286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d44216-1898-45a4-a82a-400fd9868888 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:39.145860 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d44216-1898-45a4-a82a-400fd9868888 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:39.153414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f2d44216-1898-45a4-a82a-400fd9868888 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:39.163692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:39.164760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:39.165655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:39.165655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:39.165655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:39.165655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:39.165655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:39.165655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:39.165655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:39.165655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:39.165655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 17:10:39.165655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:39.166830 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 277/553] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:10:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:39.169496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315a6ef-b911-433c-93a4-36b14768be66 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:39.171024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315a6ef-b911-433c-93a4-36b14768be66 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:39.171518 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315a6ef-b911-433c-93a4-36b14768be66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:39.196494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8315a6ef-b911-433c-93a4-36b14768be66 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:39.198286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8315a6ef-b911-433c-93a4-36b14768be66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:39.224010 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13ca77-b9e9-47ce-9013-c37b38874b1d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:39.268625 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427a431-7dc3-4a43-93ce-33dfa7de0320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:39.269415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427a431-7dc3-4a43-93ce-33dfa7de0320 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:39.269875 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427a431-7dc3-4a43-93ce-33dfa7de0320 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:39.270242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427a431-7dc3-4a43-93ce-33dfa7de0320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:39.283884 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427a431-7dc3-4a43-93ce-33dfa7de0320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:39.285504 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427a431-7dc3-4a43-93ce-33dfa7de0320 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:39.287720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 278/554] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:39.288861 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315a6ef-b911-433c-93a4-36b14768be66 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-6427a431-7dc3-4a43-93ce-33dfa7de0320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:39.323083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:39.324157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:39.325025 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:39.325025 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:39.325025 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:39.329244 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 277/555] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:39.336420 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427a431-7dc3-4a43-93ce-33dfa7de0320 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:39.456663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:39.476889 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315a6ef-b911-433c-93a4-36b14768be66 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:39.514196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427a431-7dc3-4a43-93ce-33dfa7de0320 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:39.515950 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:39.518072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eabe3-a55a-4df9-a292-9276fa22536d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:39.518723 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eabe3-a55a-4df9-a292-9276fa22536d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:39.519003 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eabe3-a55a-4df9-a292-9276fa22536d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:39.519311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eabe3-a55a-4df9-a292-9276fa22536d None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:39.520044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eabe3-a55a-4df9-a292-9276fa22536d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:39.520353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eabe3-a55a-4df9-a292-9276fa22536d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:39.521802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eabe3-a55a-4df9-a292-9276fa22536d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:39.543905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 279/556] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Sep 27 17:10:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:39.546038 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ce602-08de-4c77-97fa-43660b5d9baf None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:39.546360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ce602-08de-4c77-97fa-43660b5d9baf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:39.546770 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ce602-08de-4c77-97fa-43660b5d9baf None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:39.552418 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 280/557] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:39.553507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ce602-08de-4c77-97fa-43660b5d9baf None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:39.567425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c7bfb-8d0e-4b9a-80b0-0637b00e5b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:39.568833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c7bfb-8d0e-4b9a-80b0-0637b00e5b23 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:39.569576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c7bfb-8d0e-4b9a-80b0-0637b00e5b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:39.570077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c7bfb-8d0e-4b9a-80b0-0637b00e5b23 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:39.571046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c7bfb-8d0e-4b9a-80b0-0637b00e5b23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:39.571586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c7bfb-8d0e-4b9a-80b0-0637b00e5b23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:39.573275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c7bfb-8d0e-4b9a-80b0-0637b00e5b23 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:39.595330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 278/558] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:39.597937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d501b14-de01-492a-8741-6cb9c5ef373f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:39.598458 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d501b14-de01-492a-8741-6cb9c5ef373f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:39.599022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d501b14-de01-492a-8741-6cb9c5ef373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:39.620664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6d501b14-de01-492a-8741-6cb9c5ef373f None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:39.621872 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6d501b14-de01-492a-8741-6cb9c5ef373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:39.676298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ce602-08de-4c77-97fa-43660b5d9baf None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:39.691122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 279/559] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:39.691964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d501b14-de01-492a-8741-6cb9c5ef373f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:39.717280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b44ec0-c570-479f-8118-270b32760413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:39.717965 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b44ec0-c570-479f-8118-270b32760413 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:39.718249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b44ec0-c570-479f-8118-270b32760413 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:39.718641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b44ec0-c570-479f-8118-270b32760413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:39.731390 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:39.788255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:39.795270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b44ec0-c570-479f-8118-270b32760413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:39.796903 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b44ec0-c570-479f-8118-270b32760413 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:39.797545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d501b14-de01-492a-8741-6cb9c5ef373f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:39.836610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ded4a-f3bf-47dd-80af-02c23ac5bb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:39.837470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ded4a-f3bf-47dd-80af-02c23ac5bb49 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:39.837582 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ded4a-f3bf-47dd-80af-02c23ac5bb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:39.837829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ded4a-f3bf-47dd-80af-02c23ac5bb49 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:39.845610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ded4a-f3bf-47dd-80af-02c23ac5bb49 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:39.847083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ded4a-f3bf-47dd-80af-02c23ac5bb49 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-653ded4a-f3bf-47dd-80af-02c23ac5bb49 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:39.859351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:39.860293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:39.861234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:39.861234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:39.861234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:39.861234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:39.861234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:39.861234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:39.861234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:39.861234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:39.861234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:10:39.861234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:39.861234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 280/560] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Sep 27 17:10:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:39.861234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ded4a-f3bf-47dd-80af-02c23ac5bb49 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:39.908273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 281/561] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:39.909860 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b52b7-a661-43e8-8f6b-e29f66029ee1 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:39.910150 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b52b7-a661-43e8-8f6b-e29f66029ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:39.910426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b52b7-a661-43e8-8f6b-e29f66029ee1 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:39.912211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 282/562] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:39.913066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b52b7-a661-43e8-8f6b-e29f66029ee1 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:39.964431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:39.974159 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ded4a-f3bf-47dd-80af-02c23ac5bb49 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:40.007785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c2d91-2795-4804-8601-3b6c63e78595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:40.008416 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c2d91-2795-4804-8601-3b6c63e78595 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:40.008695 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c2d91-2795-4804-8601-3b6c63e78595 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:40.008969 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c2d91-2795-4804-8601-3b6c63e78595 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:40.019858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c2d91-2795-4804-8601-3b6c63e78595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:40.023744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b52b7-a661-43e8-8f6b-e29f66029ee1 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-200c2d91-2795-4804-8601-3b6c63e78595 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:40.025049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:40.026186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:40.027031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:40.027031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:40.027031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:40.027031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:40.027031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:40.027031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:40.027031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:40.027031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:40.027031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:40.027031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:40.027031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:40.027031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:40.027031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 281/563] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:40.027031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c2d91-2795-4804-8601-3b6c63e78595 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:40.045363 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:40.062522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc79526-b103-4c64-841d-b74e6090d3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:40.063152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc79526-b103-4c64-841d-b74e6090d3ce None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:40.063428 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc79526-b103-4c64-841d-b74e6090d3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:40.063698 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc79526-b103-4c64-841d-b74e6090d3ce None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:40.064411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc79526-b103-4c64-841d-b74e6090d3ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:40.064712 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc79526-b103-4c64-841d-b74e6090d3ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:40.066163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc79526-b103-4c64-841d-b74e6090d3ce None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:40.083526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 283/564] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Sep 27 17:10:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:40.085005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bdfcb-f7c2-4896-992f-152b86c015db None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:40.085289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bdfcb-f7c2-4896-992f-152b86c015db None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:40.085555 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bdfcb-f7c2-4896-992f-152b86c015db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:40.102504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-145bdfcb-f7c2-4896-992f-152b86c015db None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:40.103668 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-145bdfcb-f7c2-4896-992f-152b86c015db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:40.134379 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c2d91-2795-4804-8601-3b6c63e78595 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:40.167673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be288a3b-c3b1-45cb-b7db-6fa0bd3eb41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:40.167886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 284/565] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:40.168308 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be288a3b-c3b1-45cb-b7db-6fa0bd3eb41f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:40.168587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be288a3b-c3b1-45cb-b7db-6fa0bd3eb41f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:40.168848 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bdfcb-f7c2-4896-992f-152b86c015db None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:40.168947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be288a3b-c3b1-45cb-b7db-6fa0bd3eb41f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:40.193473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be288a3b-c3b1-45cb-b7db-6fa0bd3eb41f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:40.194958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be288a3b-c3b1-45cb-b7db-6fa0bd3eb41f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:40.200228 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-be288a3b-c3b1-45cb-b7db-6fa0bd3eb41f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:40.210523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:40.211490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:40.212369 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:40.212369 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:40.212369 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:40.212369 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 282/566] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:40.213006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be288a3b-c3b1-45cb-b7db-6fa0bd3eb41f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:40.278071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bdfcb-f7c2-4896-992f-152b86c015db None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:40.279661 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:40.316012 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0815f1-571a-431b-a728-a16a7c357bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:40.316996 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0815f1-571a-431b-a728-a16a7c357bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:40.317341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0815f1-571a-431b-a728-a16a7c357bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:40.317618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0815f1-571a-431b-a728-a16a7c357bf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:40.321237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be288a3b-c3b1-45cb-b7db-6fa0bd3eb41f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:40.328015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0815f1-571a-431b-a728-a16a7c357bf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ec0815f1-571a-431b-a728-a16a7c357bf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:40.332917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:40.333842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:40.334932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:40.334932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:40.334932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:40.334932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:40.334932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:40.334932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:40.334932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:40.334932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:40.334932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:40.334932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:40.334932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:40.334932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:40.339228 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 285/567] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:40.339965 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0815f1-571a-431b-a728-a16a7c357bf0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:40.359559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0258773-a9d3-4b60-9d5c-76a9f0aee32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:40.360422 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0258773-a9d3-4b60-9d5c-76a9f0aee32a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:40.360921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0258773-a9d3-4b60-9d5c-76a9f0aee32a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:40.361195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0258773-a9d3-4b60-9d5c-76a9f0aee32a None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:40.361899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0258773-a9d3-4b60-9d5c-76a9f0aee32a None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:40.362207 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0258773-a9d3-4b60-9d5c-76a9f0aee32a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:40.363588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0258773-a9d3-4b60-9d5c-76a9f0aee32a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:40.371379 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 283/568] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:40.372150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0258773-a9d3-4b60-9d5c-76a9f0aee32a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:40.439910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:40.449364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0815f1-571a-431b-a728-a16a7c357bf0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:40.482742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dabbdb-fff0-4b43-87c7-7f754ae3ea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:40.483376 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0258773-a9d3-4b60-9d5c-76a9f0aee32a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:40.483476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabbdb-fff0-4b43-87c7-7f754ae3ea22 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:40.483655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabbdb-fff0-4b43-87c7-7f754ae3ea22 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:40.483929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabbdb-fff0-4b43-87c7-7f754ae3ea22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:40.494116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dabbdb-fff0-4b43-87c7-7f754ae3ea22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:40.495549 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dabbdb-fff0-4b43-87c7-7f754ae3ea22 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:40.508928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-54dabbdb-fff0-4b43-87c7-7f754ae3ea22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:40.509625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:40.510747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:40.511635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:40.511635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:40.511635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:40.511635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 286/569] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:40.511635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dabbdb-fff0-4b43-87c7-7f754ae3ea22 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:40.522304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe535b-4535-45b6-b5d8-5a8b8a96d0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:40.522911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe535b-4535-45b6-b5d8-5a8b8a96d0cb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:40.523195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe535b-4535-45b6-b5d8-5a8b8a96d0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:40.523468 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe535b-4535-45b6-b5d8-5a8b8a96d0cb None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:40.524108 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe535b-4535-45b6-b5d8-5a8b8a96d0cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:40.524415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe535b-4535-45b6-b5d8-5a8b8a96d0cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:40.525793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe535b-4535-45b6-b5d8-5a8b8a96d0cb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:40.537251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 284/570] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:40.538017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe535b-4535-45b6-b5d8-5a8b8a96d0cb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:40.613832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dabbdb-fff0-4b43-87c7-7f754ae3ea22 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:40.636832 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe535b-4535-45b6-b5d8-5a8b8a96d0cb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:40.645996 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3c41c-762d-437e-839f-7a0e2c9412da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:40.646594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3c41c-762d-437e-839f-7a0e2c9412da None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:40.646871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3c41c-762d-437e-839f-7a0e2c9412da None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:40.647139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3c41c-762d-437e-839f-7a0e2c9412da None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:40.647802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3c41c-762d-437e-839f-7a0e2c9412da None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:40.648102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3c41c-762d-437e-839f-7a0e2c9412da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:40.649457 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3c41c-762d-437e-839f-7a0e2c9412da None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:40.657643 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 287/571] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:40.658445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3c41c-762d-437e-839f-7a0e2c9412da None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:40.662660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:40.671182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab134d-c8a9-40cf-8539-324ebc0fa6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:40.671807 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab134d-c8a9-40cf-8539-324ebc0fa6df None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:40.672083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab134d-c8a9-40cf-8539-324ebc0fa6df None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:40.672356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab134d-c8a9-40cf-8539-324ebc0fa6df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:40.682226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab134d-c8a9-40cf-8539-324ebc0fa6df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:40.683657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab134d-c8a9-40cf-8539-324ebc0fa6df None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-c2ab134d-c8a9-40cf-8539-324ebc0fa6df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:40.698514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:40.699641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:40.700899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:40.700899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:40.700899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:40.704301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 285/572] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:40.705082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab134d-c8a9-40cf-8539-324ebc0fa6df None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:40.744056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:40.758028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3c41c-762d-437e-839f-7a0e2c9412da None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:40.791045 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aecff-40d0-4f0a-bc75-7a8e0ad17f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:40.791611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aecff-40d0-4f0a-bc75-7a8e0ad17f91 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:40.791890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aecff-40d0-4f0a-bc75-7a8e0ad17f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:40.792164 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aecff-40d0-4f0a-bc75-7a8e0ad17f91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:40.802210 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91aecff-40d0-4f0a-bc75-7a8e0ad17f91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:40.805340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab134d-c8a9-40cf-8539-324ebc0fa6df None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e91aecff-40d0-4f0a-bc75-7a8e0ad17f91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:40.807327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:40.808434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:40.809396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:40.809396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:40.809396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:40.809396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:40.809396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:40.809396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:40.809396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:40.809396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:40.809396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:40.809396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:40.809396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:40.809396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:40.809396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 288/573] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:40.809396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aecff-40d0-4f0a-bc75-7a8e0ad17f91 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:40.842889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6d127-2f57-4bd4-a638-606f9e314077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:40.843494 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6d127-2f57-4bd4-a638-606f9e314077 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:40.843778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6d127-2f57-4bd4-a638-606f9e314077 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:40.844048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6d127-2f57-4bd4-a638-606f9e314077 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:40.844690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6d127-2f57-4bd4-a638-606f9e314077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:40.844993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6d127-2f57-4bd4-a638-606f9e314077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:40.846382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6d127-2f57-4bd4-a638-606f9e314077 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:40.857332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 286/574] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:40.858365 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6d127-2f57-4bd4-a638-606f9e314077 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:40.873646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:40.912537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aecff-40d0-4f0a-bc75-7a8e0ad17f91 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:40.945358 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4e879-b501-4327-91a1-4ab27518480c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:40.946006 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4e879-b501-4327-91a1-4ab27518480c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:40.946283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4e879-b501-4327-91a1-4ab27518480c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:40.946556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4e879-b501-4327-91a1-4ab27518480c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:40.951459 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:40.953873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4e879-b501-4327-91a1-4ab27518480c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:40.955476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4e879-b501-4327-91a1-4ab27518480c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:40.955769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6d127-2f57-4bd4-a638-606f9e314077 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:40.967114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-dae4e879-b501-4327-91a1-4ab27518480c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:40.967114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:40.967114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:40.967114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:40.967114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:40.967114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:40.967114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:40.967114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:40.967114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:40.967114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:40.967114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:40.967114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:40.967114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:40.967114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:40.967114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:40.968124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:40.969323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:40.969323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:40.969323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:40.969323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:40.969323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:40.969323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:40.969323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:40.969323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:40.969323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 289/575] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:40.969323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4e879-b501-4327-91a1-4ab27518480c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:40.993363 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b39f32-b871-43e2-9c9d-385dead9b470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:40.994677 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39f32-b871-43e2-9c9d-385dead9b470 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:40.994970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39f32-b871-43e2-9c9d-385dead9b470 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:40.995252 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b39f32-b871-43e2-9c9d-385dead9b470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:41.006385 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b39f32-b871-43e2-9c9d-385dead9b470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:41.007815 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b39f32-b871-43e2-9c9d-385dead9b470 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-31b39f32-b871-43e2-9c9d-385dead9b470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:41.021699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:41.022624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:41.023526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:41.023526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:41.023526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:41.023526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 287/576] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:41.023526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b39f32-b871-43e2-9c9d-385dead9b470 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:41.070019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4e879-b501-4327-91a1-4ab27518480c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:41.093339 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:41.104613 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95840a46-d459-476e-bf62-b68082401cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:41.105214 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95840a46-d459-476e-bf62-b68082401cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:41.105496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95840a46-d459-476e-bf62-b68082401cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:41.105794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95840a46-d459-476e-bf62-b68082401cf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:41.106430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95840a46-d459-476e-bf62-b68082401cf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:41.107368 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95840a46-d459-476e-bf62-b68082401cf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:41.108744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95840a46-d459-476e-bf62-b68082401cf9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:41.120076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 290/577] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:41.120933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95840a46-d459-476e-bf62-b68082401cf9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:41.124064 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b39f32-b871-43e2-9c9d-385dead9b470 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:41.156633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfba149-828f-4a1b-84c6-6cb6c5b7316e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:41.157241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfba149-828f-4a1b-84c6-6cb6c5b7316e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:41.157526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfba149-828f-4a1b-84c6-6cb6c5b7316e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:41.157838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfba149-828f-4a1b-84c6-6cb6c5b7316e None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:41.158503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfba149-828f-4a1b-84c6-6cb6c5b7316e None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:41.158815 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfba149-828f-4a1b-84c6-6cb6c5b7316e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:41.160172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfba149-828f-4a1b-84c6-6cb6c5b7316e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:41.167931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 288/578] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:41.168700 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfba149-828f-4a1b-84c6-6cb6c5b7316e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:41.183292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:41.223784 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95840a46-d459-476e-bf62-b68082401cf9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:41.257248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b50afb-441c-4283-ab97-8873bfb10f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:41.257896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b50afb-441c-4283-ab97-8873bfb10f2b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:41.258170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b50afb-441c-4283-ab97-8873bfb10f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:41.258438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b50afb-441c-4283-ab97-8873bfb10f2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:41.265247 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b50afb-441c-4283-ab97-8873bfb10f2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:41.266712 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b50afb-441c-4283-ab97-8873bfb10f2b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:41.269710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfba149-828f-4a1b-84c6-6cb6c5b7316e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:41.277558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-68b50afb-441c-4283-ab97-8873bfb10f2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:41.277558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:41.277558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:41.277558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:41.277558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:41.277558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:41.277558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:41.277558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:41.277558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:41.277558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:41.277558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:41.277558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:41.277558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:41.277558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:41.277558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:41.278486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:41.279431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:41.279431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:41.279431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:41.279431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:41.279431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:41.279431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:41.279431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:41.279431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:41.279431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 291/579] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:41.279934 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b50afb-441c-4283-ab97-8873bfb10f2b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:41.307909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d76dfa-726b-41cc-bb1e-3e1e05fefd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:41.308515 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d76dfa-726b-41cc-bb1e-3e1e05fefd9f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:41.308794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d76dfa-726b-41cc-bb1e-3e1e05fefd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:41.309061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d76dfa-726b-41cc-bb1e-3e1e05fefd9f None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:41.310304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d76dfa-726b-41cc-bb1e-3e1e05fefd9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:41.310693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d76dfa-726b-41cc-bb1e-3e1e05fefd9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:41.312092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d76dfa-726b-41cc-bb1e-3e1e05fefd9f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:41.323734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:41.324388 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 289/580] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:41.325173 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d76dfa-726b-41cc-bb1e-3e1e05fefd9f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:41.377775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b50afb-441c-4283-ab97-8873bfb10f2b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:41.395462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:41.411757 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3de6b-b650-416a-ba15-3a041a74e2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:41.412363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3de6b-b650-416a-ba15-3a041a74e2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:41.412651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3de6b-b650-416a-ba15-3a041a74e2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:41.412925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3de6b-b650-416a-ba15-3a041a74e2b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:41.413568 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3de6b-b650-416a-ba15-3a041a74e2b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:41.413899 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3de6b-b650-416a-ba15-3a041a74e2b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:41.415266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3de6b-b650-416a-ba15-3a041a74e2b9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:41.428107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 292/581] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:41.428255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d76dfa-726b-41cc-bb1e-3e1e05fefd9f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:41.429171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3de6b-b650-416a-ba15-3a041a74e2b9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:41.467370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20f511-d823-4f18-8bfa-bbe9f9d9f5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:41.468002 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20f511-d823-4f18-8bfa-bbe9f9d9f5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:41.468284 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20f511-d823-4f18-8bfa-bbe9f9d9f5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:41.468565 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20f511-d823-4f18-8bfa-bbe9f9d9f5c7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:41.475486 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20f511-d823-4f18-8bfa-bbe9f9d9f5c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:41.476937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20f511-d823-4f18-8bfa-bbe9f9d9f5c7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-fa20f511-d823-4f18-8bfa-bbe9f9d9f5c7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:41.490029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:41.491016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:41.492351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:41.492351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:41.492351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:41.492351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:41.492351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:41.492351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:41.492351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:41.492351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:41.492351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 27 17:10:41.492351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:41.492351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 290/582] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:41.492351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20f511-d823-4f18-8bfa-bbe9f9d9f5c7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:41.531666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3de6b-b650-416a-ba15-3a041a74e2b9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:41.534025 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:41.566491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1db4d-4ad1-4c78-ab93-18c0013311ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:41.567123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1db4d-4ad1-4c78-ab93-18c0013311ff None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:41.567401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1db4d-4ad1-4c78-ab93-18c0013311ff None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:41.567676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1db4d-4ad1-4c78-ab93-18c0013311ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:41.577627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1db4d-4ad1-4c78-ab93-18c0013311ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:41.579041 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1db4d-4ad1-4c78-ab93-18c0013311ff None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:41.590216 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20f511-d823-4f18-8bfa-bbe9f9d9f5c7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-afb1db4d-4ad1-4c78-ab93-18c0013311ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:41.594022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:41.594930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:41.595813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:41.595813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:41.595813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:41.595813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 293/583] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:41.596034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1db4d-4ad1-4c78-ab93-18c0013311ff None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:41.622759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:41.628404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d0a0-991b-4594-9b18-8b44db09aea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:41.629007 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d0a0-991b-4594-9b18-8b44db09aea9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:41.629287 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d0a0-991b-4594-9b18-8b44db09aea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:41.629556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d0a0-991b-4594-9b18-8b44db09aea9 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:41.630307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163d0a0-991b-4594-9b18-8b44db09aea9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:41.630612 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163d0a0-991b-4594-9b18-8b44db09aea9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:41.632032 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163d0a0-991b-4594-9b18-8b44db09aea9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:41.648653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 291/584] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:41.648653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d0a0-991b-4594-9b18-8b44db09aea9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:41.698013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1db4d-4ad1-4c78-ab93-18c0013311ff None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:41.731121 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648bed9-ff26-43b5-a39f-f2162a02a26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:41.732330 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648bed9-ff26-43b5-a39f-f2162a02a26d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:41.732610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648bed9-ff26-43b5-a39f-f2162a02a26d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:41.732881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648bed9-ff26-43b5-a39f-f2162a02a26d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:41.733598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648bed9-ff26-43b5-a39f-f2162a02a26d None admin] RBAC: Adding query filter params (role.id=f384ed869fc647d9b0187a4d586cd119, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=87a74ab0288847a7bb8b63756985e509) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:41.733936 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648bed9-ff26-43b5-a39f-f2162a02a26d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:41.735397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648bed9-ff26-43b5-a39f-f2162a02a26d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:41.740394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d0a0-991b-4594-9b18-8b44db09aea9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:41.740680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 294/585] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:10:41 2022] GET /identity/v3/role_assignments?user.id=87a74ab0288847a7bb8b63756985e509&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f384ed869fc647d9b0187a4d586cd119 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:41.741447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648bed9-ff26-43b5-a39f-f2162a02a26d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:41.772179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:41.791512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9a7ff-c9ad-4afd-9774-0b326e1ceedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:41.791512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9a7ff-c9ad-4afd-9774-0b326e1ceedf None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:41.791512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9a7ff-c9ad-4afd-9774-0b326e1ceedf None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:41.791512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9a7ff-c9ad-4afd-9774-0b326e1ceedf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:41.799358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9a7ff-c9ad-4afd-9774-0b326e1ceedf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:41.800817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9a7ff-c9ad-4afd-9774-0b326e1ceedf None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-1ab9a7ff-c9ad-4afd-9774-0b326e1ceedf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:41.815382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:41.816406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:41.817356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:41.817356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:41.817356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:41.817356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:41.817356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:41.817356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:41.817356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:41.817356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:41.817356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 17:10:41.817356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:41.819358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 292/586] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:41.820452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9a7ff-c9ad-4afd-9774-0b326e1ceedf None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:41.873448 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648bed9-ff26-43b5-a39f-f2162a02a26d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:41.882378 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:41.911991 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d62c8c-d6d8-4f55-bc56-8249c808cc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:41.912415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62c8c-d6d8-4f55-bc56-8249c808cc98 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:41.912697 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62c8c-d6d8-4f55-bc56-8249c808cc98 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:41.913734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d62c8c-d6d8-4f55-bc56-8249c808cc98 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:41.913734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d62c8c-d6d8-4f55-bc56-8249c808cc98 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:41.914019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d62c8c-d6d8-4f55-bc56-8249c808cc98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:41.915450 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d62c8c-d6d8-4f55-bc56-8249c808cc98 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:41.941230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 295/587] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Sep 27 17:10:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:41.942104 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d62c8c-d6d8-4f55-bc56-8249c808cc98 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:41.947972 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9a7ff-c9ad-4afd-9774-0b326e1ceedf None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:41.987267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abee60-b66d-4fc1-8fff-10ec013ee8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:41.987978 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abee60-b66d-4fc1-8fff-10ec013ee8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:41.988329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abee60-b66d-4fc1-8fff-10ec013ee8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:41.988682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abee60-b66d-4fc1-8fff-10ec013ee8f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:41.989401 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abee60-b66d-4fc1-8fff-10ec013ee8f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:41.989809 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abee60-b66d-4fc1-8fff-10ec013ee8f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:41.991359 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abee60-b66d-4fc1-8fff-10ec013ee8f1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:42.007905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 293/588] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:42.007905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abee60-b66d-4fc1-8fff-10ec013ee8f1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:42.030090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:42.055017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d62c8c-d6d8-4f55-bc56-8249c808cc98 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:42.090267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de647d12-1090-4b24-8bac-8c942e1d7d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:42.091178 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de647d12-1090-4b24-8bac-8c942e1d7d0f None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:42.091386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de647d12-1090-4b24-8bac-8c942e1d7d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:42.091802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de647d12-1090-4b24-8bac-8c942e1d7d0f None admin] PATH_INFO: `/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/e75b03fde75e411bace8d406237a7e50/roles/f384ed869fc647d9b0187a4d586cd119` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:42.106310 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de647d12-1090-4b24-8bac-8c942e1d7d0f None admin] RBAC: Authorizing `identity:create_grant(project_id=20fffa15f44b4f519ac7e29a48a7a596, user_id=e75b03fde75e411bace8d406237a7e50, role_id=f384ed869fc647d9b0187a4d586cd119)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:42.108607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de647d12-1090-4b24-8bac-8c942e1d7d0f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:42.117011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abee60-b66d-4fc1-8fff-10ec013ee8f1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:42.129810 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 296/589] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:10:41 2022] PUT /identity/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/e75b03fde75e411bace8d406237a7e50/roles/f384ed869fc647d9b0187a4d586cd119 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:10:42.129810 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de647d12-1090-4b24-8bac-8c942e1d7d0f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:42.137393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:42.164053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a3291-4818-45c9-b012-99dc5c3cef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:42.164806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a3291-4818-45c9-b012-99dc5c3cef71 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:42.165165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a3291-4818-45c9-b012-99dc5c3cef71 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:42.165438 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a3291-4818-45c9-b012-99dc5c3cef71 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:42.166351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a3291-4818-45c9-b012-99dc5c3cef71 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:42.166653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a3291-4818-45c9-b012-99dc5c3cef71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:42.168163 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a3291-4818-45c9-b012-99dc5c3cef71 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:42.192659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 294/590] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Sep 27 17:10:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:42.193571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a3291-4818-45c9-b012-99dc5c3cef71 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:42.252493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de647d12-1090-4b24-8bac-8c942e1d7d0f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:42.288846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:42.293553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b69ab-f25b-4e56-8f56-4202efb8642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:42.294407 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b69ab-f25b-4e56-8f56-4202efb8642e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:42.295330 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b69ab-f25b-4e56-8f56-4202efb8642e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:42.295611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b69ab-f25b-4e56-8f56-4202efb8642e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:42.315857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b69ab-f25b-4e56-8f56-4202efb8642e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:42.317935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b69ab-f25b-4e56-8f56-4202efb8642e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:42.334338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a3291-4818-45c9-b012-99dc5c3cef71 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8c1b69ab-f25b-4e56-8f56-4202efb8642e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:42.336958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:42.338005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:42.338984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:42.338984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:42.338984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:42.339346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 297/591] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:42.340207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b69ab-f25b-4e56-8f56-4202efb8642e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:42.382038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea636c7-92bb-4720-8f72-a965eb16c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:42.383246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea636c7-92bb-4720-8f72-a965eb16c6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:42.383246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea636c7-92bb-4720-8f72-a965eb16c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:42.383246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea636c7-92bb-4720-8f72-a965eb16c6f4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:42.391929 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea636c7-92bb-4720-8f72-a965eb16c6f4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:42.393506 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea636c7-92bb-4720-8f72-a965eb16c6f4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-cea636c7-92bb-4720-8f72-a965eb16c6f4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:42.409307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:42.410367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:42.411328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:42.411328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:42.411328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:42.411328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:42.411328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:42.411328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:42.411328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:42.411328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:42.411328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 17:10:42.411328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:42.411885 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 295/592] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:42.412343 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea636c7-92bb-4720-8f72-a965eb16c6f4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:42.451783 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:42.462954 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b69ab-f25b-4e56-8f56-4202efb8642e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:42.500501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ce6fe-5774-48a8-9ec3-0b47223ebb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:42.501146 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ce6fe-5774-48a8-9ec3-0b47223ebb13 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:42.501421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ce6fe-5774-48a8-9ec3-0b47223ebb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:42.501711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ce6fe-5774-48a8-9ec3-0b47223ebb13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:42.514264 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ce6fe-5774-48a8-9ec3-0b47223ebb13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:42.515782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ce6fe-5774-48a8-9ec3-0b47223ebb13 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:42.529815 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea636c7-92bb-4720-8f72-a965eb16c6f4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-4d9ce6fe-5774-48a8-9ec3-0b47223ebb13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:42.531230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:42.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:42.533947 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:42.533947 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:42.533947 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:42.533947 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 298/593] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:42.533947 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ce6fe-5774-48a8-9ec3-0b47223ebb13 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:42.567641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:42.570218 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e2abb-82c2-4cf1-9718-781b94aecae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:42.571073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e2abb-82c2-4cf1-9718-781b94aecae3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:42.571542 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e2abb-82c2-4cf1-9718-781b94aecae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:42.572000 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e2abb-82c2-4cf1-9718-781b94aecae3 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:42.572832 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e2abb-82c2-4cf1-9718-781b94aecae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:42.573315 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e2abb-82c2-4cf1-9718-781b94aecae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:42.575039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e2abb-82c2-4cf1-9718-781b94aecae3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:42.589038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 296/594] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:42.590275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e2abb-82c2-4cf1-9718-781b94aecae3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:42.656283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ce6fe-5774-48a8-9ec3-0b47223ebb13 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:42.695137 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:42.698455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408fa2d-f890-46e5-b638-6e0b85b7cb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:42.699072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408fa2d-f890-46e5-b638-6e0b85b7cb47 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:42.699412 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408fa2d-f890-46e5-b638-6e0b85b7cb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:42.699619 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408fa2d-f890-46e5-b638-6e0b85b7cb47 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:42.700461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408fa2d-f890-46e5-b638-6e0b85b7cb47 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:42.701004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408fa2d-f890-46e5-b638-6e0b85b7cb47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:42.702405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408fa2d-f890-46e5-b638-6e0b85b7cb47 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:42.707202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e2abb-82c2-4cf1-9718-781b94aecae3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:42.725621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 299/595] 10.222.0.57 () {56 vars in 1139 bytes} [Tue Sep 27 17:10:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:42.726496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408fa2d-f890-46e5-b638-6e0b85b7cb47 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:42.756631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584ce0a-e6ff-42cb-8e95-1626011846c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:42.757245 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584ce0a-e6ff-42cb-8e95-1626011846c4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:42.757523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584ce0a-e6ff-42cb-8e95-1626011846c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:42.757829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584ce0a-e6ff-42cb-8e95-1626011846c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:42.758524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584ce0a-e6ff-42cb-8e95-1626011846c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:42.759083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584ce0a-e6ff-42cb-8e95-1626011846c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:42.761145 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584ce0a-e6ff-42cb-8e95-1626011846c4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:42.774309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 297/596] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:42.775142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584ce0a-e6ff-42cb-8e95-1626011846c4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:42.843278 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:42.858561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408fa2d-f890-46e5-b638-6e0b85b7cb47 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:42.897075 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584ce0a-e6ff-42cb-8e95-1626011846c4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:42.906901 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fab215-b70f-4cdf-bb21-e408cc290f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:42.907787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fab215-b70f-4cdf-bb21-e408cc290f88 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:42.908764 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fab215-b70f-4cdf-bb21-e408cc290f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:42.909223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fab215-b70f-4cdf-bb21-e408cc290f88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:42.919027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fab215-b70f-4cdf-bb21-e408cc290f88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:42.921676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fab215-b70f-4cdf-bb21-e408cc290f88 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:42.937293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-16fab215-b70f-4cdf-bb21-e408cc290f88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:42.937293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:42.937293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:42.937293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:42.937293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:42.937293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:42.937293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:42.937293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:42.937293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:42.937293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:42.937293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:42.937293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:42.937293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:42.937293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:42.937293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:42.938267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:42.939131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:42.939131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:42.939131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:42.939131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:42.939131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:42.939131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:42.939131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:42.939131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:42.939131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 300/597] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:42.939624 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fab215-b70f-4cdf-bb21-e408cc290f88 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:42.946580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc938d-6db2-475d-bab6-01f566d333a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:42.948475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc938d-6db2-475d-bab6-01f566d333a0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:42.948935 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc938d-6db2-475d-bab6-01f566d333a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:42.949388 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc938d-6db2-475d-bab6-01f566d333a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:42.964989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc938d-6db2-475d-bab6-01f566d333a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:42.967711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc938d-6db2-475d-bab6-01f566d333a0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-06bc938d-6db2-475d-bab6-01f566d333a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:42.987142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:42.988201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:42.989063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:42.989063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:42.989063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:42.998785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 298/598] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:42.998785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc938d-6db2-475d-bab6-01f566d333a0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:42.999502 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:43.079335 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fab215-b70f-4cdf-bb21-e408cc290f88 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:43.110523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc938d-6db2-475d-bab6-01f566d333a0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:43.123167 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bd9ae-bcc7-4afa-b4b5-5f4efef1ce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:43.124162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bd9ae-bcc7-4afa-b4b5-5f4efef1ce41 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:43.124162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bd9ae-bcc7-4afa-b4b5-5f4efef1ce41 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:43.124515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bd9ae-bcc7-4afa-b4b5-5f4efef1ce41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:43.132539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bd9ae-bcc7-4afa-b4b5-5f4efef1ce41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:43.134169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bd9ae-bcc7-4afa-b4b5-5f4efef1ce41 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:43.146794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-530bd9ae-bcc7-4afa-b4b5-5f4efef1ce41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:43.146794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:43.146794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:43.146794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:43.146794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:43.146794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:43.146794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:43.146794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:43.146794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:43.146794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:43.146794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:43.146794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:43.146794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:43.146794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:43.146794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:43.147754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:43.148640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:43.148640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:43.148640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:43.148640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:43.148640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:43.148640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:43.148640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:43.148640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:43.152892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 301/599] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:43.154521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bd9ae-bcc7-4afa-b4b5-5f4efef1ce41 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:43.159336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8ba2e-5d81-405e-b794-572fba67d00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:43.160169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8ba2e-5d81-405e-b794-572fba67d00c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:43.160654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8ba2e-5d81-405e-b794-572fba67d00c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:43.161107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8ba2e-5d81-405e-b794-572fba67d00c None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:43.162038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8ba2e-5d81-405e-b794-572fba67d00c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:43.162539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8ba2e-5d81-405e-b794-572fba67d00c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:43.164681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8ba2e-5d81-405e-b794-572fba67d00c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:43.168284 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:43.183888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 299/600] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:43.185622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8ba2e-5d81-405e-b794-572fba67d00c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:43.262201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:43.280035 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bd9ae-bcc7-4afa-b4b5-5f4efef1ce41 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:43.304711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8ba2e-5d81-405e-b794-572fba67d00c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:43.327116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4067b0-9d6e-4870-b2af-715e288819b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:43.328203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4067b0-9d6e-4870-b2af-715e288819b0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:43.328657 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4067b0-9d6e-4870-b2af-715e288819b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:43.329320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4067b0-9d6e-4870-b2af-715e288819b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:43.330584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4067b0-9d6e-4870-b2af-715e288819b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:43.331065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4067b0-9d6e-4870-b2af-715e288819b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:43.333100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4067b0-9d6e-4870-b2af-715e288819b0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:43.344188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237035b-c6d6-4a78-9aa9-fd7c8c0e5aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:43.345334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237035b-c6d6-4a78-9aa9-fd7c8c0e5aae None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:43.345334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237035b-c6d6-4a78-9aa9-fd7c8c0e5aae None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:43.345670 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237035b-c6d6-4a78-9aa9-fd7c8c0e5aae None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:43.346555 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237035b-c6d6-4a78-9aa9-fd7c8c0e5aae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:43.346964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237035b-c6d6-4a78-9aa9-fd7c8c0e5aae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:43.348475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237035b-c6d6-4a78-9aa9-fd7c8c0e5aae None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:43.357701 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 302/601] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:43.358772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4067b0-9d6e-4870-b2af-715e288819b0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:43.368051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 300/602] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:43.368923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237035b-c6d6-4a78-9aa9-fd7c8c0e5aae None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:43.447306 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:43.480902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4067b0-9d6e-4870-b2af-715e288819b0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:43.481139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237035b-c6d6-4a78-9aa9-fd7c8c0e5aae None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:43.510091 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:43.518927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4ef7e-fae3-48c5-bc90-b9f7994250fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:43.519806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4ef7e-fae3-48c5-bc90-b9f7994250fc None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:43.519926 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1a5c8-e714-4508-a922-7209b804fead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:43.520379 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4ef7e-fae3-48c5-bc90-b9f7994250fc None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:43.520737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1a5c8-e714-4508-a922-7209b804fead None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:43.520968 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4ef7e-fae3-48c5-bc90-b9f7994250fc None admin] PATH_INFO: `/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/2a6c4a886aec4dd290b13118e2528fb4/roles/f384ed869fc647d9b0187a4d586cd119` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:43.521212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1a5c8-e714-4508-a922-7209b804fead None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:43.521584 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1a5c8-e714-4508-a922-7209b804fead None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:43.529488 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1a5c8-e714-4508-a922-7209b804fead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:43.531101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1a5c8-e714-4508-a922-7209b804fead None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:43.537660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4ef7e-fae3-48c5-bc90-b9f7994250fc None admin] RBAC: Authorizing `identity:create_grant(project_id=20fffa15f44b4f519ac7e29a48a7a596, user_id=2a6c4a886aec4dd290b13118e2528fb4, role_id=f384ed869fc647d9b0187a4d586cd119)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:43.539637 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4ef7e-fae3-48c5-bc90-b9f7994250fc None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:43.544397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-49f1a5c8-e714-4508-a922-7209b804fead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:43.544397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:43.544397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:43.544397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:43.544397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:43.544397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:43.544397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:43.544397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:43.544397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:43.544397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:43.544397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:43.544397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:43.544397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:43.544397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:43.544397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:43.545554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:43.546690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:43.546690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:43.546690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:43.546690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:43.546690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:43.546690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:43.546690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:43.546690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:43.548356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 301/603] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:43.548571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1a5c8-e714-4508-a922-7209b804fead None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:43.560734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 303/604] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:10:43 2022] PUT /identity/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/2a6c4a886aec4dd290b13118e2528fb4/roles/f384ed869fc647d9b0187a4d586cd119 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:10:43.561728 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4ef7e-fae3-48c5-bc90-b9f7994250fc None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:43.678709 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4ef7e-fae3-48c5-bc90-b9f7994250fc None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:43.716615 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:43.734249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d9c5e-8359-41a5-81bb-8a5f5bd41e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:43.734945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d9c5e-8359-41a5-81bb-8a5f5bd41e36 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:43.735227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d9c5e-8359-41a5-81bb-8a5f5bd41e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:43.735497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d9c5e-8359-41a5-81bb-8a5f5bd41e36 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:43.736223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d9c5e-8359-41a5-81bb-8a5f5bd41e36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:43.736535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d9c5e-8359-41a5-81bb-8a5f5bd41e36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:43.738054 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d9c5e-8359-41a5-81bb-8a5f5bd41e36 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:43.752338 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 304/605] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:43.758710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d9c5e-8359-41a5-81bb-8a5f5bd41e36 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:43.786391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1a5c8-e714-4508-a922-7209b804fead None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:43.853794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df60fb-2936-4c0c-905b-a84be23c10d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:43.854478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df60fb-2936-4c0c-905b-a84be23c10d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:43.854745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df60fb-2936-4c0c-905b-a84be23c10d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:43.855052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df60fb-2936-4c0c-905b-a84be23c10d3 None admin] PATH_INFO: `/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/2c57bac4e0f54d2596fe1fda9a7dfc76/roles/f384ed869fc647d9b0187a4d586cd119` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:43.875710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df60fb-2936-4c0c-905b-a84be23c10d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=20fffa15f44b4f519ac7e29a48a7a596, user_id=2c57bac4e0f54d2596fe1fda9a7dfc76, role_id=f384ed869fc647d9b0187a4d586cd119)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:43.877582 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df60fb-2936-4c0c-905b-a84be23c10d3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:43.899895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 302/606] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:10:43 2022] PUT /identity/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/2c57bac4e0f54d2596fe1fda9a7dfc76/roles/f384ed869fc647d9b0187a4d586cd119 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:10:43.936275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d9c5e-8359-41a5-81bb-8a5f5bd41e36 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:43.978378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146968e-98c5-4980-80cc-8fcd254e6ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:43.978970 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146968e-98c5-4980-80cc-8fcd254e6ee0 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:43.979303 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146968e-98c5-4980-80cc-8fcd254e6ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:43.979577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146968e-98c5-4980-80cc-8fcd254e6ee0 None admin] PATH_INFO: `/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/008cfc0b27d7448b9c84f8087c969e55/roles/f384ed869fc647d9b0187a4d586cd119` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:43.998051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146968e-98c5-4980-80cc-8fcd254e6ee0 None admin] RBAC: Authorizing `identity:create_grant(project_id=20fffa15f44b4f519ac7e29a48a7a596, user_id=008cfc0b27d7448b9c84f8087c969e55, role_id=f384ed869fc647d9b0187a4d586cd119)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:43.999650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146968e-98c5-4980-80cc-8fcd254e6ee0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:44.022786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 305/607] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:10:43 2022] PUT /identity/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/008cfc0b27d7448b9c84f8087c969e55/roles/f384ed869fc647d9b0187a4d586cd119 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:10:44.028332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296b736-af08-4ab4-bf50-ef3ec2d0b30c None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:44.028808 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296b736-af08-4ab4-bf50-ef3ec2d0b30c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:44.029094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3296b736-af08-4ab4-bf50-ef3ec2d0b30c None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:44.030690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 303/608] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:44.041306 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4241f2f-c9b6-4dcf-9d0c-0180edfaa20e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:44.041720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4241f2f-c9b6-4dcf-9d0c-0180edfaa20e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:44.041886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4241f2f-c9b6-4dcf-9d0c-0180edfaa20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:44.070575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d4241f2f-c9b6-4dcf-9d0c-0180edfaa20e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:44.071817 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d4241f2f-c9b6-4dcf-9d0c-0180edfaa20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:44.104049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:44.160925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 306/609] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:44.459455 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296b736-af08-4ab4-bf50-ef3ec2d0b30c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:44.504497 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:44.527523 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67521f-f7cc-43b6-886b-17c18956784c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:44.527805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67521f-f7cc-43b6-886b-17c18956784c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:44.528084 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67521f-f7cc-43b6-886b-17c18956784c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:44.530329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 307/610] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:10:44.535512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450eb3a-9089-4006-8c2c-1fca484f0cf6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:44.535941 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450eb3a-9089-4006-8c2c-1fca484f0cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:44.536314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450eb3a-9089-4006-8c2c-1fca484f0cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:44.559050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d450eb3a-9089-4006-8c2c-1fca484f0cf6 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:44.561020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d450eb3a-9089-4006-8c2c-1fca484f0cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:44.622979 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3296b736-af08-4ab4-bf50-ef3ec2d0b30c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:44.651745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 308/611] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:44.684202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785666d-7f33-4354-9741-11415d34122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:44.685580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785666d-7f33-4354-9741-11415d34122a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:44.685888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785666d-7f33-4354-9741-11415d34122a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:44.686162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785666d-7f33-4354-9741-11415d34122a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:44.702902 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785666d-7f33-4354-9741-11415d34122a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-c785666d-7f33-4354-9741-11415d34122a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:44.707837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:44.708780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:44.709966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:44.709966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:44.709966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:44.709966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:44.709966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:44.709966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:44.709966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:44.709966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:44.709966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:44.709966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:44.709966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:44.709966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:44.714028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 304/612] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:44.720689 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450eb3a-9089-4006-8c2c-1fca484f0cf6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:44.861573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:44.877458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450eb3a-9089-4006-8c2c-1fca484f0cf6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:44.914308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8431420-6b92-471a-a977-98df77e0c96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:44.915289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8431420-6b92-471a-a977-98df77e0c96a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:44.915786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8431420-6b92-471a-a977-98df77e0c96a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:44.916256 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8431420-6b92-471a-a977-98df77e0c96a None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:44.917114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8431420-6b92-471a-a977-98df77e0c96a None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:44.917628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8431420-6b92-471a-a977-98df77e0c96a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:44.919789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8431420-6b92-471a-a977-98df77e0c96a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:44.929050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 309/613] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:44.935011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785666d-7f33-4354-9741-11415d34122a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:44.965393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8431420-6b92-471a-a977-98df77e0c96a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:45.090039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:45.107775 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785666d-7f33-4354-9741-11415d34122a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:45.151156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8431420-6b92-471a-a977-98df77e0c96a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:45.173795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe93ad-658e-416c-814a-7bd36003eae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:45.174440 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe93ad-658e-416c-814a-7bd36003eae7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:45.175025 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe93ad-658e-416c-814a-7bd36003eae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:45.175300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe93ad-658e-416c-814a-7bd36003eae7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:45.194611 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe93ad-658e-416c-814a-7bd36003eae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:45.195981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe93ad-658e-416c-814a-7bd36003eae7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:45.221434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbb6d3-f7b2-4b76-8054-bbe7fea4a039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:45.222141 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbb6d3-f7b2-4b76-8054-bbe7fea4a039 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:45.222419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbb6d3-f7b2-4b76-8054-bbe7fea4a039 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:45.222692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbb6d3-f7b2-4b76-8054-bbe7fea4a039 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-63fe93ad-658e-416c-814a-7bd36003eae7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:45.228796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:45.229760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:45.231038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:45.231038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:45.231038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:45.231038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 305/614] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:45.237656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe93ad-658e-416c-814a-7bd36003eae7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:45.244609 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbb6d3-f7b2-4b76-8054-bbe7fea4a039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-91fbb6d3-f7b2-4b76-8054-bbe7fea4a039 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:45.255846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:45.256766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:45.257579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:45.257579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:45.257579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:45.257579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:45.257579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:45.257579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:45.257579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:45.257579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:45.257579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:45.257579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:45.257579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:45.257579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:45.260363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 310/615] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:45.267814 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbb6d3-f7b2-4b76-8054-bbe7fea4a039 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:45.294227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:45.440660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe93ad-658e-416c-814a-7bd36003eae7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:45.462685 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbb6d3-f7b2-4b76-8054-bbe7fea4a039 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:45.503211 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cac5df-9062-4944-9e1f-b7b12fcffb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:45.503892 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cac5df-9062-4944-9e1f-b7b12fcffb0e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:45.504098 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cac5df-9062-4944-9e1f-b7b12fcffb0e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:45.504372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cac5df-9062-4944-9e1f-b7b12fcffb0e None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:45.505018 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cac5df-9062-4944-9e1f-b7b12fcffb0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:45.505322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cac5df-9062-4944-9e1f-b7b12fcffb0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:45.506709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cac5df-9062-4944-9e1f-b7b12fcffb0e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:45.526934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 306/616] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:45.530081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9f7e7-86bd-46cd-84dc-4dbda6fa3306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:45.530755 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9f7e7-86bd-46cd-84dc-4dbda6fa3306 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:45.531035 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9f7e7-86bd-46cd-84dc-4dbda6fa3306 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:45.531346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9f7e7-86bd-46cd-84dc-4dbda6fa3306 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:45.532099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9f7e7-86bd-46cd-84dc-4dbda6fa3306 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:45.532404 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9f7e7-86bd-46cd-84dc-4dbda6fa3306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:45.533790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9f7e7-86bd-46cd-84dc-4dbda6fa3306 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:45.535947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cac5df-9062-4944-9e1f-b7b12fcffb0e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:45.541978 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:45.551228 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 311/617] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:45.557641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9f7e7-86bd-46cd-84dc-4dbda6fa3306 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:45.671477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:45.681979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9f7e7-86bd-46cd-84dc-4dbda6fa3306 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:45.704274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cac5df-9062-4944-9e1f-b7b12fcffb0e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:45.740518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58be803-f587-4e2e-af53-672f12946a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:45.741205 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58be803-f587-4e2e-af53-672f12946a7a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:45.741601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58be803-f587-4e2e-af53-672f12946a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:45.742064 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58be803-f587-4e2e-af53-672f12946a7a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:45.749831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58be803-f587-4e2e-af53-672f12946a7a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:45.751386 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58be803-f587-4e2e-af53-672f12946a7a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-a58be803-f587-4e2e-af53-672f12946a7a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:45.764254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:45.765419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:45.766629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:45.766629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:45.766629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:45.766629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:45.766629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:45.766629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:45.766629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:45.766629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:45.766629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 17:10:45.766629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:45.768047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eaeab0-ca5f-4d64-879f-cc75b5f5b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:45.768454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 307/618] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:10:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:45.768999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaeab0-ca5f-4d64-879f-cc75b5f5b67b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:45.769426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaeab0-ca5f-4d64-879f-cc75b5f5b67b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:45.769867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaeab0-ca5f-4d64-879f-cc75b5f5b67b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:45.779343 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58be803-f587-4e2e-af53-672f12946a7a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:45.784563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eaeab0-ca5f-4d64-879f-cc75b5f5b67b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:45.786310 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eaeab0-ca5f-4d64-879f-cc75b5f5b67b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-48eaeab0-ca5f-4d64-879f-cc75b5f5b67b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:45.820226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:45.821376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:45.822308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:45.822308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:45.822308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:45.826931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 312/619] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:45.832415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eaeab0-ca5f-4d64-879f-cc75b5f5b67b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:45.905543 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:45.984975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58be803-f587-4e2e-af53-672f12946a7a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:46.044366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eaeab0-ca5f-4d64-879f-cc75b5f5b67b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:46.060864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b12e3-dcc4-4b3c-ba69-8e3517cbe175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:46.062243 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b12e3-dcc4-4b3c-ba69-8e3517cbe175 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:46.064293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b12e3-dcc4-4b3c-ba69-8e3517cbe175 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:46.067171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b12e3-dcc4-4b3c-ba69-8e3517cbe175 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:46.068115 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b12e3-dcc4-4b3c-ba69-8e3517cbe175 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:46.068297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b12e3-dcc4-4b3c-ba69-8e3517cbe175 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:46.069708 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b12e3-dcc4-4b3c-ba69-8e3517cbe175 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:46.091722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:46.099220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7de3e-8078-4766-955e-0011bfd8f827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:46.101890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7de3e-8078-4766-955e-0011bfd8f827 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:46.104915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7de3e-8078-4766-955e-0011bfd8f827 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:46.105393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7de3e-8078-4766-955e-0011bfd8f827 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:46.106377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7de3e-8078-4766-955e-0011bfd8f827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:46.106880 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7de3e-8078-4766-955e-0011bfd8f827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:46.108448 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7de3e-8078-4766-955e-0011bfd8f827 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:46.115454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 308/620] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Sep 27 17:10:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:46.123494 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b12e3-dcc4-4b3c-ba69-8e3517cbe175 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:46.135799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 313/621] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:46.142103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7de3e-8078-4766-955e-0011bfd8f827 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:46.324145 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b12e3-dcc4-4b3c-ba69-8e3517cbe175 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:46.329818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7de3e-8078-4766-955e-0011bfd8f827 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:46.349426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:46.362203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03ae23-1632-4ce7-bc3a-03d5922f3b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:46.362844 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03ae23-1632-4ce7-bc3a-03d5922f3b0e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:46.363124 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03ae23-1632-4ce7-bc3a-03d5922f3b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:46.363396 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03ae23-1632-4ce7-bc3a-03d5922f3b0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:46.371009 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541080a3-cd9d-4912-9c87-25fd777408a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:46.371967 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541080a3-cd9d-4912-9c87-25fd777408a3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:46.372639 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541080a3-cd9d-4912-9c87-25fd777408a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:46.373161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541080a3-cd9d-4912-9c87-25fd777408a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:46.374646 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03ae23-1632-4ce7-bc3a-03d5922f3b0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:46.376212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03ae23-1632-4ce7-bc3a-03d5922f3b0e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:46.381858 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541080a3-cd9d-4912-9c87-25fd777408a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:46.383644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541080a3-cd9d-4912-9c87-25fd777408a3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-6d03ae23-1632-4ce7-bc3a-03d5922f3b0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:46.392223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:46.393188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:46.394112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:46.394112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:46.394112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:46.394112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 309/622] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:46.394925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d4240-c018-4f97-a000-edb7b4f02dac None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:46.395197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d4240-c018-4f97-a000-edb7b4f02dac None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:46.395470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d4240-c018-4f97-a000-edb7b4f02dac None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-541080a3-cd9d-4912-9c87-25fd777408a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:46.400113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:46.401048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:46.402010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:46.402010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:46.402010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:46.402010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:46.402010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:46.402010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:46.402010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:46.402010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:46.402010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:10:46.402010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:46.402537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 310/623] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:46.402537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d4240-c018-4f97-a000-edb7b4f02dac None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:46.405391 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 314/624] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Sep 27 17:10:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:46.406976 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25c11b-976f-4af2-a34a-9c8a9a977467 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:46.407454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25c11b-976f-4af2-a34a-9c8a9a977467 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:46.407924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25c11b-976f-4af2-a34a-9c8a9a977467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:46.439758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5d25c11b-976f-4af2-a34a-9c8a9a977467 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:46.441565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5d25c11b-976f-4af2-a34a-9c8a9a977467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:46.492104 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:46.517946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d4240-c018-4f97-a000-edb7b4f02dac None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:46.521487 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 315/625] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:46.522555 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25c11b-976f-4af2-a34a-9c8a9a977467 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:46.575570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37030983-801a-4e0d-862c-47ba4fc9beaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:46.576610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37030983-801a-4e0d-862c-47ba4fc9beaa None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:46.576808 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37030983-801a-4e0d-862c-47ba4fc9beaa None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:46.577034 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37030983-801a-4e0d-862c-47ba4fc9beaa None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:46.577700 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37030983-801a-4e0d-862c-47ba4fc9beaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:46.578017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37030983-801a-4e0d-862c-47ba4fc9beaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:46.579369 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37030983-801a-4e0d-862c-47ba4fc9beaa None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:46.592627 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 311/626] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:46.593931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e76eef-c550-4791-9a3a-a0a32dee5e82 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:46.594219 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e76eef-c550-4791-9a3a-a0a32dee5e82 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:46.594491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e76eef-c550-4791-9a3a-a0a32dee5e82 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:46.596067 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 312/627] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:46.597540 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e76eef-c550-4791-9a3a-a0a32dee5e82 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:46.633408 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25c11b-976f-4af2-a34a-9c8a9a977467 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:46.635717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:46.673410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af7a95-6fc6-4ccc-886c-be87f3bb54aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:46.675100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af7a95-6fc6-4ccc-886c-be87f3bb54aa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:46.675632 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af7a95-6fc6-4ccc-886c-be87f3bb54aa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:46.676100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af7a95-6fc6-4ccc-886c-be87f3bb54aa None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:46.677062 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af7a95-6fc6-4ccc-886c-be87f3bb54aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:46.677572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af7a95-6fc6-4ccc-886c-be87f3bb54aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:46.679364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af7a95-6fc6-4ccc-886c-be87f3bb54aa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:46.701744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 316/628] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Sep 27 17:10:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:46.703792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db855282-597f-4cba-9de2-b7a02a38610a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:46.704305 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db855282-597f-4cba-9de2-b7a02a38610a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:46.704853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db855282-597f-4cba-9de2-b7a02a38610a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:46.712051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e76eef-c550-4791-9a3a-a0a32dee5e82 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:46.726135 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-db855282-597f-4cba-9de2-b7a02a38610a None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:46.727836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-db855282-597f-4cba-9de2-b7a02a38610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:46.749298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d4f81-3d27-4ff8-b84a-2369d24b4a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:46.750049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d4f81-3d27-4ff8-b84a-2369d24b4a70 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:46.750327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d4f81-3d27-4ff8-b84a-2369d24b4a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:46.750597 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d4f81-3d27-4ff8-b84a-2369d24b4a70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:46.760462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d4f81-3d27-4ff8-b84a-2369d24b4a70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:46.760462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d4f81-3d27-4ff8-b84a-2369d24b4a70 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:46.761072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:46.773851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-a38d4f81-3d27-4ff8-b84a-2369d24b4a70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:46.773851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:46.773851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:46.773851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:46.773851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:46.773851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:46.773851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:46.773851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:46.773851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:46.773851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:46.773851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:46.773851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:46.773851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:46.773851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:46.773851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:46.774882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:46.775770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:46.775770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:46.775770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:46.775770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:46.775770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:46.775770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:46.775770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:46.775770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:46.778620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 313/629] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:46.780164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d4f81-3d27-4ff8-b84a-2369d24b4a70 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:46.807061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 317/630] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:46.808040 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db855282-597f-4cba-9de2-b7a02a38610a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:46.884175 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:46.893268 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d4f81-3d27-4ff8-b84a-2369d24b4a70 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:46.914546 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db855282-597f-4cba-9de2-b7a02a38610a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:46.937026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fb7f7-bf8f-4936-81a4-745ec727ad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:46.937793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fb7f7-bf8f-4936-81a4-745ec727ad7c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:46.938112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fb7f7-bf8f-4936-81a4-745ec727ad7c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:46.938395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fb7f7-bf8f-4936-81a4-745ec727ad7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:46.950360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce635c7b-6330-43a1-bc91-dccb3dbf1f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:46.950964 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce635c7b-6330-43a1-bc91-dccb3dbf1f9f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:46.951244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce635c7b-6330-43a1-bc91-dccb3dbf1f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:46.951514 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce635c7b-6330-43a1-bc91-dccb3dbf1f9f None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:46.952205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce635c7b-6330-43a1-bc91-dccb3dbf1f9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:46.952510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce635c7b-6330-43a1-bc91-dccb3dbf1f9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:46.953970 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce635c7b-6330-43a1-bc91-dccb3dbf1f9f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:46.971119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 318/631] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:46.971119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498b2dd-53f7-4855-8575-e23592bfec58 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:46.971119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498b2dd-53f7-4855-8575-e23592bfec58 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:46.971119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498b2dd-53f7-4855-8575-e23592bfec58 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:46.971119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 319/632] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:46.971119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498b2dd-53f7-4855-8575-e23592bfec58 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:47.000766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:47.023766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fb7f7-bf8f-4936-81a4-745ec727ad7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:47.025317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fb7f7-bf8f-4936-81a4-745ec727ad7c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:47.082798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498b2dd-53f7-4855-8575-e23592bfec58 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:47.116292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec145d8-e70e-4441-92e0-2231bcafe7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:47.116916 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec145d8-e70e-4441-92e0-2231bcafe7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:47.117193 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec145d8-e70e-4441-92e0-2231bcafe7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:47.117467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec145d8-e70e-4441-92e0-2231bcafe7d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:47.120836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:47.127713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec145d8-e70e-4441-92e0-2231bcafe7d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:47.128832 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 314/633] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:47.129613 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fb7f7-bf8f-4936-81a4-745ec727ad7c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-cec145d8-e70e-4441-92e0-2231bcafe7d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:47.132900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:47.133907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:47.135008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:47.135008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:47.135008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:47.135008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:47.135008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:47.135008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:47.135008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:47.135008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:47.135008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:47.135008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:47.135008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:47.135008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:47.135008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 320/634] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:47.135923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b0fba-924a-40b4-875c-b2bc5f3ea394 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:47.135923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b0fba-924a-40b4-875c-b2bc5f3ea394 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:47.135923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b0fba-924a-40b4-875c-b2bc5f3ea394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:47.154247 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a42b0fba-924a-40b4-875c-b2bc5f3ea394 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:47.155439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a42b0fba-924a-40b4-875c-b2bc5f3ea394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:47.220642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 321/635] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:47.221462 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b0fba-924a-40b4-875c-b2bc5f3ea394 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:47.237414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fb7f7-bf8f-4936-81a4-745ec727ad7c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:47.241522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:47.277369 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea036d-6216-4999-9241-133c2a274f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:47.278866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea036d-6216-4999-9241-133c2a274f52 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:47.279423 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea036d-6216-4999-9241-133c2a274f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:47.279711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea036d-6216-4999-9241-133c2a274f52 None admin] PATH_INFO: `/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/87a74ab0288847a7bb8b63756985e509/roles/f384ed869fc647d9b0187a4d586cd119` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:47.295823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea036d-6216-4999-9241-133c2a274f52 None admin] RBAC: Authorizing `identity:create_grant(project_id=20fffa15f44b4f519ac7e29a48a7a596, user_id=87a74ab0288847a7bb8b63756985e509, role_id=f384ed869fc647d9b0187a4d586cd119)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:47.296882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea036d-6216-4999-9241-133c2a274f52 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:47.321720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 315/636] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:10:47 2022] PUT /identity/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/87a74ab0288847a7bb8b63756985e509/roles/f384ed869fc647d9b0187a4d586cd119 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:10:47.321720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea036d-6216-4999-9241-133c2a274f52 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:47.345257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b0fba-924a-40b4-875c-b2bc5f3ea394 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:47.380126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:47.383326 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4c67f-5f90-4b74-b227-a3e664ac4695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:47.384019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4c67f-5f90-4b74-b227-a3e664ac4695 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:47.384369 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4c67f-5f90-4b74-b227-a3e664ac4695 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:47.384723 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4c67f-5f90-4b74-b227-a3e664ac4695 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:47.400061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4c67f-5f90-4b74-b227-a3e664ac4695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1fb4c67f-5f90-4b74-b227-a3e664ac4695 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:47.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:47.406291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:47.407147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:47.407147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:47.407147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:47.407147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:47.407147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:47.407147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:47.407147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:47.407147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:47.407147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:47.407147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:47.407147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:47.407147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:47.411407 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 322/637] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:47.412377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4c67f-5f90-4b74-b227-a3e664ac4695 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:47.486671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea036d-6216-4999-9241-133c2a274f52 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:47.505275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:47.534372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc33e6e-38c6-4661-a06d-6f2268886624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:47.535023 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc33e6e-38c6-4661-a06d-6f2268886624 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:47.535303 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc33e6e-38c6-4661-a06d-6f2268886624 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:47.535576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc33e6e-38c6-4661-a06d-6f2268886624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:47.544668 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4c67f-5f90-4b74-b227-a3e664ac4695 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:47.546413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc33e6e-38c6-4661-a06d-6f2268886624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:47.547860 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc33e6e-38c6-4661-a06d-6f2268886624 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-6cc33e6e-38c6-4661-a06d-6f2268886624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:47.564140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:47.565140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:47.566082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:47.566082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:47.566082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:47.566082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 316/638] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:47.566502 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc33e6e-38c6-4661-a06d-6f2268886624 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:47.581648 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db79d8-0cd6-486d-b269-f4cee9a5e8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:47.582353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db79d8-0cd6-486d-b269-f4cee9a5e8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:47.582633 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db79d8-0cd6-486d-b269-f4cee9a5e8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:47.582906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db79d8-0cd6-486d-b269-f4cee9a5e8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:47.583570 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db79d8-0cd6-486d-b269-f4cee9a5e8e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:47.584138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db79d8-0cd6-486d-b269-f4cee9a5e8e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:47.585515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db79d8-0cd6-486d-b269-f4cee9a5e8e6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:47.599011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 323/639] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:47.599011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db79d8-0cd6-486d-b269-f4cee9a5e8e6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:47.672945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:47.679794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc33e6e-38c6-4661-a06d-6f2268886624 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:47.706653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db79d8-0cd6-486d-b269-f4cee9a5e8e6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:47.717114 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69812a-3cc5-4760-b08b-6b3f89a77304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:47.717887 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69812a-3cc5-4760-b08b-6b3f89a77304 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:47.718227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69812a-3cc5-4760-b08b-6b3f89a77304 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:47.718508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69812a-3cc5-4760-b08b-6b3f89a77304 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:47.719296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69812a-3cc5-4760-b08b-6b3f89a77304 None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:47.719691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69812a-3cc5-4760-b08b-6b3f89a77304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:47.720971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69812a-3cc5-4760-b08b-6b3f89a77304 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:47.729826 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 317/640] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:47.730609 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69812a-3cc5-4760-b08b-6b3f89a77304 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:47.747177 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b3f8e-9109-4558-8c10-51ad5dc65a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:47.747833 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3f8e-9109-4558-8c10-51ad5dc65a65 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:47.748116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3f8e-9109-4558-8c10-51ad5dc65a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:47.748389 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3f8e-9109-4558-8c10-51ad5dc65a65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:47.751410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:47.760541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b3f8e-9109-4558-8c10-51ad5dc65a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-376b3f8e-9109-4558-8c10-51ad5dc65a65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:47.766289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:47.767258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:47.768088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:47.768088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:47.768088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:47.768088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:47.768088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:47.768088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:47.768088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:47.768088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:47.768088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:47.768088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:47.768088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:47.768088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:47.768088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 324/641] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:47.768786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b3f8e-9109-4558-8c10-51ad5dc65a65 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:47.848841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69812a-3cc5-4760-b08b-6b3f89a77304 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:47.877015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b3f8e-9109-4558-8c10-51ad5dc65a65 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:47.885810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f654236-c532-4fbe-bcdc-bb6e69da6519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:47.886421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f654236-c532-4fbe-bcdc-bb6e69da6519 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:47.886703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f654236-c532-4fbe-bcdc-bb6e69da6519 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:47.886978 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f654236-c532-4fbe-bcdc-bb6e69da6519 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:47.887735 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f654236-c532-4fbe-bcdc-bb6e69da6519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:47.888041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f654236-c532-4fbe-bcdc-bb6e69da6519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:47.889400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f654236-c532-4fbe-bcdc-bb6e69da6519 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:47.901127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 318/642] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:47.901958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f654236-c532-4fbe-bcdc-bb6e69da6519 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:47.920705 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a577c73-463a-40b3-b3a1-28db20d5314e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:47.921348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a577c73-463a-40b3-b3a1-28db20d5314e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:47.921627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a577c73-463a-40b3-b3a1-28db20d5314e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:47.921933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a577c73-463a-40b3-b3a1-28db20d5314e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:47.922804 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:47.934324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a577c73-463a-40b3-b3a1-28db20d5314e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:47.935759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a577c73-463a-40b3-b3a1-28db20d5314e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-4a577c73-463a-40b3-b3a1-28db20d5314e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:47.952163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:47.953204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:47.954605 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:47.954605 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:47.954605 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:47.954605 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 325/643] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:47.954605 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a577c73-463a-40b3-b3a1-28db20d5314e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:48.007175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:48.016568 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f654236-c532-4fbe-bcdc-bb6e69da6519 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:48.054418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158bf86-8d8f-4538-9330-a10d6819a91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:48.055049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158bf86-8d8f-4538-9330-a10d6819a91b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:48.055363 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158bf86-8d8f-4538-9330-a10d6819a91b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:48.055709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158bf86-8d8f-4538-9330-a10d6819a91b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:48.060834 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a577c73-463a-40b3-b3a1-28db20d5314e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:48.067796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158bf86-8d8f-4538-9330-a10d6819a91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:48.069236 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158bf86-8d8f-4538-9330-a10d6819a91b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-1158bf86-8d8f-4538-9330-a10d6819a91b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:48.086234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:48.087213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:48.088267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:48.088267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:48.088267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:48.088267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 319/644] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:48.088965 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158bf86-8d8f-4538-9330-a10d6819a91b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:48.100658 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5f9de-5458-481f-91e4-d47c438855cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:48.101560 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5f9de-5458-481f-91e4-d47c438855cb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:48.101905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5f9de-5458-481f-91e4-d47c438855cb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:48.102251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5f9de-5458-481f-91e4-d47c438855cb None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:48.102843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5f9de-5458-481f-91e4-d47c438855cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:48.103147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5f9de-5458-481f-91e4-d47c438855cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:48.104519 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5f9de-5458-481f-91e4-d47c438855cb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:48.113591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 326/645] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:48.114259 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5f9de-5458-481f-91e4-d47c438855cb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:48.166262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:48.201003 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158bf86-8d8f-4538-9330-a10d6819a91b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:48.225639 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5f9de-5458-481f-91e4-d47c438855cb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:48.236889 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:48.241570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f815a-578f-4d92-b39b-84f7bff3c494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:48.242240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f815a-578f-4d92-b39b-84f7bff3c494 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:48.242522 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f815a-578f-4d92-b39b-84f7bff3c494 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:48.242800 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f815a-578f-4d92-b39b-84f7bff3c494 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:48.251508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f815a-578f-4d92-b39b-84f7bff3c494 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:48.252960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f815a-578f-4d92-b39b-84f7bff3c494 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:48.263343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b7a8b-cda8-4dbc-8926-2fce609833a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:48.263950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b7a8b-cda8-4dbc-8926-2fce609833a5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:48.264230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b7a8b-cda8-4dbc-8926-2fce609833a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:48.264503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b7a8b-cda8-4dbc-8926-2fce609833a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:48.265140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b7a8b-cda8-4dbc-8926-2fce609833a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:48.265233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-c55f815a-578f-4d92-b39b-84f7bff3c494 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:48.265233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:48.265233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:48.265233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:48.265233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:48.265233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:48.265233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:48.265233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:48.265233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:48.265233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:48.265233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:48.265233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:48.265233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:48.265233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:48.265233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:48.266072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:48.266953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:48.266953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:48.266953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:48.266953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:48.266953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:48.266953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:48.266953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:48.266953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:48.267396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b7a8b-cda8-4dbc-8926-2fce609833a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:48.267466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 320/646] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:48.267466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f815a-578f-4d92-b39b-84f7bff3c494 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:48.270531 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b7a8b-cda8-4dbc-8926-2fce609833a5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:48.289471 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 327/647] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:48.289471 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b7a8b-cda8-4dbc-8926-2fce609833a5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:48.377348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f815a-578f-4d92-b39b-84f7bff3c494 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:48.399056 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b7a8b-cda8-4dbc-8926-2fce609833a5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:48.405293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:48.411813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf55ec3-6652-48d0-816a-ed502c7b9344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:48.412432 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf55ec3-6652-48d0-816a-ed502c7b9344 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:48.412703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf55ec3-6652-48d0-816a-ed502c7b9344 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:48.412976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf55ec3-6652-48d0-816a-ed502c7b9344 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:48.413619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf55ec3-6652-48d0-816a-ed502c7b9344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:48.413964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf55ec3-6652-48d0-816a-ed502c7b9344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:48.415338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf55ec3-6652-48d0-816a-ed502c7b9344 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:48.431421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 321/648] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:48.433259 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf55ec3-6652-48d0-816a-ed502c7b9344 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:48.443330 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cddbda-3568-45cf-845d-857abbfaf7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:48.443957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cddbda-3568-45cf-845d-857abbfaf7af None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:48.444232 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cddbda-3568-45cf-845d-857abbfaf7af None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:48.444499 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cddbda-3568-45cf-845d-857abbfaf7af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:48.455185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cddbda-3568-45cf-845d-857abbfaf7af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:48.456693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cddbda-3568-45cf-845d-857abbfaf7af None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-76cddbda-3568-45cf-845d-857abbfaf7af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:48.473180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:48.474179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:48.475065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:48.475065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:48.475065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:48.478912 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 328/649] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:48.479712 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cddbda-3568-45cf-845d-857abbfaf7af None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:48.505090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:48.538429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf55ec3-6652-48d0-816a-ed502c7b9344 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:48.576381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3e9a2-f4a3-4df9-b389-3719ba840c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:48.577093 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3e9a2-f4a3-4df9-b389-3719ba840c2e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:48.577372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3e9a2-f4a3-4df9-b389-3719ba840c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:48.577651 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3e9a2-f4a3-4df9-b389-3719ba840c2e None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:48.578373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3e9a2-f4a3-4df9-b389-3719ba840c2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:48.578684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3e9a2-f4a3-4df9-b389-3719ba840c2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:48.580321 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3e9a2-f4a3-4df9-b389-3719ba840c2e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:48.586134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cddbda-3568-45cf-845d-857abbfaf7af None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:48.597349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 322/650] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:48.597349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3e9a2-f4a3-4df9-b389-3719ba840c2e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:48.626502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961ae0b-b680-4690-9e4b-b23d04d8c076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:48.627140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961ae0b-b680-4690-9e4b-b23d04d8c076 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:48.627421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961ae0b-b680-4690-9e4b-b23d04d8c076 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:48.627696 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961ae0b-b680-4690-9e4b-b23d04d8c076 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:48.635793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961ae0b-b680-4690-9e4b-b23d04d8c076 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:48.637256 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961ae0b-b680-4690-9e4b-b23d04d8c076 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:48.647990 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-a961ae0b-b680-4690-9e4b-b23d04d8c076 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:48.649537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:48.650493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:48.651442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:48.651442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:48.651442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:48.651442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:48.651442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:48.651442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:48.651442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:48.651442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:48.651442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 27 17:10:48.651442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:48.655601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 329/651] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:48.656235 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961ae0b-b680-4690-9e4b-b23d04d8c076 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:48.703948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3e9a2-f4a3-4df9-b389-3719ba840c2e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:48.736172 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:48.741165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69657e-2570-460b-850c-7f8c8498e563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:48.741822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69657e-2570-460b-850c-7f8c8498e563 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:48.742106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69657e-2570-460b-850c-7f8c8498e563 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:48.742380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69657e-2570-460b-850c-7f8c8498e563 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:48.750028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69657e-2570-460b-850c-7f8c8498e563 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:48.751492 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69657e-2570-460b-850c-7f8c8498e563 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:48.755837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961ae0b-b680-4690-9e4b-b23d04d8c076 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-7c69657e-2570-460b-850c-7f8c8498e563 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:48.762907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:48.763877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:48.764922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:48.764922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:48.764922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:48.764922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:48.764922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:48.764922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:48.764922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:48.764922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:48.764922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 17:10:48.764922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:48.764922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 323/652] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:48.764922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69657e-2570-460b-850c-7f8c8498e563 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:48.798911 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72859aa4-9ac5-40f6-93ed-490d6ae68da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:48.799599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859aa4-9ac5-40f6-93ed-490d6ae68da4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:48.799884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859aa4-9ac5-40f6-93ed-490d6ae68da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:48.800157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859aa4-9ac5-40f6-93ed-490d6ae68da4 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:48.800788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72859aa4-9ac5-40f6-93ed-490d6ae68da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:48.801091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72859aa4-9ac5-40f6-93ed-490d6ae68da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:48.802721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72859aa4-9ac5-40f6-93ed-490d6ae68da4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:48.819669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 330/653] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:48.820567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72859aa4-9ac5-40f6-93ed-490d6ae68da4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:48.870575 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69657e-2570-460b-850c-7f8c8498e563 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:48.881767 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:48.907967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99398df4-22ce-4592-9d3f-41f4cb35a406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:48.908595 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398df4-22ce-4592-9d3f-41f4cb35a406 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:48.908855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398df4-22ce-4592-9d3f-41f4cb35a406 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:48.909127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398df4-22ce-4592-9d3f-41f4cb35a406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:48.909886 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99398df4-22ce-4592-9d3f-41f4cb35a406 None admin] RBAC: Adding query filter params (role.id=f384ed869fc647d9b0187a4d586cd119, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=e75b03fde75e411bace8d406237a7e50) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:48.910201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99398df4-22ce-4592-9d3f-41f4cb35a406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:48.911680 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99398df4-22ce-4592-9d3f-41f4cb35a406 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:48.925445 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 324/654] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:10:48 2022] GET /identity/v3/role_assignments?user.id=e75b03fde75e411bace8d406237a7e50&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f384ed869fc647d9b0187a4d586cd119 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:48.925445 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99398df4-22ce-4592-9d3f-41f4cb35a406 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:48.944132 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72859aa4-9ac5-40f6-93ed-490d6ae68da4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:48.985284 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b0ac9-b534-4b74-ba48-8ca84d873823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:48.985930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b0ac9-b534-4b74-ba48-8ca84d873823 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:48.986263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b0ac9-b534-4b74-ba48-8ca84d873823 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:48.986478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b0ac9-b534-4b74-ba48-8ca84d873823 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:48.987211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b0ac9-b534-4b74-ba48-8ca84d873823 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:48.987515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b0ac9-b534-4b74-ba48-8ca84d873823 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:48.989067 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b0ac9-b534-4b74-ba48-8ca84d873823 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:49.006342 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:49.017618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 331/655] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Sep 27 17:10:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:49.019545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b0ac9-b534-4b74-ba48-8ca84d873823 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:49.055996 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99398df4-22ce-4592-9d3f-41f4cb35a406 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:49.101567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18a279-4c77-43d3-8821-bf0d21e7a4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:49.102567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18a279-4c77-43d3-8821-bf0d21e7a4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:49.103297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18a279-4c77-43d3-8821-bf0d21e7a4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:49.103776 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18a279-4c77-43d3-8821-bf0d21e7a4a6 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:49.105428 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18a279-4c77-43d3-8821-bf0d21e7a4a6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:49.105984 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18a279-4c77-43d3-8821-bf0d21e7a4a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:49.108167 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18a279-4c77-43d3-8821-bf0d21e7a4a6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:49.131121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 325/656] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Sep 27 17:10:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:49.132111 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18a279-4c77-43d3-8821-bf0d21e7a4a6 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:49.156581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b0ac9-b534-4b74-ba48-8ca84d873823 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:49.172433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:49.199118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec9a2a-82ed-40b7-91c9-3a5b649a30c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:49.199933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec9a2a-82ed-40b7-91c9-3a5b649a30c6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:49.200210 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec9a2a-82ed-40b7-91c9-3a5b649a30c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:49.200481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec9a2a-82ed-40b7-91c9-3a5b649a30c6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:49.209435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec9a2a-82ed-40b7-91c9-3a5b649a30c6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:49.210160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec9a2a-82ed-40b7-91c9-3a5b649a30c6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-07ec9a2a-82ed-40b7-91c9-3a5b649a30c6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:49.223463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:49.224421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:49.225363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:49.225363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:49.225363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:49.225363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:49.225363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:49.225363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:49.225363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:49.225363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:49.225363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 17:10:49.225363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:49.232072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 332/657] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:49.232072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec9a2a-82ed-40b7-91c9-3a5b649a30c6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:49.260879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18a279-4c77-43d3-8821-bf0d21e7a4a6 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:49.304126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c52bed-879a-404c-8214-b8994794becb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:49.304830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c52bed-879a-404c-8214-b8994794becb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:49.305173 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c52bed-879a-404c-8214-b8994794becb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:49.305514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c52bed-879a-404c-8214-b8994794becb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:49.314777 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:49.362926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec9a2a-82ed-40b7-91c9-3a5b649a30c6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:49.399881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c0d71-97f0-4f60-9f5e-ea146f49dc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:49.400715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c0d71-97f0-4f60-9f5e-ea146f49dc71 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:49.401100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c0d71-97f0-4f60-9f5e-ea146f49dc71 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:49.401472 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c0d71-97f0-4f60-9f5e-ea146f49dc71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:49.405632 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c52bed-879a-404c-8214-b8994794becb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:49.408528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c52bed-879a-404c-8214-b8994794becb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:49.457742 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:49.483223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c0d71-97f0-4f60-9f5e-ea146f49dc71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:49.484820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c0d71-97f0-4f60-9f5e-ea146f49dc71 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:49.550344 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:49.551840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 326/658] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:49.552748 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c52bed-879a-404c-8214-b8994794becb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:49.597272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 333/659] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:49.598576 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e967b-271f-4c97-aa35-0e095a687b50 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:49.598863 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e967b-271f-4c97-aa35-0e095a687b50 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:49.599137 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e967b-271f-4c97-aa35-0e095a687b50 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:49.604714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 334/660] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:49.604714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e967b-271f-4c97-aa35-0e095a687b50 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:49.667806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c52bed-879a-404c-8214-b8994794becb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:49.700836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:49.706193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184985af-32ab-4a9f-9669-a5505f81d131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:49.706798 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184985af-32ab-4a9f-9669-a5505f81d131 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:49.707085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184985af-32ab-4a9f-9669-a5505f81d131 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:49.707364 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184985af-32ab-4a9f-9669-a5505f81d131 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:49.708086 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184985af-32ab-4a9f-9669-a5505f81d131 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:49.708395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184985af-32ab-4a9f-9669-a5505f81d131 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:49.710097 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184985af-32ab-4a9f-9669-a5505f81d131 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:49.714224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e967b-271f-4c97-aa35-0e095a687b50 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:49.728152 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 327/661] 10.222.0.57 () {56 vars in 1139 bytes} [Tue Sep 27 17:10:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:49.729888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184985af-32ab-4a9f-9669-a5505f81d131 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:49.756898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a587a-e6e8-4c28-bd0a-8294c16ac3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:49.758286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a587a-e6e8-4c28-bd0a-8294c16ac3fc None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:49.758777 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a587a-e6e8-4c28-bd0a-8294c16ac3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:49.759247 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a587a-e6e8-4c28-bd0a-8294c16ac3fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:49.770440 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a587a-e6e8-4c28-bd0a-8294c16ac3fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:49.772273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a587a-e6e8-4c28-bd0a-8294c16ac3fc None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b32a587a-e6e8-4c28-bd0a-8294c16ac3fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:49.788128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:49.789292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:49.790287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:49.790287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:49.790287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:49.795556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 335/662] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:49.795556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e3ad5-02f1-4f84-8774-57aa3342ee8f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:49.795556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e3ad5-02f1-4f84-8774-57aa3342ee8f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:49.795556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e3ad5-02f1-4f84-8774-57aa3342ee8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:49.811631 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7e7e3ad5-02f1-4f84-8774-57aa3342ee8f None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:49.812753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7e7e3ad5-02f1-4f84-8774-57aa3342ee8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:49.820420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:49.844137 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184985af-32ab-4a9f-9669-a5505f81d131 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:49.893722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 336/663] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:49.893722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e3ad5-02f1-4f84-8774-57aa3342ee8f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:49.894792 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1512ab-0470-4d32-8ecb-581c51e534ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:49.895546 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1512ab-0470-4d32-8ecb-581c51e534ed None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:49.895876 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1512ab-0470-4d32-8ecb-581c51e534ed None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:49.896152 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1512ab-0470-4d32-8ecb-581c51e534ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:49.908505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1512ab-0470-4d32-8ecb-581c51e534ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:49.909975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1512ab-0470-4d32-8ecb-581c51e534ed None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-5a1512ab-0470-4d32-8ecb-581c51e534ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:49.929755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:49.930762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:49.931639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:49.931639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:49.931639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:49.935620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 328/664] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:49.936491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1512ab-0470-4d32-8ecb-581c51e534ed None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:49.986607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:50.024572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e3ad5-02f1-4f84-8774-57aa3342ee8f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:50.058685 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1512ab-0470-4d32-8ecb-581c51e534ed None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:50.064550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fa751-ac4c-416d-8e9e-45d286820285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:50.065378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fa751-ac4c-416d-8e9e-45d286820285 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:50.065881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fa751-ac4c-416d-8e9e-45d286820285 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:50.066328 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fa751-ac4c-416d-8e9e-45d286820285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:50.082941 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:50.099147 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3e5ca-daba-4ed6-b265-9ffc2446a9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:50.100087 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3e5ca-daba-4ed6-b265-9ffc2446a9eb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:50.100685 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3e5ca-daba-4ed6-b265-9ffc2446a9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:50.101127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3e5ca-daba-4ed6-b265-9ffc2446a9eb None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:50.101970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3e5ca-daba-4ed6-b265-9ffc2446a9eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:50.102429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3e5ca-daba-4ed6-b265-9ffc2446a9eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:50.104152 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3e5ca-daba-4ed6-b265-9ffc2446a9eb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:50.119952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 329/665] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:50.120993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3e5ca-daba-4ed6-b265-9ffc2446a9eb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:50.161584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fa751-ac4c-416d-8e9e-45d286820285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:50.163143 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fa751-ac4c-416d-8e9e-45d286820285 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:50.232330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3e5ca-daba-4ed6-b265-9ffc2446a9eb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:50.234275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:50.271267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b317b7-3558-42bf-b6d4-60aa08e7b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:50.272139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b317b7-3558-42bf-b6d4-60aa08e7b3ff None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:50.272833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b317b7-3558-42bf-b6d4-60aa08e7b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:50.273105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b317b7-3558-42bf-b6d4-60aa08e7b3ff None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:50.273784 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b317b7-3558-42bf-b6d4-60aa08e7b3ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:50.274095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b317b7-3558-42bf-b6d4-60aa08e7b3ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:50.275512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b317b7-3558-42bf-b6d4-60aa08e7b3ff None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:50.280977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 337/666] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:50.280977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fa751-ac4c-416d-8e9e-45d286820285 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:50.298551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 330/667] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:50.299304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b317b7-3558-42bf-b6d4-60aa08e7b3ff None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:50.322997 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:50.384767 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fa751-ac4c-416d-8e9e-45d286820285 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:50.407315 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b317b7-3558-42bf-b6d4-60aa08e7b3ff None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:50.429550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea2ef5-ae92-4429-95fc-041f86831935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:50.430218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea2ef5-ae92-4429-95fc-041f86831935 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:50.430497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea2ef5-ae92-4429-95fc-041f86831935 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:50.430788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea2ef5-ae92-4429-95fc-041f86831935 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:50.438430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea2ef5-ae92-4429-95fc-041f86831935 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:50.439925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea2ef5-ae92-4429-95fc-041f86831935 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:50.449284 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2c023-b4ed-4d28-8f53-5529401c7844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:50.450140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2c023-b4ed-4d28-8f53-5529401c7844 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:50.450634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2c023-b4ed-4d28-8f53-5529401c7844 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:50.450938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2c023-b4ed-4d28-8f53-5529401c7844 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:50.452015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-70ea2ef5-ae92-4429-95fc-041f86831935 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:50.452015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:50.452015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:50.452015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:50.452015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:50.452015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:50.452015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:50.452015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:50.452015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:50.452015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:50.452015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:50.452015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:50.452015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:50.452015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:50.452015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:50.452882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:50.453808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:50.453808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:50.453808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:50.453808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:50.453808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:50.453808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:50.453808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:50.453808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:50.453808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 338/668] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:50.454302 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea2ef5-ae92-4429-95fc-041f86831935 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:50.468069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2c023-b4ed-4d28-8f53-5529401c7844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-c6d2c023-b4ed-4d28-8f53-5529401c7844 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:50.472838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:50.473780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:50.474697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:50.474697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:50.474697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:50.474697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:50.474697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:50.474697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:50.474697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:50.474697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:50.474697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:50.474697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:50.474697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:50.474697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:50.474697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 331/669] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:50.474697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2c023-b4ed-4d28-8f53-5529401c7844 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:50.501003 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:50.569536 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea2ef5-ae92-4429-95fc-041f86831935 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:50.571412 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:50.580712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2c023-b4ed-4d28-8f53-5529401c7844 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:50.606701 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6049efd-37cb-489b-b69d-afd6a1cbe17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:50.607321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6049efd-37cb-489b-b69d-afd6a1cbe17f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:50.607601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6049efd-37cb-489b-b69d-afd6a1cbe17f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:50.607872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6049efd-37cb-489b-b69d-afd6a1cbe17f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:50.617887 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6049efd-37cb-489b-b69d-afd6a1cbe17f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:50.618716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ff268-2cdd-43f6-b90b-e005ef1669a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:50.619332 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6049efd-37cb-489b-b69d-afd6a1cbe17f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:50.619453 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ff268-2cdd-43f6-b90b-e005ef1669a7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:50.619611 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ff268-2cdd-43f6-b90b-e005ef1669a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:50.619875 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ff268-2cdd-43f6-b90b-e005ef1669a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:50.626769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ff268-2cdd-43f6-b90b-e005ef1669a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:50.628164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ff268-2cdd-43f6-b90b-e005ef1669a7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b6049efd-37cb-489b-b69d-afd6a1cbe17f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:50.634905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:50.635828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:50.636731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:50.636731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:50.636731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:50.637998 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 339/670] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:50.639023 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6049efd-37cb-489b-b69d-afd6a1cbe17f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:50.639662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-5d6ff268-2cdd-43f6-b90b-e005ef1669a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:50.639662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:50.639662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:50.639662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:50.639662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:50.639662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:50.639662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:50.639662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:50.639662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:50.639662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:50.639662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:50.639662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:50.639662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:50.639662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:50.639662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:50.640523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:50.641503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:50.641503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:50.641503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:50.641503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:50.641503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:50.641503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:50.641503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:50.641503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:50.641503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 332/671] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:50.642053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ff268-2cdd-43f6-b90b-e005ef1669a7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:50.729907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:50.749274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6049efd-37cb-489b-b69d-afd6a1cbe17f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:50.753232 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ff268-2cdd-43f6-b90b-e005ef1669a7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:50.786118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092b2a-e5b2-404c-b29b-1dff4534e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:50.786839 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092b2a-e5b2-404c-b29b-1dff4534e18f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:50.787126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092b2a-e5b2-404c-b29b-1dff4534e18f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:50.787399 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092b2a-e5b2-404c-b29b-1dff4534e18f None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:50.788086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4092b2a-e5b2-404c-b29b-1dff4534e18f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:50.788389 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4092b2a-e5b2-404c-b29b-1dff4534e18f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:50.789226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de250183-8c20-4f00-a23a-4abece2e4eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:50.789841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4092b2a-e5b2-404c-b29b-1dff4534e18f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:50.789943 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250183-8c20-4f00-a23a-4abece2e4eec None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:50.790160 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250183-8c20-4f00-a23a-4abece2e4eec None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:50.790431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250183-8c20-4f00-a23a-4abece2e4eec None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:50.791086 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de250183-8c20-4f00-a23a-4abece2e4eec None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:50.791380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de250183-8c20-4f00-a23a-4abece2e4eec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:50.792700 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de250183-8c20-4f00-a23a-4abece2e4eec None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:50.806717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 333/672] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:50.806717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de250183-8c20-4f00-a23a-4abece2e4eec None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:50.806970 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 340/673] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:50.806970 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092b2a-e5b2-404c-b29b-1dff4534e18f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:50.822461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:50.911343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092b2a-e5b2-404c-b29b-1dff4534e18f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:50.917876 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de250183-8c20-4f00-a23a-4abece2e4eec None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:50.946625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89226ae-370d-4869-95a0-29d941ec2fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:50.947227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89226ae-370d-4869-95a0-29d941ec2fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:50.947503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89226ae-370d-4869-95a0-29d941ec2fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:50.947769 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89226ae-370d-4869-95a0-29d941ec2fe5 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:50.948462 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89226ae-370d-4869-95a0-29d941ec2fe5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:50.948752 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89226ae-370d-4869-95a0-29d941ec2fe5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:50.951395 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89226ae-370d-4869-95a0-29d941ec2fe5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:50.956714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba05442-aafc-4384-acc2-750afb581e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:50.957591 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba05442-aafc-4384-acc2-750afb581e3a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:50.958162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba05442-aafc-4384-acc2-750afb581e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:50.958558 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba05442-aafc-4384-acc2-750afb581e3a None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:50.959563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba05442-aafc-4384-acc2-750afb581e3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:50.959872 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba05442-aafc-4384-acc2-750afb581e3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:50.961229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba05442-aafc-4384-acc2-750afb581e3a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:50.963602 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 341/674] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:50.964227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89226ae-370d-4869-95a0-29d941ec2fe5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:50.983511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 334/675] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:50.983511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba05442-aafc-4384-acc2-750afb581e3a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:50.986406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:51.047742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:51.072950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89226ae-370d-4869-95a0-29d941ec2fe5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:51.099505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba05442-aafc-4384-acc2-750afb581e3a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:51.107660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181914b-9e29-4a8e-938f-01cfc51f18c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:51.108290 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181914b-9e29-4a8e-938f-01cfc51f18c8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:51.108569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181914b-9e29-4a8e-938f-01cfc51f18c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:51.108848 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181914b-9e29-4a8e-938f-01cfc51f18c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:51.119413 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181914b-9e29-4a8e-938f-01cfc51f18c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:51.120862 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181914b-9e29-4a8e-938f-01cfc51f18c8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-6181914b-9e29-4a8e-938f-01cfc51f18c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:51.135525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:51.136494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:51.138142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:51.138142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:51.138142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:51.140002 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e814801-d848-4c93-975f-c134af310065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:51.140616 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e814801-d848-4c93-975f-c134af310065 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:51.140895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e814801-d848-4c93-975f-c134af310065 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:51.141166 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e814801-d848-4c93-975f-c134af310065 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:51.141842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 342/676] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:51.141958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e814801-d848-4c93-975f-c134af310065 None admin] RBAC: Adding query filter params (role.id=f384ed869fc647d9b0187a4d586cd119, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=2a6c4a886aec4dd290b13118e2528fb4) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:51.142220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e814801-d848-4c93-975f-c134af310065 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:51.142680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181914b-9e29-4a8e-938f-01cfc51f18c8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:51.143802 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e814801-d848-4c93-975f-c134af310065 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:51.161936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 335/677] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:10:50 2022] GET /identity/v3/role_assignments?user.id=2a6c4a886aec4dd290b13118e2528fb4&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f384ed869fc647d9b0187a4d586cd119 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:51.161936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e814801-d848-4c93-975f-c134af310065 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:51.252358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:51.283898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181914b-9e29-4a8e-938f-01cfc51f18c8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:51.294323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e814801-d848-4c93-975f-c134af310065 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:51.317584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:51.327931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40b08f-8c29-4a14-8f48-46e11ec0279a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:51.328667 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40b08f-8c29-4a14-8f48-46e11ec0279a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:51.328946 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40b08f-8c29-4a14-8f48-46e11ec0279a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:51.329329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40b08f-8c29-4a14-8f48-46e11ec0279a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:51.330119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40b08f-8c29-4a14-8f48-46e11ec0279a None admin] RBAC: Adding query filter params (role.id=f384ed869fc647d9b0187a4d586cd119, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=2c57bac4e0f54d2596fe1fda9a7dfc76) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:51.330421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40b08f-8c29-4a14-8f48-46e11ec0279a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:51.331867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40b08f-8c29-4a14-8f48-46e11ec0279a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:51.338359 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 343/678] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:10:51 2022] GET /identity/v3/role_assignments?user.id=2c57bac4e0f54d2596fe1fda9a7dfc76&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f384ed869fc647d9b0187a4d586cd119 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:51.339163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40b08f-8c29-4a14-8f48-46e11ec0279a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:51.347930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb4400-89a7-4955-98f1-691a5fc06a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:51.348601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb4400-89a7-4955-98f1-691a5fc06a88 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:51.348886 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb4400-89a7-4955-98f1-691a5fc06a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:51.349200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb4400-89a7-4955-98f1-691a5fc06a88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:51.359251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb4400-89a7-4955-98f1-691a5fc06a88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:51.360738 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb4400-89a7-4955-98f1-691a5fc06a88 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:51.377963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-80bb4400-89a7-4955-98f1-691a5fc06a88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:51.377963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:51.377963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:51.377963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:51.377963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:51.377963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:51.377963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:51.377963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:51.377963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:51.377963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:51.377963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:51.377963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:51.377963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:51.377963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:51.377963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:51.378895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:51.379777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:51.379777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:51.379777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:51.379777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:51.379777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:51.379777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:51.379777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:51.379777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:51.382196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 336/679] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:51.384051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46228121-7827-4157-a079-171509d68ff0 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:51.384599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46228121-7827-4157-a079-171509d68ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:51.385067 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46228121-7827-4157-a079-171509d68ff0 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:51.387320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 337/680] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:51.388433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46228121-7827-4157-a079-171509d68ff0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:51.489677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40b08f-8c29-4a14-8f48-46e11ec0279a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:51.521912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46228121-7827-4157-a079-171509d68ff0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:51.528931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa72cd9-096b-41c9-b525-197d2a75f490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:51.529645 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72cd9-096b-41c9-b525-197d2a75f490 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:51.530023 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72cd9-096b-41c9-b525-197d2a75f490 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:51.530371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72cd9-096b-41c9-b525-197d2a75f490 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:51.531662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa72cd9-096b-41c9-b525-197d2a75f490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:51.532049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa72cd9-096b-41c9-b525-197d2a75f490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:51.533535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa72cd9-096b-41c9-b525-197d2a75f490 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:51.548680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 344/681] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:51.550167 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6997371-fe63-46fa-b75c-87600b0b227e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:51.550571 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6997371-fe63-46fa-b75c-87600b0b227e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:51.550942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6997371-fe63-46fa-b75c-87600b0b227e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:51.560663 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:51.570357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e29ea-fb1d-487b-a70d-ac5dafb3713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:51.570974 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e29ea-fb1d-487b-a70d-ac5dafb3713b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:51.571347 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e29ea-fb1d-487b-a70d-ac5dafb3713b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:51.571620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e29ea-fb1d-487b-a70d-ac5dafb3713b None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:51.572234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c6997371-fe63-46fa-b75c-87600b0b227e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:51.572353 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e29ea-fb1d-487b-a70d-ac5dafb3713b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:51.572595 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e29ea-fb1d-487b-a70d-ac5dafb3713b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:51.573718 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c6997371-fe63-46fa-b75c-87600b0b227e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:51.574049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e29ea-fb1d-487b-a70d-ac5dafb3713b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:51.590854 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 338/682] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:51.592830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e29ea-fb1d-487b-a70d-ac5dafb3713b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:51.627689 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:51.656059 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 345/683] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:51.657327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6997371-fe63-46fa-b75c-87600b0b227e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:51.709791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e29ea-fb1d-487b-a70d-ac5dafb3713b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:51.748976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0cb9e-e1ab-45eb-9c6a-bb30729d695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:51.749883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0cb9e-e1ab-45eb-9c6a-bb30729d695a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:51.750334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0cb9e-e1ab-45eb-9c6a-bb30729d695a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:51.750749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0cb9e-e1ab-45eb-9c6a-bb30729d695a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:51.761273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0cb9e-e1ab-45eb-9c6a-bb30729d695a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:51.763753 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0cb9e-e1ab-45eb-9c6a-bb30729d695a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:51.777954 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6997371-fe63-46fa-b75c-87600b0b227e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-e1c0cb9e-e1ab-45eb-9c6a-bb30729d695a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:51.779101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:51.780123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:51.781135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:51.781135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:51.781135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:51.781135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:51.781135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:51.781135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:51.781135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:51.781135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:51.781135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 17:10:51.781135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:51.783232 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 339/684] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:10:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:51.790659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0cb9e-e1ab-45eb-9c6a-bb30729d695a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:51.860633 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c662c6-8896-43fb-86d4-d412d37c99ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:51.861556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c662c6-8896-43fb-86d4-d412d37c99ea None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:51.863092 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c662c6-8896-43fb-86d4-d412d37c99ea None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:51.863387 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:51.863553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c662c6-8896-43fb-86d4-d412d37c99ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:51.864706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c662c6-8896-43fb-86d4-d412d37c99ea None admin] RBAC: Adding query filter params (role.id=f384ed869fc647d9b0187a4d586cd119, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=008cfc0b27d7448b9c84f8087c969e55) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:51.864706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c662c6-8896-43fb-86d4-d412d37c99ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:51.867124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c662c6-8896-43fb-86d4-d412d37c99ea None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:51.888502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 346/685] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:10:51 2022] GET /identity/v3/role_assignments?user.id=008cfc0b27d7448b9c84f8087c969e55&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f384ed869fc647d9b0187a4d586cd119 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:51.975156 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0cb9e-e1ab-45eb-9c6a-bb30729d695a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:52.041671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb2bb5-dfb3-4cf8-9717-0c9bc28f021b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:52.042305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb2bb5-dfb3-4cf8-9717-0c9bc28f021b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:52.042577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb2bb5-dfb3-4cf8-9717-0c9bc28f021b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:52.042840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb2bb5-dfb3-4cf8-9717-0c9bc28f021b None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:52.043724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb2bb5-dfb3-4cf8-9717-0c9bc28f021b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:52.044273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb2bb5-dfb3-4cf8-9717-0c9bc28f021b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:52.045709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb2bb5-dfb3-4cf8-9717-0c9bc28f021b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:52.066715 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 340/686] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Sep 27 17:10:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:52.074951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c662c6-8896-43fb-86d4-d412d37c99ea None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:52.166357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb2bb5-dfb3-4cf8-9717-0c9bc28f021b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:52.181352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:52.264368 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c662c6-8896-43fb-86d4-d412d37c99ea None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:52.299314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cd27c-c8bb-4cae-8914-071bc7fac6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:52.299980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cd27c-c8bb-4cae-8914-071bc7fac6aa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:52.300265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cd27c-c8bb-4cae-8914-071bc7fac6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:52.300534 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cd27c-c8bb-4cae-8914-071bc7fac6aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:52.318372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb2bb5-dfb3-4cf8-9717-0c9bc28f021b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:52.328742 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:52.362166 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60b0cc-22ab-49b3-ae19-38e7218c2f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:52.362803 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60b0cc-22ab-49b3-ae19-38e7218c2f76 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:52.363084 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60b0cc-22ab-49b3-ae19-38e7218c2f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:52.363380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60b0cc-22ab-49b3-ae19-38e7218c2f76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:52.377220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60b0cc-22ab-49b3-ae19-38e7218c2f76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-5b60b0cc-22ab-49b3-ae19-38e7218c2f76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:52.382874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:52.383852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:52.390913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:52.390913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:52.390913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:52.390913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:52.390913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:52.390913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:52.390913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:52.390913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:52.390913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:52.390913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:52.390913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:10:52.390913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:52.390913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 341/687] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:10:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:52.391603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cd27c-c8bb-4cae-8914-071bc7fac6aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:52.392593 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cd27c-c8bb-4cae-8914-071bc7fac6aa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:52.394628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60b0cc-22ab-49b3-ae19-38e7218c2f76 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:52.459106 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:52.530981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60b0cc-22ab-49b3-ae19-38e7218c2f76 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:52.570639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d778d78-5bce-4e2a-b924-5a8d100d952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:52.571302 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d778d78-5bce-4e2a-b924-5a8d100d952b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:52.571640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d778d78-5bce-4e2a-b924-5a8d100d952b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:52.571904 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d778d78-5bce-4e2a-b924-5a8d100d952b None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:52.572564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d778d78-5bce-4e2a-b924-5a8d100d952b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:52.572864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d778d78-5bce-4e2a-b924-5a8d100d952b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:52.574285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d778d78-5bce-4e2a-b924-5a8d100d952b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:52.585014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 342/688] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:52.591031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d778d78-5bce-4e2a-b924-5a8d100d952b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:52.593661 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 347/689] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:52.598873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cd27c-c8bb-4cae-8914-071bc7fac6aa None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:52.621746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:52.702600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d778d78-5bce-4e2a-b924-5a8d100d952b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:52.770100 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794b176-3140-44d8-b9b3-595d5f0511b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:52.770736 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794b176-3140-44d8-b9b3-595d5f0511b2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:52.771016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794b176-3140-44d8-b9b3-595d5f0511b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:52.771293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794b176-3140-44d8-b9b3-595d5f0511b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:52.783712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794b176-3140-44d8-b9b3-595d5f0511b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:52.785087 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794b176-3140-44d8-b9b3-595d5f0511b2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-3794b176-3140-44d8-b9b3-595d5f0511b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:52.799600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:52.800531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:52.801828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:52.801828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:52.801828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:52.801828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 343/690] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:52.806381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794b176-3140-44d8-b9b3-595d5f0511b2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:52.818751 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cd27c-c8bb-4cae-8914-071bc7fac6aa None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:52.864793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3dae7-bcb8-4368-a754-1f15d27638bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:52.865438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3dae7-bcb8-4368-a754-1f15d27638bf None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:52.865705 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3dae7-bcb8-4368-a754-1f15d27638bf None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:52.865988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3dae7-bcb8-4368-a754-1f15d27638bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:52.878029 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3dae7-bcb8-4368-a754-1f15d27638bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:52.879726 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3dae7-bcb8-4368-a754-1f15d27638bf None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:52.882352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-7ba3dae7-bcb8-4368-a754-1f15d27638bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:52.897799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:52.898750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:52.899916 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:52.899916 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:52.899916 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:52.899916 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 348/691] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:10:52.905167 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3dae7-bcb8-4368-a754-1f15d27638bf None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:52.989247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:53.026397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794b176-3140-44d8-b9b3-595d5f0511b2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:53.095728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fab3f7-c3dc-4448-a2f9-132e233312bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:53.096359 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fab3f7-c3dc-4448-a2f9-132e233312bc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:53.096641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fab3f7-c3dc-4448-a2f9-132e233312bc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:53.096909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fab3f7-c3dc-4448-a2f9-132e233312bc None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:53.097545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fab3f7-c3dc-4448-a2f9-132e233312bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:53.097873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fab3f7-c3dc-4448-a2f9-132e233312bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:53.099292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fab3f7-c3dc-4448-a2f9-132e233312bc None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:53.113730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 344/692] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:53.119060 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fab3f7-c3dc-4448-a2f9-132e233312bc None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:53.133488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3dae7-bcb8-4368-a754-1f15d27638bf None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:53.186787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32f4a4-b19c-428c-b836-0bee996a9c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:53.187398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32f4a4-b19c-428c-b836-0bee996a9c4a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:53.187673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32f4a4-b19c-428c-b836-0bee996a9c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:53.187939 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32f4a4-b19c-428c-b836-0bee996a9c4a None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:53.193708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32f4a4-b19c-428c-b836-0bee996a9c4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:53.193708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32f4a4-b19c-428c-b836-0bee996a9c4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:53.193708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32f4a4-b19c-428c-b836-0bee996a9c4a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:53.204844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 349/693] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:53.210162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32f4a4-b19c-428c-b836-0bee996a9c4a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:53.273478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:53.330284 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32f4a4-b19c-428c-b836-0bee996a9c4a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:53.352982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fab3f7-c3dc-4448-a2f9-132e233312bc None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:53.398694 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f297d3-c7a8-495d-8646-ce20492636b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:53.399676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f297d3-c7a8-495d-8646-ce20492636b8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:53.400173 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f297d3-c7a8-495d-8646-ce20492636b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:53.400645 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f297d3-c7a8-495d-8646-ce20492636b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:53.416006 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f297d3-c7a8-495d-8646-ce20492636b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:53.418666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f297d3-c7a8-495d-8646-ce20492636b8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:53.423724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec33eb-59fb-415d-86b1-ba959a924d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:53.424756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec33eb-59fb-415d-86b1-ba959a924d14 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:53.425872 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec33eb-59fb-415d-86b1-ba959a924d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:53.426555 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec33eb-59fb-415d-86b1-ba959a924d14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:53.443411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f8f297d3-c7a8-495d-8646-ce20492636b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:53.443411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:53.443411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:53.443411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:53.443411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:53.443411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:53.443411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:53.443411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:53.443411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:53.443411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:53.443411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:53.443411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:53.443411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:53.443411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:53.443411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:53.444333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:53.445239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:53.445239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:53.445239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:53.445239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:53.445239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:53.445239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:53.445239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:53.445239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:53.445658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec33eb-59fb-415d-86b1-ba959a924d14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:53.447633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec33eb-59fb-415d-86b1-ba959a924d14 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:53.448334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 350/694] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:53.454238 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f297d3-c7a8-495d-8646-ce20492636b8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:53.454521 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-ebec33eb-59fb-415d-86b1-ba959a924d14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:53.466857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:53.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:53.468838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:53.468838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:53.468838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:53.468838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:53.468838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:53.468838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:53.468838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:53.468838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:53.468838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:10:53.468838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:53.471497 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 345/695] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Sep 27 17:10:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:53.476683 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec33eb-59fb-415d-86b1-ba959a924d14 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:53.638563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec33eb-59fb-415d-86b1-ba959a924d14 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:53.660311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f297d3-c7a8-495d-8646-ce20492636b8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:53.680691 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:53.684586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320c9c3-c762-409f-bf4c-01069f4538de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:53.685246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320c9c3-c762-409f-bf4c-01069f4538de None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:53.685530 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320c9c3-c762-409f-bf4c-01069f4538de None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:53.685890 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320c9c3-c762-409f-bf4c-01069f4538de None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:53.686634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320c9c3-c762-409f-bf4c-01069f4538de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:53.686943 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320c9c3-c762-409f-bf4c-01069f4538de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:53.690083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320c9c3-c762-409f-bf4c-01069f4538de None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:53.705044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fceb2d1-20e0-4fdb-afe0-de90f30c77e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:53.706115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fceb2d1-20e0-4fdb-afe0-de90f30c77e7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:53.706597 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fceb2d1-20e0-4fdb-afe0-de90f30c77e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:53.707623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fceb2d1-20e0-4fdb-afe0-de90f30c77e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:53.709072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fceb2d1-20e0-4fdb-afe0-de90f30c77e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:53.709583 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fceb2d1-20e0-4fdb-afe0-de90f30c77e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:53.710892 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 346/696] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Sep 27 17:10:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:53.711447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fceb2d1-20e0-4fdb-afe0-de90f30c77e7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:53.712124 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec3b86-8d01-4e6d-b08b-a6262ae93ee0 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:53.712410 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec3b86-8d01-4e6d-b08b-a6262ae93ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:53.712686 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec3b86-8d01-4e6d-b08b-a6262ae93ee0 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:53.718235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 347/697] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:53.722796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec3b86-8d01-4e6d-b08b-a6262ae93ee0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:53.742108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 351/698] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:53.742108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d4ff2-9313-479f-a611-a8afd3c42f26 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:53.742108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d4ff2-9313-479f-a611-a8afd3c42f26 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:53.742108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d4ff2-9313-479f-a611-a8afd3c42f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:53.769381 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2c6d4ff2-9313-479f-a611-a8afd3c42f26 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:53.770945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2c6d4ff2-9313-479f-a611-a8afd3c42f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:53.797862 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:53.859140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec3b86-8d01-4e6d-b08b-a6262ae93ee0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:53.865560 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 352/699] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:53.865560 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d4ff2-9313-479f-a611-a8afd3c42f26 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:53.932080 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc3f66-33e9-40f7-9583-dd30c0691432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:53.932615 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc3f66-33e9-40f7-9583-dd30c0691432 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:53.932899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc3f66-33e9-40f7-9583-dd30c0691432 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:53.933170 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc3f66-33e9-40f7-9583-dd30c0691432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:54.070813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d4ff2-9313-479f-a611-a8afd3c42f26 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:54.073050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc3f66-33e9-40f7-9583-dd30c0691432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:54.075076 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc3f66-33e9-40f7-9583-dd30c0691432 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:54.085714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:54.137726 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06737c2a-6bf3-40d0-b7d2-4d5cf75ae0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:54.138341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06737c2a-6bf3-40d0-b7d2-4d5cf75ae0be None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:54.138618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06737c2a-6bf3-40d0-b7d2-4d5cf75ae0be None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:54.138888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06737c2a-6bf3-40d0-b7d2-4d5cf75ae0be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:54.139666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06737c2a-6bf3-40d0-b7d2-4d5cf75ae0be None admin] RBAC: Adding query filter params (role.id=f384ed869fc647d9b0187a4d586cd119, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=87a74ab0288847a7bb8b63756985e509) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:54.139971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06737c2a-6bf3-40d0-b7d2-4d5cf75ae0be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:54.141397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06737c2a-6bf3-40d0-b7d2-4d5cf75ae0be None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:54.153710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 353/700] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:10:53 2022] GET /identity/v3/role_assignments?user.id=87a74ab0288847a7bb8b63756985e509&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f384ed869fc647d9b0187a4d586cd119 => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:54.153710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc52f51-f482-4208-9c55-fa705a44f57d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:54.153710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc52f51-f482-4208-9c55-fa705a44f57d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:54.153710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc52f51-f482-4208-9c55-fa705a44f57d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:54.157851 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 354/701] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:54.159364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abde85-bda3-4d71-8908-81c1218b4f09 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:54.159713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abde85-bda3-4d71-8908-81c1218b4f09 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:54.160093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abde85-bda3-4d71-8908-81c1218b4f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:54.181412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:54.184319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e1abde85-bda3-4d71-8908-81c1218b4f09 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:54.185232 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e1abde85-bda3-4d71-8908-81c1218b4f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:54.244846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 348/702] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:54.245899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc3f66-33e9-40f7-9583-dd30c0691432 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:54.278065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 355/703] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:54.279106 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abde85-bda3-4d71-8908-81c1218b4f09 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:54.394347 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:54.396980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc3f66-33e9-40f7-9583-dd30c0691432 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:54.397420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abde85-bda3-4d71-8908-81c1218b4f09 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:54.444149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c598893-b64e-4568-b8fc-a4ce17d9a626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:54.444785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c598893-b64e-4568-b8fc-a4ce17d9a626 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:54.445152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c598893-b64e-4568-b8fc-a4ce17d9a626 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:54.445372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c598893-b64e-4568-b8fc-a4ce17d9a626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:54.449960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4231d-5978-4509-9f75-ee145cceaa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:54.450828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4231d-5978-4509-9f75-ee145cceaa01 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:54.451307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4231d-5978-4509-9f75-ee145cceaa01 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:54.451777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4231d-5978-4509-9f75-ee145cceaa01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:54.457598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c598893-b64e-4568-b8fc-a4ce17d9a626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:54.459336 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c598893-b64e-4568-b8fc-a4ce17d9a626 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:54.464460 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4231d-5978-4509-9f75-ee145cceaa01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:54.466703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4231d-5978-4509-9f75-ee145cceaa01 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-0c598893-b64e-4568-b8fc-a4ce17d9a626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:54.477124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:54.478130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:54.479020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:54.479020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:54.479020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:54.479020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 356/704] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:54.484087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c598893-b64e-4568-b8fc-a4ce17d9a626 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-b1a4231d-5978-4509-9f75-ee145cceaa01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:54.487408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:54.488367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:54.489266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:54.489266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:54.489266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:54.491292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 349/705] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:54.498749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4231d-5978-4509-9f75-ee145cceaa01 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:54.514444 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:54.622875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c598893-b64e-4568-b8fc-a4ce17d9a626 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:54.630076 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4231d-5978-4509-9f75-ee145cceaa01 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:54.670951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a6dad-986e-474b-9980-0c78c26cd4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:54.671572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a6dad-986e-474b-9980-0c78c26cd4dc None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:54.671854 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a6dad-986e-474b-9980-0c78c26cd4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:54.672124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a6dad-986e-474b-9980-0c78c26cd4dc None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:54.672884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a6dad-986e-474b-9980-0c78c26cd4dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:54.673192 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a6dad-986e-474b-9980-0c78c26cd4dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:54.674625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a6dad-986e-474b-9980-0c78c26cd4dc None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:54.677012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9141ab-001a-47da-a82f-e7e90beed7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:54.678144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9141ab-001a-47da-a82f-e7e90beed7bc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:54.678564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9141ab-001a-47da-a82f-e7e90beed7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:54.678988 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9141ab-001a-47da-a82f-e7e90beed7bc None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:54.679780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9141ab-001a-47da-a82f-e7e90beed7bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:54.680234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9141ab-001a-47da-a82f-e7e90beed7bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:54.681788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9141ab-001a-47da-a82f-e7e90beed7bc None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:54.686907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 357/706] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:54.687731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a6dad-986e-474b-9980-0c78c26cd4dc None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:54.695306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 350/707] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:10:54.696818 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f310479-fcec-4139-88ee-6fdce7210878 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:54.697258 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f310479-fcec-4139-88ee-6fdce7210878 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:54.697668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f310479-fcec-4139-88ee-6fdce7210878 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:54.699995 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 351/708] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:54.700965 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f310479-fcec-4139-88ee-6fdce7210878 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:54.702654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:54.778464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:54.794582 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a6dad-986e-474b-9980-0c78c26cd4dc None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:54.810589 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f310479-fcec-4139-88ee-6fdce7210878 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:54.830551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b0c88-43fc-47e7-b703-c8fd6b564ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:54.831521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b0c88-43fc-47e7-b703-c8fd6b564ffb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:54.831800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b0c88-43fc-47e7-b703-c8fd6b564ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:54.832069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b0c88-43fc-47e7-b703-c8fd6b564ffb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:54.832650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b0c88-43fc-47e7-b703-c8fd6b564ffb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:54.834409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b0c88-43fc-47e7-b703-c8fd6b564ffb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-444b0c88-43fc-47e7-b703-c8fd6b564ffb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:54.845892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:54.846925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:54.847762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:54.847762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:54.847762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:54.847762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:54.847762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:54.847762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:54.847762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:54.847762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:54.847762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:54.847762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:54.847762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:10:54.847762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:10:54.847762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 17:10:54.847762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:54.849167 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30a0d9-4254-4770-a4a4-513e75967a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:54.849167 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30a0d9-4254-4770-a4a4-513e75967a7a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:54.849167 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30a0d9-4254-4770-a4a4-513e75967a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:54.849167 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30a0d9-4254-4770-a4a4-513e75967a7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:54.851719 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 358/709] 10.222.0.57 () {56 vars in 1129 bytes} [Tue Sep 27 17:10:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:54.852423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b0c88-43fc-47e7-b703-c8fd6b564ffb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:54.855026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30a0d9-4254-4770-a4a4-513e75967a7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:54.857002 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30a0d9-4254-4770-a4a4-513e75967a7a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:54.869095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-8e30a0d9-4254-4770-a4a4-513e75967a7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:54.869095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:54.869095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:54.869095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:54.869095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:54.869095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:54.869095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:54.869095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:54.869095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:54.869095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:54.869095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:54.869095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:54.869095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:10:54.869095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:10:54.869095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:54.870045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:54.870957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:10:54.870957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:10:54.870957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:10:54.870957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:10:54.870957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:10:54.870957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:10:54.870957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:10:54.870957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:54.870957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 352/710] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:54.873027 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aafc83-ad43-4445-8e73-dea17c1c8e33 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:54.873027 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aafc83-ad43-4445-8e73-dea17c1c8e33 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:54.873027 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aafc83-ad43-4445-8e73-dea17c1c8e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:54.893412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b0aafc83-ad43-4445-8e73-dea17c1c8e33 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:54.894633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b0aafc83-ad43-4445-8e73-dea17c1c8e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:54.941243 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:54.969609 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b0c88-43fc-47e7-b703-c8fd6b564ffb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:54.970691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 353/711] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:54.974559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aafc83-ad43-4445-8e73-dea17c1c8e33 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:55.005647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281d819-487d-4bc4-99ec-43a995d2d5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:55.006295 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281d819-487d-4bc4-99ec-43a995d2d5b2 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:55.006571 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281d819-487d-4bc4-99ec-43a995d2d5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:55.006843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281d819-487d-4bc4-99ec-43a995d2d5b2 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:55.007542 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281d819-487d-4bc4-99ec-43a995d2d5b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:55.009043 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281d819-487d-4bc4-99ec-43a995d2d5b2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:55.038315 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 359/712] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:10:54 2022] POST /identity/v3/users => generated 254 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:10:55.039605 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281d819-487d-4bc4-99ec-43a995d2d5b2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:55.061640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:55.121967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aafc83-ad43-4445-8e73-dea17c1c8e33 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:55.179977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281d819-487d-4bc4-99ec-43a995d2d5b2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:55.184313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dfbc2-8268-4ef2-afdc-fe3802ae9cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:55.185101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dfbc2-8268-4ef2-afdc-fe3802ae9cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:55.185663 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dfbc2-8268-4ef2-afdc-fe3802ae9cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:55.186089 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dfbc2-8268-4ef2-afdc-fe3802ae9cf0 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:55.186960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dfbc2-8268-4ef2-afdc-fe3802ae9cf0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:55.187397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dfbc2-8268-4ef2-afdc-fe3802ae9cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:55.189019 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dfbc2-8268-4ef2-afdc-fe3802ae9cf0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:55.195083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 354/713] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Sep 27 17:10:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:55.201260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dfbc2-8268-4ef2-afdc-fe3802ae9cf0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:55.222230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:55.229438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9437f-480a-483c-9cab-5c103dbef7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:55.230103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9437f-480a-483c-9cab-5c103dbef7ba None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:55.230384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9437f-480a-483c-9cab-5c103dbef7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:55.231330 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9437f-480a-483c-9cab-5c103dbef7ba None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:55.232410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9437f-480a-483c-9cab-5c103dbef7ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:55.232410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9437f-480a-483c-9cab-5c103dbef7ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:55.240057 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9437f-480a-483c-9cab-5c103dbef7ba None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:55.270739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 360/714] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:10:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:55.276140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9437f-480a-483c-9cab-5c103dbef7ba None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:55.362768 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dfbc2-8268-4ef2-afdc-fe3802ae9cf0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:55.397895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:55.408781 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95aac3-0aa7-4edf-bee6-502c9a03f8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:55.409404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95aac3-0aa7-4edf-bee6-502c9a03f8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:55.409736 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95aac3-0aa7-4edf-bee6-502c9a03f8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:55.409989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95aac3-0aa7-4edf-bee6-502c9a03f8e6 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:55.411031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9437f-480a-483c-9cab-5c103dbef7ba None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:55.411143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95aac3-0aa7-4edf-bee6-502c9a03f8e6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:55.411143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95aac3-0aa7-4edf-bee6-502c9a03f8e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:55.412381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95aac3-0aa7-4edf-bee6-502c9a03f8e6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:55.424172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 355/715] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Sep 27 17:10:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:55.424837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95aac3-0aa7-4edf-bee6-502c9a03f8e6 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:55.489589 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9400f6f-b76f-49e3-b09c-a7e8bef32439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:55.491058 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9400f6f-b76f-49e3-b09c-a7e8bef32439 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:55.491790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9400f6f-b76f-49e3-b09c-a7e8bef32439 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:55.492497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9400f6f-b76f-49e3-b09c-a7e8bef32439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:55.494052 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9400f6f-b76f-49e3-b09c-a7e8bef32439 None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=e75b03fde75e411bace8d406237a7e50) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:55.494873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9400f6f-b76f-49e3-b09c-a7e8bef32439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:55.498730 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9400f6f-b76f-49e3-b09c-a7e8bef32439 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:55.512449 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 361/716] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:10:55 2022] GET /identity/v3/role_assignments?user.id=e75b03fde75e411bace8d406237a7e50&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:55.581244 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95aac3-0aa7-4edf-bee6-502c9a03f8e6 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:55.625147 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0f404-1423-4192-8eef-6bda82648afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:55.626216 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0f404-1423-4192-8eef-6bda82648afe None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:55.626728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0f404-1423-4192-8eef-6bda82648afe None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:55.627215 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0f404-1423-4192-8eef-6bda82648afe None admin] PATH_INFO: `/v3/services/network` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:55.628051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0f404-1423-4192-8eef-6bda82648afe None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:55.629717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0f404-1423-4192-8eef-6bda82648afe None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-c7f0f404-1423-4192-8eef-6bda82648afe None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:55.645574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:55.646915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:55.647976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:55.647976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:55.647976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:55.647976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:55.647976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:55.647976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:55.647976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:55.647976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:55.647976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:55.647976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:55.647976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:10:55.647976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:10:55.647976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 17:10:55.647976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:55.650687 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 356/717] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:10:55 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:55.657473 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9400f6f-b76f-49e3-b09c-a7e8bef32439 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:55.726409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:55.779806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9400f6f-b76f-49e3-b09c-a7e8bef32439 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:55.831404 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba207ac0-ad24-4b82-93b7-e6183ac51197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:55.832026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba207ac0-ad24-4b82-93b7-e6183ac51197 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:55.832308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba207ac0-ad24-4b82-93b7-e6183ac51197 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:55.832582 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba207ac0-ad24-4b82-93b7-e6183ac51197 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:55.833220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba207ac0-ad24-4b82-93b7-e6183ac51197 None admin] RBAC: Adding query filter params (name=network) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:55.833816 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba207ac0-ad24-4b82-93b7-e6183ac51197 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:55.835190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba207ac0-ad24-4b82-93b7-e6183ac51197 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:55.841987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 362/718] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Sep 27 17:10:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:55.847251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0f404-1423-4192-8eef-6bda82648afe None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:55.932221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:55.986336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0f404-1423-4192-8eef-6bda82648afe None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:56.029421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf589c01-3a2d-4f60-a093-1926b7361a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:56.030117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589c01-3a2d-4f60-a093-1926b7361a1c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:56.030340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589c01-3a2d-4f60-a093-1926b7361a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:56.030612 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589c01-3a2d-4f60-a093-1926b7361a1c None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:56.031242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf589c01-3a2d-4f60-a093-1926b7361a1c None admin] RBAC: Adding query filter params (type=network) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:56.031543 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf589c01-3a2d-4f60-a093-1926b7361a1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:56.032904 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf589c01-3a2d-4f60-a093-1926b7361a1c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:56.039433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 357/719] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Sep 27 17:10:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:56.825488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a89be-c92c-41a4-a143-aba30d79edd9 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:56.826033 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a89be-c92c-41a4-a143-aba30d79edd9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:56.826033 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a89be-c92c-41a4-a143-aba30d79edd9 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:56.827690 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 363/720] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:56.832733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adbb82-bf21-429d-941d-a077015fa2c1 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:56.833015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adbb82-bf21-429d-941d-a077015fa2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:56.833286 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adbb82-bf21-429d-941d-a077015fa2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:56.866637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d1adbb82-bf21-429d-941d-a077015fa2c1 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:56.867810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d1adbb82-bf21-429d-941d-a077015fa2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:57.080663 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 358/721] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 17:10:57.507089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a89be-c92c-41a4-a143-aba30d79edd9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:57.644777 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a89be-c92c-41a4-a143-aba30d79edd9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:57.670025 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:57.691726 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a1246-0768-474a-b673-27b58517f0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:57.692372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a1246-0768-474a-b673-27b58517f0ef None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:57.692650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a1246-0768-474a-b673-27b58517f0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:57.692923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a1246-0768-474a-b673-27b58517f0ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:57.707270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a1246-0768-474a-b673-27b58517f0ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8b7a1246-0768-474a-b673-27b58517f0ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:57.712253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:57.713185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:57.714103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:57.714103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:57.714103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:57.714103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:57.714103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:57.714103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:57.714103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:57.714103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:57.714103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:57.714103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:57.714103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:10:57.714103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:57.714820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 364/722] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:10:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:57.719399 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1adbb82-bf21-429d-941d-a077015fa2c1 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:57.768644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:57.826547 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1adbb82-bf21-429d-941d-a077015fa2c1 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:57.869462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf8c33-8260-4a83-9112-58cc6a00b77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:57.870316 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf8c33-8260-4a83-9112-58cc6a00b77d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:57.870480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf8c33-8260-4a83-9112-58cc6a00b77d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:57.870631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf8c33-8260-4a83-9112-58cc6a00b77d None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:57.872125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf8c33-8260-4a83-9112-58cc6a00b77d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:57.872735 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf8c33-8260-4a83-9112-58cc6a00b77d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:57.874147 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf8c33-8260-4a83-9112-58cc6a00b77d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:57.884292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 359/723] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:57.889745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a1246-0768-474a-b673-27b58517f0ef None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:57.997287 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57e22c-fb2f-4ee7-82b1-a590edde8cb6 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:57.997520 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57e22c-fb2f-4ee7-82b1-a590edde8cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:57.997754 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57e22c-fb2f-4ee7-82b1-a590edde8cb6 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:57.999086 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 360/724] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:10:58.013442 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aff667-c41c-48e0-bd5e-706e791c0eed None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:58.013839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aff667-c41c-48e0-bd5e-706e791c0eed None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:58.014042 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aff667-c41c-48e0-bd5e-706e791c0eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:58.037764 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a1246-0768-474a-b673-27b58517f0ef None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:58.045746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-59aff667-c41c-48e0-bd5e-706e791c0eed None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:58.046923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-59aff667-c41c-48e0-bd5e-706e791c0eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:58.106962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbad20-7fcf-4c9e-9137-0b1f3bc3c7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:58.107607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbad20-7fcf-4c9e-9137-0b1f3bc3c7ae None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:58.107887 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbad20-7fcf-4c9e-9137-0b1f3bc3c7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:58.108155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbad20-7fcf-4c9e-9137-0b1f3bc3c7ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:58.123659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbad20-7fcf-4c9e-9137-0b1f3bc3c7ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:58.125537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbad20-7fcf-4c9e-9137-0b1f3bc3c7ae None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-08dbad20-7fcf-4c9e-9137-0b1f3bc3c7ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:58.156850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:58.157942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:58.158847 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:58.158847 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:58.158847 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:58.160710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 365/725] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:58.167276 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 361/726] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:58.169563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbad20-7fcf-4c9e-9137-0b1f3bc3c7ae None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:58.222187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:58.250994 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396970a-7627-48c0-b716-b085b58188fd None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:58.251300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396970a-7627-48c0-b716-b085b58188fd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:58.251464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396970a-7627-48c0-b716-b085b58188fd None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:58.253037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 362/727] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:58.258304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e600c1-c11b-4c1b-9089-235533d5ca4b None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:58.258900 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e600c1-c11b-4c1b-9089-235533d5ca4b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:58.259319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e600c1-c11b-4c1b-9089-235533d5ca4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:58.299150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-55e600c1-c11b-4c1b-9089-235533d5ca4b None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:58.300358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-55e600c1-c11b-4c1b-9089-235533d5ca4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:58.360318 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbad20-7fcf-4c9e-9137-0b1f3bc3c7ae None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:58.371235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:58.430552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f331348-6007-47e6-96f9-8254bd1ade5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:58.431965 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f331348-6007-47e6-96f9-8254bd1ade5a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:58.432420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f331348-6007-47e6-96f9-8254bd1ade5a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:58.432840 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f331348-6007-47e6-96f9-8254bd1ade5a None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:58.434493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f331348-6007-47e6-96f9-8254bd1ade5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:58.434952 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f331348-6007-47e6-96f9-8254bd1ade5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:58.436470 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f331348-6007-47e6-96f9-8254bd1ade5a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:58.452477 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 363/728] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:58.459268 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 366/729] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:58.464571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e600c1-c11b-4c1b-9089-235533d5ca4b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:58.464924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccbc66-6f81-44c7-9dc0-18800d2e123e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:58.465145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccbc66-6f81-44c7-9dc0-18800d2e123e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:58.465396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccbc66-6f81-44c7-9dc0-18800d2e123e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:58.466981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 367/730] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:58.468024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccbc66-6f81-44c7-9dc0-18800d2e123e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:58.567776 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:58.580090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccbc66-6f81-44c7-9dc0-18800d2e123e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:58.581707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e600c1-c11b-4c1b-9089-235533d5ca4b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:58.616585 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23fc92-52f0-45b9-80ef-2077ae1710b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:58.617454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23fc92-52f0-45b9-80ef-2077ae1710b8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:58.618192 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23fc92-52f0-45b9-80ef-2077ae1710b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:58.618468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23fc92-52f0-45b9-80ef-2077ae1710b8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:58.623800 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fde114-5d39-4a0e-a413-f660659945c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:58.624512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fde114-5d39-4a0e-a413-f660659945c8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:58.624868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fde114-5d39-4a0e-a413-f660659945c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:58.625218 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fde114-5d39-4a0e-a413-f660659945c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:58.626345 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23fc92-52f0-45b9-80ef-2077ae1710b8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:58.628070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23fc92-52f0-45b9-80ef-2077ae1710b8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:58.636581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fde114-5d39-4a0e-a413-f660659945c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-4e23fc92-52f0-45b9-80ef-2077ae1710b8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:58.641532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:58.642478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:58.643401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:58.643401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:58.643401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:58.643401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:58.643401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:58.643401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:58.643401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:58.643401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:58.643401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 17:10:58.643401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-50fde114-5d39-4a0e-a413-f660659945c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:58.643936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:58.644763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:58.645588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:58.645588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:58.645588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:58.645588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:58.645588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:58.645588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:58.645588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:58.645588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:58.645588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:58.645588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:58.645588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:10:58.645588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:58.647177 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 368/731] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:10:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:58.647177 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4c5f1-d538-47e8-ba2f-551bb4e16226 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:58.647177 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4c5f1-d538-47e8-ba2f-551bb4e16226 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:58.647177 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4c5f1-d538-47e8-ba2f-551bb4e16226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:58.651952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 364/732] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:10:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:58.651952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fde114-5d39-4a0e-a413-f660659945c8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:58.667713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-43b4c5f1-d538-47e8-ba2f-551bb4e16226 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:58.669547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-43b4c5f1-d538-47e8-ba2f-551bb4e16226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:58.681840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:58.757470 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 369/733] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:58.758340 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4c5f1-d538-47e8-ba2f-551bb4e16226 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:58.781401 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fde114-5d39-4a0e-a413-f660659945c8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:58.826239 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0fe65-355f-4280-82fe-4f45e6b05efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:58.826917 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0fe65-355f-4280-82fe-4f45e6b05efe None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:58.827201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0fe65-355f-4280-82fe-4f45e6b05efe None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:58.827480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0fe65-355f-4280-82fe-4f45e6b05efe None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:58.828148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0fe65-355f-4280-82fe-4f45e6b05efe None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:58.828456 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0fe65-355f-4280-82fe-4f45e6b05efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:58.830516 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0fe65-355f-4280-82fe-4f45e6b05efe None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:58.845784 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 365/734] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:10:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:58.846998 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0fe65-355f-4280-82fe-4f45e6b05efe None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:58.850578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:58.872248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4c5f1-d538-47e8-ba2f-551bb4e16226 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:58.909747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44c7b0-0fd6-4a1b-ab98-ef51e3ce6adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:58.910419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44c7b0-0fd6-4a1b-ab98-ef51e3ce6adc None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:58.910721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44c7b0-0fd6-4a1b-ab98-ef51e3ce6adc None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:58.910968 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44c7b0-0fd6-4a1b-ab98-ef51e3ce6adc None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:58.911689 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44c7b0-0fd6-4a1b-ab98-ef51e3ce6adc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:58.911990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44c7b0-0fd6-4a1b-ab98-ef51e3ce6adc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:58.913415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44c7b0-0fd6-4a1b-ab98-ef51e3ce6adc None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:58.930971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 370/735] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Sep 27 17:10:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:58.931762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44c7b0-0fd6-4a1b-ab98-ef51e3ce6adc None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:58.950237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:58.959782 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0fe65-355f-4280-82fe-4f45e6b05efe None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:58.996868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dc251-5c99-4c90-832b-1dd1e7f72783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:58.997656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dc251-5c99-4c90-832b-1dd1e7f72783 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:58.997963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dc251-5c99-4c90-832b-1dd1e7f72783 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:58.998241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dc251-5c99-4c90-832b-1dd1e7f72783 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:59.007997 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dc251-5c99-4c90-832b-1dd1e7f72783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-169dc251-5c99-4c90-832b-1dd1e7f72783 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:10:59.014729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:59.015923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:59.016960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:59.016960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:59.016960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:59.016960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:59.016960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:10:59.016960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:10:59.016960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:10:59.016960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:10:59.016960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:10:59.016960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:10:59.016960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:10:59.016960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:59.017837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 366/736] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:59.019109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9db78-5b54-4fd8-b6f4-2cd12329bc33 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:59.019607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9db78-5b54-4fd8-b6f4-2cd12329bc33 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:59.020102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9db78-5b54-4fd8-b6f4-2cd12329bc33 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:59.021766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 367/737] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:10:59.022454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9db78-5b54-4fd8-b6f4-2cd12329bc33 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:59.047496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44c7b0-0fd6-4a1b-ab98-ef51e3ce6adc None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:59.083048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3c17e-aeac-43c1-ba09-d8b7bee436af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:59.083860 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3c17e-aeac-43c1-ba09-d8b7bee436af None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:59.084139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3c17e-aeac-43c1-ba09-d8b7bee436af None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:59.084405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3c17e-aeac-43c1-ba09-d8b7bee436af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:59.093274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:59.095609 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3c17e-aeac-43c1-ba09-d8b7bee436af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:59.097542 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3c17e-aeac-43c1-ba09-d8b7bee436af None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-bed3c17e-aeac-43c1-ba09-d8b7bee436af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:59.114409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:59.115564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:59.116434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:59.116434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:59.116434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:59.116434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 371/738] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:59.116434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3c17e-aeac-43c1-ba09-d8b7bee436af None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:59.130845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9db78-5b54-4fd8-b6f4-2cd12329bc33 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:59.164030 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3037e1-72b3-45de-9d58-dcb91b1d9e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:59.164636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3037e1-72b3-45de-9d58-dcb91b1d9e0a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:59.164912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3037e1-72b3-45de-9d58-dcb91b1d9e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:59.165182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3037e1-72b3-45de-9d58-dcb91b1d9e0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:59.184720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:59.216258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3c17e-aeac-43c1-ba09-d8b7bee436af None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:59.234204 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3037e1-72b3-45de-9d58-dcb91b1d9e0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:59.235640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3037e1-72b3-45de-9d58-dcb91b1d9e0a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:59.249758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faa613-13c7-483f-89b3-bc65ac615e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:59.250358 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faa613-13c7-483f-89b3-bc65ac615e52 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:59.250634 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faa613-13c7-483f-89b3-bc65ac615e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:59.250906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faa613-13c7-483f-89b3-bc65ac615e52 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:59.251565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10faa613-13c7-483f-89b3-bc65ac615e52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:59.251868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10faa613-13c7-483f-89b3-bc65ac615e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:59.253216 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10faa613-13c7-483f-89b3-bc65ac615e52 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:59.260984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 372/739] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:10:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:59.262214 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff79ab7-8cf7-4063-91a1-139ca8a62592 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:59.262498 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff79ab7-8cf7-4063-91a1-139ca8a62592 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:59.262772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff79ab7-8cf7-4063-91a1-139ca8a62592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:59.280309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-bff79ab7-8cf7-4063-91a1-139ca8a62592 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:10:59.281513 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bff79ab7-8cf7-4063-91a1-139ca8a62592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:10:59.330055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:59.338707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 368/740] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 17:10:59.339450 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3037e1-72b3-45de-9d58-dcb91b1d9e0a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:59.351386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 373/741] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 17:10:59.352407 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff79ab7-8cf7-4063-91a1-139ca8a62592 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:59.405740 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:59.453776 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff79ab7-8cf7-4063-91a1-139ca8a62592 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:59.471275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3037e1-72b3-45de-9d58-dcb91b1d9e0a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:59.490508 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca900ad-1a51-452f-a97e-3324715bbcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:59.491117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca900ad-1a51-452f-a97e-3324715bbcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:59.491393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca900ad-1a51-452f-a97e-3324715bbcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:59.491663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca900ad-1a51-452f-a97e-3324715bbcc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:59.492308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca900ad-1a51-452f-a97e-3324715bbcc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:10:59.492610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca900ad-1a51-452f-a97e-3324715bbcc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:59.494010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca900ad-1a51-452f-a97e-3324715bbcc3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:59.506621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 374/742] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:10:59.507508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334445e-e360-46be-b4d5-843b419f2438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:59.508110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334445e-e360-46be-b4d5-843b419f2438 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:59.508389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334445e-e360-46be-b4d5-843b419f2438 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:59.508656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334445e-e360-46be-b4d5-843b419f2438 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:59.509294 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334445e-e360-46be-b4d5-843b419f2438 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:59.510684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334445e-e360-46be-b4d5-843b419f2438 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:59.512268 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca900ad-1a51-452f-a97e-3324715bbcc3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:59.529317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 369/743] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Sep 27 17:10:59 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:10:59.530747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334445e-e360-46be-b4d5-843b419f2438 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:59.571070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:59.653310 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca900ad-1a51-452f-a97e-3324715bbcc3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:59.691341 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334445e-e360-46be-b4d5-843b419f2438 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:59.697015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfb97d-8f7f-4ac3-8ff4-600202dfe490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:59.697655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfb97d-8f7f-4ac3-8ff4-600202dfe490 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:59.698027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfb97d-8f7f-4ac3-8ff4-600202dfe490 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:59.698324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfb97d-8f7f-4ac3-8ff4-600202dfe490 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:59.702281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:59.711625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfb97d-8f7f-4ac3-8ff4-600202dfe490 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:59.713094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfb97d-8f7f-4ac3-8ff4-600202dfe490 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9abfb97d-8f7f-4ac3-8ff4-600202dfe490 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:59.730296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:59.732065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:59.732981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:59.732981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:59.732981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:59.732981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 375/744] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:59.732981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfb97d-8f7f-4ac3-8ff4-600202dfe490 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:59.746119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44926b9c-c64f-4802-9c7f-05c3e6a14d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:59.746773 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44926b9c-c64f-4802-9c7f-05c3e6a14d5c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:59.747063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44926b9c-c64f-4802-9c7f-05c3e6a14d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:59.747510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44926b9c-c64f-4802-9c7f-05c3e6a14d5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:59.758307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44926b9c-c64f-4802-9c7f-05c3e6a14d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:59.759794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44926b9c-c64f-4802-9c7f-05c3e6a14d5c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-44926b9c-c64f-4802-9c7f-05c3e6a14d5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:10:59.777125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:59.778567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:10:59.779488 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:10:59.779488 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:10:59.779488 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:10:59.781895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 370/745] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:59.782589 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44926b9c-c64f-4802-9c7f-05c3e6a14d5c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:59.840135 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:10:59.850440 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfb97d-8f7f-4ac3-8ff4-600202dfe490 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:59.887287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da1baf-49ee-450f-a52a-43bcd8a3d0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:59.888298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da1baf-49ee-450f-a52a-43bcd8a3d0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:59.888794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da1baf-49ee-450f-a52a-43bcd8a3d0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:59.889257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da1baf-49ee-450f-a52a-43bcd8a3d0b9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:59.890646 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44926b9c-c64f-4802-9c7f-05c3e6a14d5c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:10:59.898351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da1baf-49ee-450f-a52a-43bcd8a3d0b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:59.899908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da1baf-49ee-450f-a52a-43bcd8a3d0b9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b4da1baf-49ee-450f-a52a-43bcd8a3d0b9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:10:59.911753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:10:59.913124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:10:59.914227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:10:59.914227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:10:59.914227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:10:59.914227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:10:59.914227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:10:59.914227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:10:59.914227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:10:59.914227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:10:59.914227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 17:10:59.914227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:10:59.914227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 376/746] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Sep 27 17:10:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:10:59.914227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da1baf-49ee-450f-a52a-43bcd8a3d0b9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:59.931581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ffac2-6afe-410a-a983-fca314b8aae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:10:59.932193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ffac2-6afe-410a-a983-fca314b8aae0 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:10:59.932479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ffac2-6afe-410a-a983-fca314b8aae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:10:59.932747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ffac2-6afe-410a-a983-fca314b8aae0 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:10:59.935908 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ffac2-6afe-410a-a983-fca314b8aae0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:10:59.937291 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ffac2-6afe-410a-a983-fca314b8aae0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:10:59.954305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 371/747] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Sep 27 17:10:59 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:10:59.967614 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ffac2-6afe-410a-a983-fca314b8aae0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:10:59.993029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:00.056379 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da1baf-49ee-450f-a52a-43bcd8a3d0b9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:00.111918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf46c25-6e0e-4eb8-ae9d-fbf40d49683a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:00.113099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf46c25-6e0e-4eb8-ae9d-fbf40d49683a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:00.113647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf46c25-6e0e-4eb8-ae9d-fbf40d49683a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:00.114100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf46c25-6e0e-4eb8-ae9d-fbf40d49683a None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:00.114551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ffac2-6afe-410a-a983-fca314b8aae0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:00.115110 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf46c25-6e0e-4eb8-ae9d-fbf40d49683a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:00.115554 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf46c25-6e0e-4eb8-ae9d-fbf40d49683a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:00.118495 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf46c25-6e0e-4eb8-ae9d-fbf40d49683a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:00.140192 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 377/748] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:00.140192 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf46c25-6e0e-4eb8-ae9d-fbf40d49683a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:00.151979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:00.161309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59394b13-3667-4753-965c-f0e15f8ec605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:00.162337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59394b13-3667-4753-965c-f0e15f8ec605 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:00.162564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59394b13-3667-4753-965c-f0e15f8ec605 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:00.163007 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59394b13-3667-4753-965c-f0e15f8ec605 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:00.163669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59394b13-3667-4753-965c-f0e15f8ec605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:00.163979 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59394b13-3667-4753-965c-f0e15f8ec605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:00.166504 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59394b13-3667-4753-965c-f0e15f8ec605 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:00.183039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 372/749] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:00.185405 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59394b13-3667-4753-965c-f0e15f8ec605 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:00.272743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf46c25-6e0e-4eb8-ae9d-fbf40d49683a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:00.276358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:00.304910 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59394b13-3667-4753-965c-f0e15f8ec605 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:00.314830 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df89b2-253c-4b76-b9fc-0b32adf96e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:00.315553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df89b2-253c-4b76-b9fc-0b32adf96e98 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:00.315840 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df89b2-253c-4b76-b9fc-0b32adf96e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:00.316117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df89b2-253c-4b76-b9fc-0b32adf96e98 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:00.316961 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df89b2-253c-4b76-b9fc-0b32adf96e98 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:00.317274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df89b2-253c-4b76-b9fc-0b32adf96e98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:00.318804 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df89b2-253c-4b76-b9fc-0b32adf96e98 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:00.342500 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c77b77-ca6b-425d-a3e7-4e85f3a51832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:00.343124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 378/750] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Sep 27 17:11:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:00.343236 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c77b77-ca6b-425d-a3e7-4e85f3a51832 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:00.343409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c77b77-ca6b-425d-a3e7-4e85f3a51832 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:00.343736 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c77b77-ca6b-425d-a3e7-4e85f3a51832 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:00.344045 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df89b2-253c-4b76-b9fc-0b32adf96e98 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:00.352703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c77b77-ca6b-425d-a3e7-4e85f3a51832 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:00.354340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c77b77-ca6b-425d-a3e7-4e85f3a51832 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-10c77b77-ca6b-425d-a3e7-4e85f3a51832 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:11:00.367340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:00.368320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:00.369255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:00.369255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:00.369255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:11:00.369255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:11:00.369255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:11:00.369255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:11:00.369255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:11:00.369255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:11:00.369255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:11:00.369255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:00.369255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 373/751] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Sep 27 17:11:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:00.369871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c77b77-ca6b-425d-a3e7-4e85f3a51832 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:00.423879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:00.465764 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df89b2-253c-4b76-b9fc-0b32adf96e98 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:00.486026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c77b77-ca6b-425d-a3e7-4e85f3a51832 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:00.505495 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72ca2a-64b4-4ddb-840d-bc90f27ea4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:00.506185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ca2a-64b4-4ddb-840d-bc90f27ea4dc None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:00.506572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ca2a-64b4-4ddb-840d-bc90f27ea4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:00.506854 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ca2a-64b4-4ddb-840d-bc90f27ea4dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:00.514436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72ca2a-64b4-4ddb-840d-bc90f27ea4dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:00.516085 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72ca2a-64b4-4ddb-840d-bc90f27ea4dc None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:00.527677 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fda9f-80f5-44f3-850e-6feec4953a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:00.528501 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fda9f-80f5-44f3-850e-6feec4953a99 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:00.528906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-7b72ca2a-64b4-4ddb-840d-bc90f27ea4dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:00.528906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:00.528906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:00.528906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:00.528906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:00.528906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:00.528906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:00.528906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:00.528906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:00.528906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:00.528906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:00.528906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:00.528906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:11:00.528906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:11:00.528906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:00.529988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:00.531073 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:11:00.531073 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:11:00.531073 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:11:00.531073 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:11:00.531073 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:11:00.531073 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:11:00.531073 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:00.531073 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:00.531551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fda9f-80f5-44f3-850e-6feec4953a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:00.531966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fda9f-80f5-44f3-850e-6feec4953a99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:00.534758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 379/752] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:00.535305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:00.535584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72ca2a-64b4-4ddb-840d-bc90f27ea4dc None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:00.610517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fda9f-80f5-44f3-850e-6feec4953a99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:00.612235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fda9f-80f5-44f3-850e-6feec4953a99 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:00.640652 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72ca2a-64b4-4ddb-840d-bc90f27ea4dc None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:00.666550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:00.676591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a1367-c9be-409c-b8fe-d9da73b52f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:00.677127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a1367-c9be-409c-b8fe-d9da73b52f64 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:00.677410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a1367-c9be-409c-b8fe-d9da73b52f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:00.677700 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a1367-c9be-409c-b8fe-d9da73b52f64 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:00.678439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a1367-c9be-409c-b8fe-d9da73b52f64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:00.678744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a1367-c9be-409c-b8fe-d9da73b52f64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:00.680191 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a1367-c9be-409c-b8fe-d9da73b52f64 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:00.698182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 380/753] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Sep 27 17:11:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:00.699662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a1367-c9be-409c-b8fe-d9da73b52f64 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:00.726566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 374/754] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:11:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:11:00.727685 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fda9f-80f5-44f3-850e-6feec4953a99 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:00.765811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:00.810891 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a1367-c9be-409c-b8fe-d9da73b52f64 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:00.843727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fda9f-80f5-44f3-850e-6feec4953a99 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:00.847928 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9ff98-5451-4545-af7b-6d51c41bc77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:00.848544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9ff98-5451-4545-af7b-6d51c41bc77f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:00.848826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9ff98-5451-4545-af7b-6d51c41bc77f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:00.849100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9ff98-5451-4545-af7b-6d51c41bc77f None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:00.849883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9ff98-5451-4545-af7b-6d51c41bc77f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:00.850191 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9ff98-5451-4545-af7b-6d51c41bc77f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:00.851627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9ff98-5451-4545-af7b-6d51c41bc77f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:00.869635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 381/755] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:11:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:00.870369 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9ff98-5451-4545-af7b-6d51c41bc77f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:00.892162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d600c61-53ed-42c2-b442-644d306298cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:00.893925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d600c61-53ed-42c2-b442-644d306298cf None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:00.895195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d600c61-53ed-42c2-b442-644d306298cf None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:00.895662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d600c61-53ed-42c2-b442-644d306298cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:00.911032 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d600c61-53ed-42c2-b442-644d306298cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:00.912799 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d600c61-53ed-42c2-b442-644d306298cf None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-7d600c61-53ed-42c2-b442-644d306298cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:00.936210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:00.937229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:00.938271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:00.938271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:00.938271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:00.938441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:00.942004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 375/756] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:00.943919 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d600c61-53ed-42c2-b442-644d306298cf None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:00.989238 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9ff98-5451-4545-af7b-6d51c41bc77f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:01.025031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f191ce-4358-454d-8bf8-d2ce9175b43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:01.025450 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f191ce-4358-454d-8bf8-d2ce9175b43e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:01.025759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f191ce-4358-454d-8bf8-d2ce9175b43e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:01.026037 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f191ce-4358-454d-8bf8-d2ce9175b43e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:01.037675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f191ce-4358-454d-8bf8-d2ce9175b43e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:01.039377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f191ce-4358-454d-8bf8-d2ce9175b43e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:01.047050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e4f191ce-4358-454d-8bf8-d2ce9175b43e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:01.055790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:01.056732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:01.057610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:01.057610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:01.057610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:01.061647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 382/757] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:01.062662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f191ce-4358-454d-8bf8-d2ce9175b43e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:01.071380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d600c61-53ed-42c2-b442-644d306298cf None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:01.108986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce472f-a36f-4bfc-983a-1cea0135bc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:01.109942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce472f-a36f-4bfc-983a-1cea0135bc9b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:01.110420 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce472f-a36f-4bfc-983a-1cea0135bc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:01.111003 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce472f-a36f-4bfc-983a-1cea0135bc9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:01.111914 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce472f-a36f-4bfc-983a-1cea0135bc9b None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=87a74ab0288847a7bb8b63756985e509) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:01.112441 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce472f-a36f-4bfc-983a-1cea0135bc9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:01.114072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce472f-a36f-4bfc-983a-1cea0135bc9b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:01.120154 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 376/758] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:11:00 2022] GET /identity/v3/role_assignments?user.id=87a74ab0288847a7bb8b63756985e509&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:01.122121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce472f-a36f-4bfc-983a-1cea0135bc9b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:01.203056 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:01.219022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f191ce-4358-454d-8bf8-d2ce9175b43e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:01.235160 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce472f-a36f-4bfc-983a-1cea0135bc9b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:01.273892 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69d86-1ded-4fbc-8dbf-0230bf86b6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:01.274868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69d86-1ded-4fbc-8dbf-0230bf86b6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:01.275347 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69d86-1ded-4fbc-8dbf-0230bf86b6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:01.275841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69d86-1ded-4fbc-8dbf-0230bf86b6d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:01.276717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece69d86-1ded-4fbc-8dbf-0230bf86b6d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:01.277395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece69d86-1ded-4fbc-8dbf-0230bf86b6d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:01.279310 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece69d86-1ded-4fbc-8dbf-0230bf86b6d3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:01.290467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1f816-f815-4568-9a9d-15b995a5614f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:01.291098 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1f816-f815-4568-9a9d-15b995a5614f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:01.291380 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1f816-f815-4568-9a9d-15b995a5614f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:01.291738 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1f816-f815-4568-9a9d-15b995a5614f None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:01.292308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1f816-f815-4568-9a9d-15b995a5614f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:01.293310 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1f816-f815-4568-9a9d-15b995a5614f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:01.294795 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1f816-f815-4568-9a9d-15b995a5614f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:01.295954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 377/759] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:01.311626 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69d86-1ded-4fbc-8dbf-0230bf86b6d3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:01.322201 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 383/760] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:01.326734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1f816-f815-4568-9a9d-15b995a5614f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:01.342448 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:01.487738 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1f816-f815-4568-9a9d-15b995a5614f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:01.488652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69d86-1ded-4fbc-8dbf-0230bf86b6d3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:01.524172 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3cf05-5582-4e13-bfcd-b7649b9aa507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:01.524815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3cf05-5582-4e13-bfcd-b7649b9aa507 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:01.525094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3cf05-5582-4e13-bfcd-b7649b9aa507 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:01.525366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3cf05-5582-4e13-bfcd-b7649b9aa507 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:01.533000 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3cf05-5582-4e13-bfcd-b7649b9aa507 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:01.537706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3cf05-5582-4e13-bfcd-b7649b9aa507 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:01.547371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-19d3cf05-5582-4e13-bfcd-b7649b9aa507 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:01.547371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:01.547371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:01.547371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:01.547371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:01.547371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:01.547371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:01.547371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:01.547371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:01.547371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:01.547371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:01.547371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:01.547371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:11:01.547371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:11:01.547371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:01.548249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:01.549123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:11:01.549123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:11:01.549123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:11:01.549123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:11:01.549123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:11:01.549123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:11:01.549123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:01.549123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:01.549123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 384/761] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:01.553877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3cf05-5582-4e13-bfcd-b7649b9aa507 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:01.554912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972e6b0-a958-412e-9975-c853473af00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:01.555714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972e6b0-a958-412e-9975-c853473af00c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:01.556132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972e6b0-a958-412e-9975-c853473af00c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:01.556539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972e6b0-a958-412e-9975-c853473af00c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:01.570656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972e6b0-a958-412e-9975-c853473af00c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:01.572321 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972e6b0-a958-412e-9975-c853473af00c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:01.574783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:01.589424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-b972e6b0-a958-412e-9975-c853473af00c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:01.589424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:01.589424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:01.589424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:01.589424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:01.589424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:01.589424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:01.589424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:01.589424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:01.589424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:01.589424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:01.589424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:01.589424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:11:01.589424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:11:01.589424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:01.590395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:01.591317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:11:01.591317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:11:01.591317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:11:01.591317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:11:01.591317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:11:01.591317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:11:01.591317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:01.591317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:01.602565 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 378/762] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:01.622721 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972e6b0-a958-412e-9975-c853473af00c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:01.676163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3cf05-5582-4e13-bfcd-b7649b9aa507 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:01.718619 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a9fbf-346c-41b7-b223-69cd55f4514c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:01.719669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a9fbf-346c-41b7-b223-69cd55f4514c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:01.720158 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a9fbf-346c-41b7-b223-69cd55f4514c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:01.720634 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a9fbf-346c-41b7-b223-69cd55f4514c None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:01.721717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a9fbf-346c-41b7-b223-69cd55f4514c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:01.722237 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a9fbf-346c-41b7-b223-69cd55f4514c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:01.724208 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a9fbf-346c-41b7-b223-69cd55f4514c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:01.738259 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 385/763] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:11:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:01.749093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a9fbf-346c-41b7-b223-69cd55f4514c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:01.778276 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:01.832166 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972e6b0-a958-412e-9975-c853473af00c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:01.837460 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:01.862727 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a9fbf-346c-41b7-b223-69cd55f4514c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:01.882876 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84bdf1-28c6-48fc-8b94-2458dd2332c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:01.884387 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84bdf1-28c6-48fc-8b94-2458dd2332c1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:01.885172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84bdf1-28c6-48fc-8b94-2458dd2332c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:01.885654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84bdf1-28c6-48fc-8b94-2458dd2332c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:01.887054 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84bdf1-28c6-48fc-8b94-2458dd2332c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:01.888013 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84bdf1-28c6-48fc-8b94-2458dd2332c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:01.890206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84bdf1-28c6-48fc-8b94-2458dd2332c1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:01.905027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48fd0b-af71-4cee-92a2-1d3b446d605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:01.905752 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48fd0b-af71-4cee-92a2-1d3b446d605d None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:01.906002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48fd0b-af71-4cee-92a2-1d3b446d605d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:01.906283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48fd0b-af71-4cee-92a2-1d3b446d605d None admin] PATH_INFO: `/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/e75b03fde75e411bace8d406237a7e50/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:01.908202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48fd0b-af71-4cee-92a2-1d3b446d605d None admin] RBAC: Authorizing `identity:create_grant(project_id=20fffa15f44b4f519ac7e29a48a7a596, user_id=e75b03fde75e411bace8d406237a7e50, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:01.909000 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 379/764] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:11:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:01.909631 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48fd0b-af71-4cee-92a2-1d3b446d605d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:01.910766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5915982-cfbf-4c19-921b-c37aa54f56f8 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:01.911253 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5915982-cfbf-4c19-921b-c37aa54f56f8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:01.911724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5915982-cfbf-4c19-921b-c37aa54f56f8 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:01.913185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 380/765] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:01.919068 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5915982-cfbf-4c19-921b-c37aa54f56f8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:01.925318 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 386/766] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:11:01 2022] PUT /identity/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/e75b03fde75e411bace8d406237a7e50/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:11:01.926908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab429d4d-8943-40d4-a229-0fa316de236a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:01.927291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab429d4d-8943-40d4-a229-0fa316de236a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:01.927678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab429d4d-8943-40d4-a229-0fa316de236a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:01.948211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ab429d4d-8943-40d4-a229-0fa316de236a None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:01.950702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ab429d4d-8943-40d4-a229-0fa316de236a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:02.042186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 387/767] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:02.056822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5915982-cfbf-4c19-921b-c37aa54f56f8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:02.096680 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:02.100597 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509fb9b-7a7f-436d-80e9-441406d188b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:02.101204 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509fb9b-7a7f-436d-80e9-441406d188b6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:02.101486 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509fb9b-7a7f-436d-80e9-441406d188b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:02.101870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509fb9b-7a7f-436d-80e9-441406d188b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:02.102692 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509fb9b-7a7f-436d-80e9-441406d188b6 None admin] RBAC: Adding query filter params (role.id=f384ed869fc647d9b0187a4d586cd119, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=fa016315ab6f4175974ed15311341e33) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:02.103006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509fb9b-7a7f-436d-80e9-441406d188b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:02.104498 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509fb9b-7a7f-436d-80e9-441406d188b6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:02.112052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 381/768] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:11:01 2022] GET /identity/v3/role_assignments?user.id=fa016315ab6f4175974ed15311341e33&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f384ed869fc647d9b0187a4d586cd119 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:02.397248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab429d4d-8943-40d4-a229-0fa316de236a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:02.419173 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a5ee3-77ba-49d2-9641-58750adc1cc2 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:02.419508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a5ee3-77ba-49d2-9641-58750adc1cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:02.419718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a5ee3-77ba-49d2-9641-58750adc1cc2 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:02.423829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 382/769] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:02.431280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d2bc0-2500-4099-92c6-d9f1c260b559 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:02.431280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d2bc0-2500-4099-92c6-d9f1c260b559 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:02.431452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d2bc0-2500-4099-92c6-d9f1c260b559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:02.452078 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-c82d2bc0-2500-4099-92c6-d9f1c260b559 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:02.453271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c82d2bc0-2500-4099-92c6-d9f1c260b559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:02.498088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:02.531868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 383/770] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:02.576206 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab429d4d-8943-40d4-a229-0fa316de236a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:02.626423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b428a9-9dd7-4c39-a7a4-c091ab632bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:02.627071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b428a9-9dd7-4c39-a7a4-c091ab632bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:02.627355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b428a9-9dd7-4c39-a7a4-c091ab632bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:02.627632 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b428a9-9dd7-4c39-a7a4-c091ab632bc3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:02.628227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b428a9-9dd7-4c39-a7a4-c091ab632bc3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:02.629626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b428a9-9dd7-4c39-a7a4-c091ab632bc3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e7b428a9-9dd7-4c39-a7a4-c091ab632bc3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:02.639107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:02.640353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:02.641410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:02.641410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:02.641410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:02.641410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:02.641410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:02.641410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:02.641410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:02.641410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:02.641410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:02.641410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:02.641410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:02.641410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:02.641410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 17:11:02.641410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:02.643343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 388/771] 10.222.0.57 () {56 vars in 1129 bytes} [Tue Sep 27 17:11:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:02.648322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d2bc0-2500-4099-92c6-d9f1c260b559 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:02.794464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d2bc0-2500-4099-92c6-d9f1c260b559 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:02.829074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:02.843113 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec758e98-00ec-4e37-a466-59a924671686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:02.843727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec758e98-00ec-4e37-a466-59a924671686 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:02.844004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec758e98-00ec-4e37-a466-59a924671686 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:02.844276 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec758e98-00ec-4e37-a466-59a924671686 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:02.844901 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec758e98-00ec-4e37-a466-59a924671686 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:02.845205 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec758e98-00ec-4e37-a466-59a924671686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:02.846574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec758e98-00ec-4e37-a466-59a924671686 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:02.853621 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 384/772] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Sep 27 17:11:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:02.859764 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b428a9-9dd7-4c39-a7a4-c091ab632bc3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:02.868492 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec758e98-00ec-4e37-a466-59a924671686 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:03.021749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec758e98-00ec-4e37-a466-59a924671686 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:03.056911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7c975-c770-4d2c-8e0f-9f2d3097626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:03.057568 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7c975-c770-4d2c-8e0f-9f2d3097626f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:03.065933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7c975-c770-4d2c-8e0f-9f2d3097626f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:03.065933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7c975-c770-4d2c-8e0f-9f2d3097626f None admin] PATH_INFO: `/v3/services/network` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:03.065933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7c975-c770-4d2c-8e0f-9f2d3097626f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:03.065933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7c975-c770-4d2c-8e0f-9f2d3097626f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-60c7c975-c770-4d2c-8e0f-9f2d3097626f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:03.069474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:03.070495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:03.071368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:03.071368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:03.071368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:03.071368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:03.071368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:03.071368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:03.071368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:03.071368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:03.071368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:03.071368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:03.071368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:03.071368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:03.071368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 17:11:03.071368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:03.071368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 385/773] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:02 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:03.076614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b428a9-9dd7-4c39-a7a4-c091ab632bc3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:03.094932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7c975-c770-4d2c-8e0f-9f2d3097626f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:03.115623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:03.123090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a06372-f376-44aa-8843-822606cf098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:03.123979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a06372-f376-44aa-8843-822606cf098d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:03.124498 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a06372-f376-44aa-8843-822606cf098d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:03.124913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a06372-f376-44aa-8843-822606cf098d None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:03.125714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a06372-f376-44aa-8843-822606cf098d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:03.126158 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a06372-f376-44aa-8843-822606cf098d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:03.127944 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a06372-f376-44aa-8843-822606cf098d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:03.134817 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 389/774] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Sep 27 17:11:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:03.141049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a06372-f376-44aa-8843-822606cf098d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:03.194347 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:03.239908 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7c975-c770-4d2c-8e0f-9f2d3097626f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:03.282007 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cef684-cc16-4d90-a36d-7378ce801c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:03.282510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cef684-cc16-4d90-a36d-7378ce801c4d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:03.282789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cef684-cc16-4d90-a36d-7378ce801c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:03.283064 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cef684-cc16-4d90-a36d-7378ce801c4d None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:03.283692 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cef684-cc16-4d90-a36d-7378ce801c4d None admin] RBAC: Adding query filter params (name=network) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:03.283999 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cef684-cc16-4d90-a36d-7378ce801c4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:03.285360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cef684-cc16-4d90-a36d-7378ce801c4d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:03.290166 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 386/775] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Sep 27 17:11:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:03.296415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cef684-cc16-4d90-a36d-7378ce801c4d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:03.384560 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a06372-f376-44aa-8843-822606cf098d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:03.446415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1892a0f-6af2-4846-adbd-a03ffd5bba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:03.447053 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1892a0f-6af2-4846-adbd-a03ffd5bba5e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:03.447333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1892a0f-6af2-4846-adbd-a03ffd5bba5e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:03.447610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1892a0f-6af2-4846-adbd-a03ffd5bba5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:03.448321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1892a0f-6af2-4846-adbd-a03ffd5bba5e None admin] RBAC: Adding query filter params (interface=public, service_id=31b6eccea7604c13b626aca3579b817a, region_id=RegionOne) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:03.449033 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1892a0f-6af2-4846-adbd-a03ffd5bba5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:03.450644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1892a0f-6af2-4846-adbd-a03ffd5bba5e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:03.471855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 390/776] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Sep 27 17:11:03 2022] GET /identity/v3/endpoints?service_id=31b6eccea7604c13b626aca3579b817a&interface=public®ion_id=RegionOne => generated 194 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:03.473212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cef684-cc16-4d90-a36d-7378ce801c4d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:03.477746 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1892a0f-6af2-4846-adbd-a03ffd5bba5e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:03.490826 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:03.528158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63574-4035-4ef4-84c9-790d793f5ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:03.528777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63574-4035-4ef4-84c9-790d793f5ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:03.529074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63574-4035-4ef4-84c9-790d793f5ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:03.529335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b63574-4035-4ef4-84c9-790d793f5ea8 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:03.529998 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b63574-4035-4ef4-84c9-790d793f5ea8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:03.530303 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b63574-4035-4ef4-84c9-790d793f5ea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:03.531657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b63574-4035-4ef4-84c9-790d793f5ea8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:03.539875 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 387/777] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Sep 27 17:11:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:03.548054 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63574-4035-4ef4-84c9-790d793f5ea8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:03.582607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:03.652479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1892a0f-6af2-4846-adbd-a03ffd5bba5e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:03.703739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b63574-4035-4ef4-84c9-790d793f5ea8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:03.720263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f4905-8cf1-46cf-b19c-691bc7fec0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:03.720935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f4905-8cf1-46cf-b19c-691bc7fec0af None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:03.721222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f4905-8cf1-46cf-b19c-691bc7fec0af None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:03.721494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f4905-8cf1-46cf-b19c-691bc7fec0af None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:03.722152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f4905-8cf1-46cf-b19c-691bc7fec0af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:03.723611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f4905-8cf1-46cf-b19c-691bc7fec0af None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:03.736467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 391/778] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Sep 27 17:11:03 2022] GET /identity/v3/services => generated 772 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:03.739009 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491c514-3425-45b8-9cc9-e7504241c85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:03.739638 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491c514-3425-45b8-9cc9-e7504241c85c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:03.739924 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491c514-3425-45b8-9cc9-e7504241c85c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:03.740196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491c514-3425-45b8-9cc9-e7504241c85c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:03.740911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491c514-3425-45b8-9cc9-e7504241c85c None admin] RBAC: Adding query filter params (interface=public, service_id=6cb5ae56165e41cb83bb30b027092358, region_id=RegionOne) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:03.741227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491c514-3425-45b8-9cc9-e7504241c85c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:03.742676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491c514-3425-45b8-9cc9-e7504241c85c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:03.751905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 388/779] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Sep 27 17:11:03 2022] GET /identity/v3/endpoints?service_id=6cb5ae56165e41cb83bb30b027092358&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:03.763074 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f4905-8cf1-46cf-b19c-691bc7fec0af None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:03.940307 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f4905-8cf1-46cf-b19c-691bc7fec0af None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:03.981530 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:04.000194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62f140-23f1-4822-9fcd-16147d82079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:04.000818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62f140-23f1-4822-9fcd-16147d82079e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:04.001100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62f140-23f1-4822-9fcd-16147d82079e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:04.001376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62f140-23f1-4822-9fcd-16147d82079e None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:04.002022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62f140-23f1-4822-9fcd-16147d82079e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:04.003413 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62f140-23f1-4822-9fcd-16147d82079e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:04.016590 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 392/780] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Sep 27 17:11:03 2022] GET /identity/v3/services => generated 772 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:04.055086 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbb925-a1b9-4eec-854f-e3253ab7f303 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:04.055370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbb925-a1b9-4eec-854f-e3253ab7f303 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:04.055651 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbb925-a1b9-4eec-854f-e3253ab7f303 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:04.057031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 389/781] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:04.063994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea6923-04c2-4dfd-b661-ef8fbb1465bf None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:04.064315 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea6923-04c2-4dfd-b661-ef8fbb1465bf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:04.064555 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea6923-04c2-4dfd-b661-ef8fbb1465bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:04.084744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b3ea6923-04c2-4dfd-b661-ef8fbb1465bf None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:04.086001 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b3ea6923-04c2-4dfd-b661-ef8fbb1465bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:04.169563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 393/782] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:04.459694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbb925-a1b9-4eec-854f-e3253ab7f303 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:04.514524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:04.572722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbb925-a1b9-4eec-854f-e3253ab7f303 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:04.613114 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fcc17-71d9-4bd1-a1fd-bcdd43fc30cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:04.613854 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fcc17-71d9-4bd1-a1fd-bcdd43fc30cd None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:04.614139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fcc17-71d9-4bd1-a1fd-bcdd43fc30cd None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:04.614415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fcc17-71d9-4bd1-a1fd-bcdd43fc30cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:04.618740 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a739c-f223-47d9-a662-8a4e4e3f308c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:04.619254 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a739c-f223-47d9-a662-8a4e4e3f308c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:04.619723 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a739c-f223-47d9-a662-8a4e4e3f308c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:04.622372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 394/783] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:04.626056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fcc17-71d9-4bd1-a1fd-bcdd43fc30cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:11:04.628232 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd6a17-a1a1-420a-8808-7374b01da88e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:04.628715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd6a17-a1a1-420a-8808-7374b01da88e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:04.629203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd6a17-a1a1-420a-8808-7374b01da88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-9c1fcc17-71d9-4bd1-a1fd-bcdd43fc30cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:11:04.630980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:04.631925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:04.632759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:04.632759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:04.632759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:04.632759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:04.632759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:11:04.632759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:11:04.632759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:11:04.632759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:11:04.632759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:11:04.632759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:11:04.632759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:11:04.632759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:04.635312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 390/784] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:04.638868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fcc17-71d9-4bd1-a1fd-bcdd43fc30cd None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:04.672655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f2bd6a17-a1a1-420a-8808-7374b01da88e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:04.674296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f2bd6a17-a1a1-420a-8808-7374b01da88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:04.743137 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fcc17-71d9-4bd1-a1fd-bcdd43fc30cd None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:04.746089 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:04.769533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 395/785] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:04.770909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc59478-2746-42d2-98a6-0ea6c03be1cb None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:04.771194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc59478-2746-42d2-98a6-0ea6c03be1cb None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:04.771462 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc59478-2746-42d2-98a6-0ea6c03be1cb None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:04.773154 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 396/786] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:04.778528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d769b0-f2ac-4aab-a828-768b10823f55 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:04.778815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d769b0-f2ac-4aab-a828-768b10823f55 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:04.779090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d769b0-f2ac-4aab-a828-768b10823f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:04.797239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-87d769b0-f2ac-4aab-a828-768b10823f55 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:04.798469 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-87d769b0-f2ac-4aab-a828-768b10823f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:04.825777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7261a-9b5d-427f-9db0-66a2b70ce3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:04.826404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7261a-9b5d-427f-9db0-66a2b70ce3ec None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:04.826688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7261a-9b5d-427f-9db0-66a2b70ce3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:04.827027 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7261a-9b5d-427f-9db0-66a2b70ce3ec None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:04.827705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7261a-9b5d-427f-9db0-66a2b70ce3ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:04.828011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7261a-9b5d-427f-9db0-66a2b70ce3ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:04.829394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7261a-9b5d-427f-9db0-66a2b70ce3ec None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:04.848600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 391/787] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:11:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:04.853352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:04.854872 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7261a-9b5d-427f-9db0-66a2b70ce3ec None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:04.929710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 397/788] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:04.990498 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7261a-9b5d-427f-9db0-66a2b70ce3ec None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:05.026134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee057fc-df28-4f59-8ce8-8f3b6604aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:05.027144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee057fc-df28-4f59-8ce8-8f3b6604aa0f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:05.027811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee057fc-df28-4f59-8ce8-8f3b6604aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:05.028266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee057fc-df28-4f59-8ce8-8f3b6604aa0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:05.039692 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee057fc-df28-4f59-8ce8-8f3b6604aa0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:05.041504 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee057fc-df28-4f59-8ce8-8f3b6604aa0f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-3ee057fc-df28-4f59-8ce8-8f3b6604aa0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:05.059104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:05.060556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:05.061443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:05.061443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:05.061443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:05.063526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 392/789] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:05.069270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d769b0-f2ac-4aab-a828-768b10823f55 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:05.145205 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee057fc-df28-4f59-8ce8-8f3b6604aa0f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:05.187054 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:05.212813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d769b0-f2ac-4aab-a828-768b10823f55 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:05.280016 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0dc0d-25cb-40d5-ae2e-2bf4642bd66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:05.280540 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0dc0d-25cb-40d5-ae2e-2bf4642bd66a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:05.280814 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0dc0d-25cb-40d5-ae2e-2bf4642bd66a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:05.281083 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0dc0d-25cb-40d5-ae2e-2bf4642bd66a None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:05.282922 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0dc0d-25cb-40d5-ae2e-2bf4642bd66a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:05.283053 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0dc0d-25cb-40d5-ae2e-2bf4642bd66a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:05.284375 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0dc0d-25cb-40d5-ae2e-2bf4642bd66a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:05.307117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 398/790] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:05.308022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0dc0d-25cb-40d5-ae2e-2bf4642bd66a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:05.338583 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee057fc-df28-4f59-8ce8-8f3b6604aa0f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:05.366149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:05.387541 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1807a-c02e-4e5a-80f3-ac3b78dffa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:05.388187 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1807a-c02e-4e5a-80f3-ac3b78dffa68 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:05.388471 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1807a-c02e-4e5a-80f3-ac3b78dffa68 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:05.388747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1807a-c02e-4e5a-80f3-ac3b78dffa68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:05.401257 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1807a-c02e-4e5a-80f3-ac3b78dffa68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-5fc1807a-c02e-4e5a-80f3-ac3b78dffa68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:11:05.407849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:05.408789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:05.409640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:05.409640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:05.409640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:05.409640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:05.409640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:11:05.409640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:11:05.409640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:11:05.409640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:11:05.409640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:11:05.409640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:11:05.409640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:11:05.409640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:05.410323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 393/791] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:11:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:05.410863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1807a-c02e-4e5a-80f3-ac3b78dffa68 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:05.425499 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0dc0d-25cb-40d5-ae2e-2bf4642bd66a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:05.472496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662993f-329a-49db-80ff-ac1510bd5c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:05.473839 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662993f-329a-49db-80ff-ac1510bd5c34 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:05.474537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662993f-329a-49db-80ff-ac1510bd5c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:05.474962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662993f-329a-49db-80ff-ac1510bd5c34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:05.488170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662993f-329a-49db-80ff-ac1510bd5c34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-d662993f-329a-49db-80ff-ac1510bd5c34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:11:05.496341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:05.497595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:05.498672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:05.498672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:05.498672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:05.498672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:05.498672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:11:05.498672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:11:05.498672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:11:05.498672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:11:05.498672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:11:05.498672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:11:05.498672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:11:05.498672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:05.501504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 399/792] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:11:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:05.502485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662993f-329a-49db-80ff-ac1510bd5c34 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:05.518472 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:05.542924 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1807a-c02e-4e5a-80f3-ac3b78dffa68 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:05.579197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d480e2-ed6e-414c-8d08-66dba21c8848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:05.580164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d480e2-ed6e-414c-8d08-66dba21c8848 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:05.580657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d480e2-ed6e-414c-8d08-66dba21c8848 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:05.581166 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d480e2-ed6e-414c-8d08-66dba21c8848 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:05.590310 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d480e2-ed6e-414c-8d08-66dba21c8848 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:05.592055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d480e2-ed6e-414c-8d08-66dba21c8848 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-40d480e2-ed6e-414c-8d08-66dba21c8848 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:11:05.604400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:05.605548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:05.606544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:05.606544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:05.606544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:11:05.606544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:11:05.606544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:11:05.606544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:11:05.606544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:11:05.606544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:11:05.606544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 17:11:05.606544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:05.609056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 394/793] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:11:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:05.610139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d480e2-ed6e-414c-8d08-66dba21c8848 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:05.611820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:05.622433 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662993f-329a-49db-80ff-ac1510bd5c34 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:05.659793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4407411-3a4a-49c4-aca5-f96c9f5565ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:05.660593 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4407411-3a4a-49c4-aca5-f96c9f5565ba None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:05.661021 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4407411-3a4a-49c4-aca5-f96c9f5565ba None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:05.661395 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4407411-3a4a-49c4-aca5-f96c9f5565ba None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:05.662297 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4407411-3a4a-49c4-aca5-f96c9f5565ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:05.662707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4407411-3a4a-49c4-aca5-f96c9f5565ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:05.664260 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4407411-3a4a-49c4-aca5-f96c9f5565ba None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:05.679140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 400/794] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:11:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:05.679140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4407411-3a4a-49c4-aca5-f96c9f5565ba None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:05.726093 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d480e2-ed6e-414c-8d08-66dba21c8848 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:05.763123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fca64-95ab-4a76-bfd0-877eb13e5d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:05.764117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fca64-95ab-4a76-bfd0-877eb13e5d28 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:05.764604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fca64-95ab-4a76-bfd0-877eb13e5d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:05.765167 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fca64-95ab-4a76-bfd0-877eb13e5d28 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:05.766187 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fca64-95ab-4a76-bfd0-877eb13e5d28 None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:05.766686 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fca64-95ab-4a76-bfd0-877eb13e5d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:05.768266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fca64-95ab-4a76-bfd0-877eb13e5d28 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:05.774065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:05.778711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 395/795] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:11:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:05.779810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fca64-95ab-4a76-bfd0-877eb13e5d28 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:05.795849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4407411-3a4a-49c4-aca5-f96c9f5565ba None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:05.836791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e431d1e-ae94-4da0-9ed3-5d7a494e2e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:05.837402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e431d1e-ae94-4da0-9ed3-5d7a494e2e60 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:05.837727 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e431d1e-ae94-4da0-9ed3-5d7a494e2e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:05.838013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e431d1e-ae94-4da0-9ed3-5d7a494e2e60 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:05.838749 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e431d1e-ae94-4da0-9ed3-5d7a494e2e60 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:05.839111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e431d1e-ae94-4da0-9ed3-5d7a494e2e60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:05.840755 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e431d1e-ae94-4da0-9ed3-5d7a494e2e60 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:05.865378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 401/796] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Sep 27 17:11:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:05.866421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e431d1e-ae94-4da0-9ed3-5d7a494e2e60 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:05.886801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:05.889178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fca64-95ab-4a76-bfd0-877eb13e5d28 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:05.924571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd56ac3-1856-4ae0-9627-0eccd6617ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:05.925555 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd56ac3-1856-4ae0-9627-0eccd6617ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:05.926053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd56ac3-1856-4ae0-9627-0eccd6617ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:05.926519 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd56ac3-1856-4ae0-9627-0eccd6617ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:05.937218 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd56ac3-1856-4ae0-9627-0eccd6617ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:05.938954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd56ac3-1856-4ae0-9627-0eccd6617ae2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-0dd56ac3-1856-4ae0-9627-0eccd6617ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:05.954566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:05.955557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:05.956478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:05.956478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:05.956478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:05.963141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 396/797] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:05.964274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd56ac3-1856-4ae0-9627-0eccd6617ae2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:05.980391 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e431d1e-ae94-4da0-9ed3-5d7a494e2e60 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:06.019167 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:06.022273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6482f-880b-4f4f-9230-6a5672004296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:06.022908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6482f-880b-4f4f-9230-6a5672004296 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:06.023187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6482f-880b-4f4f-9230-6a5672004296 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:06.023477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6482f-880b-4f4f-9230-6a5672004296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:06.035731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6482f-880b-4f4f-9230-6a5672004296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:06.037209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6482f-880b-4f4f-9230-6a5672004296 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-d0d6482f-880b-4f4f-9230-6a5672004296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:06.054945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:06.055979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:06.056875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:06.056875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:06.056875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:06.060968 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 402/798] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:06.062038 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6482f-880b-4f4f-9230-6a5672004296 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:06.075449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd56ac3-1856-4ae0-9627-0eccd6617ae2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:06.110928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb000f2-81fe-4bc2-97a6-b9cc59b911b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:06.111893 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb000f2-81fe-4bc2-97a6-b9cc59b911b0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:06.112379 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb000f2-81fe-4bc2-97a6-b9cc59b911b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:06.112845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb000f2-81fe-4bc2-97a6-b9cc59b911b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:06.124580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb000f2-81fe-4bc2-97a6-b9cc59b911b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:06.126354 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb000f2-81fe-4bc2-97a6-b9cc59b911b0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:06.137658 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-3cb000f2-81fe-4bc2-97a6-b9cc59b911b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:06.141975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:06.143090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:06.143981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:06.143981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:06.143981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:06.146150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 397/799] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:06.147235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb000f2-81fe-4bc2-97a6-b9cc59b911b0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:06.182233 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6482f-880b-4f4f-9230-6a5672004296 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:06.224955 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd90d45-22fa-42b0-acdd-80d26208f673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:06.226434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd90d45-22fa-42b0-acdd-80d26208f673 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:06.226846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd90d45-22fa-42b0-acdd-80d26208f673 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:06.227265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd90d45-22fa-42b0-acdd-80d26208f673 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:06.228033 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd90d45-22fa-42b0-acdd-80d26208f673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:06.228473 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd90d45-22fa-42b0-acdd-80d26208f673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:06.230113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd90d45-22fa-42b0-acdd-80d26208f673 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:06.252582 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 403/800] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:06.252582 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd90d45-22fa-42b0-acdd-80d26208f673 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:06.283401 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb000f2-81fe-4bc2-97a6-b9cc59b911b0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:06.287125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:06.330467 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b9d42-eb4e-43c1-84b8-f314205bf55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:06.331429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b9d42-eb4e-43c1-84b8-f314205bf55f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:06.332235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b9d42-eb4e-43c1-84b8-f314205bf55f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:06.332716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b9d42-eb4e-43c1-84b8-f314205bf55f None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:06.334579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b9d42-eb4e-43c1-84b8-f314205bf55f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:06.335488 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b9d42-eb4e-43c1-84b8-f314205bf55f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:06.337193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b9d42-eb4e-43c1-84b8-f314205bf55f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:06.351930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 398/801] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:06.353370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b9d42-eb4e-43c1-84b8-f314205bf55f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:06.372164 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd90d45-22fa-42b0-acdd-80d26208f673 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:06.401042 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:06.411681 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cb3cb-3597-42ae-aac7-a96a4c2bb707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:06.412287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cb3cb-3597-42ae-aac7-a96a4c2bb707 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:06.412566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cb3cb-3597-42ae-aac7-a96a4c2bb707 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:06.412834 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cb3cb-3597-42ae-aac7-a96a4c2bb707 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:06.413621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cb3cb-3597-42ae-aac7-a96a4c2bb707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:06.413951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cb3cb-3597-42ae-aac7-a96a4c2bb707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:06.415456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cb3cb-3597-42ae-aac7-a96a4c2bb707 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:06.428991 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 404/802] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:06.429805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cb3cb-3597-42ae-aac7-a96a4c2bb707 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:06.476405 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b9d42-eb4e-43c1-84b8-f314205bf55f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:06.513202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23595082-f4d5-4d51-9ca8-d894368f1b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:06.513860 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23595082-f4d5-4d51-9ca8-d894368f1b95 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:06.514170 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23595082-f4d5-4d51-9ca8-d894368f1b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:06.514429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23595082-f4d5-4d51-9ca8-d894368f1b95 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:06.521859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23595082-f4d5-4d51-9ca8-d894368f1b95 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:06.523292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23595082-f4d5-4d51-9ca8-d894368f1b95 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-23595082-f4d5-4d51-9ca8-d894368f1b95 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:11:06.535394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:06.536373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:06.537318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:06.537318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:06.537318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:11:06.537318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:11:06.537318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:11:06.537318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:11:06.537318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:11:06.537318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:11:06.537318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:11:06.537318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:06.537318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 399/803] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Sep 27 17:11:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:06.537318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23595082-f4d5-4d51-9ca8-d894368f1b95 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:06.556618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cb3cb-3597-42ae-aac7-a96a4c2bb707 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:06.569064 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:06.597129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d458ee0-cac3-4ebe-a2c6-549236fc7120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:06.597807 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d458ee0-cac3-4ebe-a2c6-549236fc7120 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:06.598086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d458ee0-cac3-4ebe-a2c6-549236fc7120 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:06.598362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d458ee0-cac3-4ebe-a2c6-549236fc7120 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:06.606773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d458ee0-cac3-4ebe-a2c6-549236fc7120 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:06.608218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d458ee0-cac3-4ebe-a2c6-549236fc7120 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8d458ee0-cac3-4ebe-a2c6-549236fc7120 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:11:06.619491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:06.621127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:06.622203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:06.622203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:06.622203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:11:06.622203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:11:06.622203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:11:06.622203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:11:06.622203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:11:06.622203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:11:06.622203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 17:11:06.622203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:06.622203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 405/804] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Sep 27 17:11:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:06.622800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42ab84-6c8c-4769-9ff1-18ccbcc69b5e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:06.622870 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42ab84-6c8c-4769-9ff1-18ccbcc69b5e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:06.623281 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42ab84-6c8c-4769-9ff1-18ccbcc69b5e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:06.625717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 406/805] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:06.625717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42ab84-6c8c-4769-9ff1-18ccbcc69b5e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:06.661556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23595082-f4d5-4d51-9ca8-d894368f1b95 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:06.682690 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:06.695922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c41d23-6ee8-47fc-ab18-a12e8572413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:06.696549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c41d23-6ee8-47fc-ab18-a12e8572413d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:06.696838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c41d23-6ee8-47fc-ab18-a12e8572413d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:06.697111 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c41d23-6ee8-47fc-ab18-a12e8572413d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:06.704146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c41d23-6ee8-47fc-ab18-a12e8572413d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:06.705570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c41d23-6ee8-47fc-ab18-a12e8572413d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:06.717667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-f3c41d23-6ee8-47fc-ab18-a12e8572413d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:06.717667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:06.717667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:06.717667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:06.717667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:06.717667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:06.717667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:06.717667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:06.717667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:06.717667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:06.717667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:06.717667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:06.717667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:11:06.717667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:11:06.717667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:06.718585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:06.719473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:11:06.719473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:11:06.719473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:11:06.719473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:11:06.719473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:11:06.719473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:11:06.719473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:06.719473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:06.719473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 400/806] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:06.719987 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c41d23-6ee8-47fc-ab18-a12e8572413d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:06.739068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42ab84-6c8c-4769-9ff1-18ccbcc69b5e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:06.773253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c92558-e9a6-465b-9591-35bdc54189e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:06.773890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c92558-e9a6-465b-9591-35bdc54189e5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:06.774168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c92558-e9a6-465b-9591-35bdc54189e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:06.774437 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c92558-e9a6-465b-9591-35bdc54189e5 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:06.775238 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c92558-e9a6-465b-9591-35bdc54189e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:06.775539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c92558-e9a6-465b-9591-35bdc54189e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:06.777721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c92558-e9a6-465b-9591-35bdc54189e5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:06.795249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 407/807] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Sep 27 17:11:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:06.796404 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be73d2-2387-4a2b-b642-1a8662cf0ee9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:06.796682 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be73d2-2387-4a2b-b642-1a8662cf0ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:06.796948 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be73d2-2387-4a2b-b642-1a8662cf0ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:06.808192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:06.815276 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-17be73d2-2387-4a2b-b642-1a8662cf0ee9 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:06.816465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-17be73d2-2387-4a2b-b642-1a8662cf0ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:06.825118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c41d23-6ee8-47fc-ab18-a12e8572413d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:06.858472 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1429817-8ab4-41f1-ab66-0c98eee5fa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:06.859009 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1429817-8ab4-41f1-ab66-0c98eee5fa7a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:06.859293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1429817-8ab4-41f1-ab66-0c98eee5fa7a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:06.859849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1429817-8ab4-41f1-ab66-0c98eee5fa7a None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:06.860291 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1429817-8ab4-41f1-ab66-0c98eee5fa7a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:06.860597 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1429817-8ab4-41f1-ab66-0c98eee5fa7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:06.862040 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1429817-8ab4-41f1-ab66-0c98eee5fa7a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:06.879221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 401/808] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Sep 27 17:11:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:06.880400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6879f3-e8dc-4351-82fe-f37f411ff4a2 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:06.880727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6879f3-e8dc-4351-82fe-f37f411ff4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:06.880951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6879f3-e8dc-4351-82fe-f37f411ff4a2 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:06.882171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 402/809] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:06.882859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6879f3-e8dc-4351-82fe-f37f411ff4a2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:06.883536 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 408/810] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:06.884496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be73d2-2387-4a2b-b642-1a8662cf0ee9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:06.920376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:06.998684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6879f3-e8dc-4351-82fe-f37f411ff4a2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:06.999220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be73d2-2387-4a2b-b642-1a8662cf0ee9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:07.036135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f42c5-595a-4ae0-b8a5-1da192181e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:07.036848 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f42c5-595a-4ae0-b8a5-1da192181e54 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:07.037138 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f42c5-595a-4ae0-b8a5-1da192181e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:07.037412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f42c5-595a-4ae0-b8a5-1da192181e54 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:07.038058 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c32e6-fd96-483a-a449-b2a1c900f897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:07.038178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f42c5-595a-4ae0-b8a5-1da192181e54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:07.038438 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f42c5-595a-4ae0-b8a5-1da192181e54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:07.038661 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c32e6-fd96-483a-a449-b2a1c900f897 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:07.038935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c32e6-fd96-483a-a449-b2a1c900f897 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:07.039207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c32e6-fd96-483a-a449-b2a1c900f897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:07.039863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f42c5-595a-4ae0-b8a5-1da192181e54 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:07.053239 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 403/811] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:11:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:07.054100 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f42c5-595a-4ae0-b8a5-1da192181e54 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:07.058959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:07.117649 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c32e6-fd96-483a-a449-b2a1c900f897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:07.119049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c32e6-fd96-483a-a449-b2a1c900f897 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:07.156861 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:07.166366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f42c5-595a-4ae0-b8a5-1da192181e54 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:07.199910 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee126134-a85d-4bb2-b576-b00afc3c7e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:07.200540 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee126134-a85d-4bb2-b576-b00afc3c7e30 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:07.200820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee126134-a85d-4bb2-b576-b00afc3c7e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:07.201096 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee126134-a85d-4bb2-b576-b00afc3c7e30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:07.211650 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee126134-a85d-4bb2-b576-b00afc3c7e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:07.213073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee126134-a85d-4bb2-b576-b00afc3c7e30 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:07.221856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 409/812] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:11:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:11:07.223080 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bbe71-6ae0-4f10-a072-3b46ff3531a7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:07.223362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bbe71-6ae0-4f10-a072-3b46ff3531a7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:07.223631 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bbe71-6ae0-4f10-a072-3b46ff3531a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-ee126134-a85d-4bb2-b576-b00afc3c7e30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:07.227676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:07.228814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:07.230669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:07.230669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:07.230669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:07.230669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 404/813] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:07.230669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee126134-a85d-4bb2-b576-b00afc3c7e30 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:07.246218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-eb8bbe71-6ae0-4f10-a072-3b46ff3531a7 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:07.247387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-eb8bbe71-6ae0-4f10-a072-3b46ff3531a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:07.284358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:07.315021 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 410/814] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:07.315960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bbe71-6ae0-4f10-a072-3b46ff3531a7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:07.340148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee126134-a85d-4bb2-b576-b00afc3c7e30 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:07.376035 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0e31e-6be4-46cf-a238-b259c8c70c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:07.376909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0e31e-6be4-46cf-a238-b259c8c70c42 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:07.377352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0e31e-6be4-46cf-a238-b259c8c70c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:07.377810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0e31e-6be4-46cf-a238-b259c8c70c42 None admin] PATH_INFO: `/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/87a74ab0288847a7bb8b63756985e509/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:07.379950 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0e31e-6be4-46cf-a238-b259c8c70c42 None admin] RBAC: Authorizing `identity:create_grant(project_id=20fffa15f44b4f519ac7e29a48a7a596, user_id=87a74ab0288847a7bb8b63756985e509, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:07.381372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0e31e-6be4-46cf-a238-b259c8c70c42 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:07.384266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:07.395121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 405/815] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:11:07 2022] PUT /identity/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/87a74ab0288847a7bb8b63756985e509/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:11:07.396308 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0e31e-6be4-46cf-a238-b259c8c70c42 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:07.439479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bbe71-6ae0-4f10-a072-3b46ff3531a7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:07.487472 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d1f94-9ab9-4fbc-aa07-78d254a4c596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:07.488486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d1f94-9ab9-4fbc-aa07-78d254a4c596 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:07.488916 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d1f94-9ab9-4fbc-aa07-78d254a4c596 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:07.489436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d1f94-9ab9-4fbc-aa07-78d254a4c596 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:07.490413 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d1f94-9ab9-4fbc-aa07-78d254a4c596 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:07.492117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d1f94-9ab9-4fbc-aa07-78d254a4c596 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9f2d1f94-9ab9-4fbc-aa07-78d254a4c596 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:07.503528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:07.504621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:07.505509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:07.505509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:07.505509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:07.505509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:07.505509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:07.505509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:07.505509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:07.505509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:07.505509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:07.505509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:07.505509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:07.505509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:07.505509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 17:11:07.505509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:07.508653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 411/816] 10.222.0.57 () {56 vars in 1129 bytes} [Tue Sep 27 17:11:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:07.509782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d1f94-9ab9-4fbc-aa07-78d254a4c596 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:07.539166 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0e31e-6be4-46cf-a238-b259c8c70c42 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:07.556834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:07.591998 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d806b-86c0-4753-b366-66ce8acc0cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:07.593499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d806b-86c0-4753-b366-66ce8acc0cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:07.593835 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d806b-86c0-4753-b366-66ce8acc0cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:07.594112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d806b-86c0-4753-b366-66ce8acc0cc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:07.607707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d806b-86c0-4753-b366-66ce8acc0cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:07.609455 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d806b-86c0-4753-b366-66ce8acc0cc1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-7c7d806b-86c0-4753-b366-66ce8acc0cc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:07.624657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:07.625672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:07.626713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:07.626713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:07.626713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:07.632057 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 406/817] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:07.632057 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d806b-86c0-4753-b366-66ce8acc0cc1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:07.638577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d1f94-9ab9-4fbc-aa07-78d254a4c596 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:07.670731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:07.678187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf6f21-6807-4b50-a5d3-bd3f42d4b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:07.679007 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf6f21-6807-4b50-a5d3-bd3f42d4b824 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:07.679294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf6f21-6807-4b50-a5d3-bd3f42d4b824 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:07.679566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf6f21-6807-4b50-a5d3-bd3f42d4b824 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:07.680229 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf6f21-6807-4b50-a5d3-bd3f42d4b824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:07.680519 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf6f21-6807-4b50-a5d3-bd3f42d4b824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:07.681902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf6f21-6807-4b50-a5d3-bd3f42d4b824 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:07.694411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 412/818] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:07.695222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf6f21-6807-4b50-a5d3-bd3f42d4b824 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:07.742780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d806b-86c0-4753-b366-66ce8acc0cc1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:07.783031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301e963-5479-4f25-91d5-270f4d53d6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:07.783643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301e963-5479-4f25-91d5-270f4d53d6dd None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:07.783923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301e963-5479-4f25-91d5-270f4d53d6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:07.784195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301e963-5479-4f25-91d5-270f4d53d6dd None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:07.784822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301e963-5479-4f25-91d5-270f4d53d6dd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:07.785125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301e963-5479-4f25-91d5-270f4d53d6dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:07.786943 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301e963-5479-4f25-91d5-270f4d53d6dd None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:07.791417 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 407/819] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Sep 27 17:11:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:07.792234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301e963-5479-4f25-91d5-270f4d53d6dd None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:07.803885 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf6f21-6807-4b50-a5d3-bd3f42d4b824 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:07.824090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:07.849377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6eecc5-e7b2-4acb-8b30-f7d6f53a5c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:07.849983 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eecc5-e7b2-4acb-8b30-f7d6f53a5c23 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:07.850264 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eecc5-e7b2-4acb-8b30-f7d6f53a5c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:07.850563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eecc5-e7b2-4acb-8b30-f7d6f53a5c23 None admin] PATH_INFO: `/v3/services/network` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:07.851109 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6eecc5-e7b2-4acb-8b30-f7d6f53a5c23 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:07.852511 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6eecc5-e7b2-4acb-8b30-f7d6f53a5c23 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-5a6eecc5-e7b2-4acb-8b30-f7d6f53a5c23 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:07.861351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:07.865882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:07.866780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:07.866780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:07.866780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:07.866780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:07.866780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:07.866780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:07.866780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:07.866780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:07.866780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:07.866780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:07.866780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:07.866780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:07.866780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 17:11:07.866780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:07.866780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 413/820] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:07 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:07.867562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6eecc5-e7b2-4acb-8b30-f7d6f53a5c23 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:07.914090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301e963-5479-4f25-91d5-270f4d53d6dd None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:07.924676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:07.952700 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b91007-245c-47c3-bd6e-2ab392291de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:07.953728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b91007-245c-47c3-bd6e-2ab392291de2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:07.954183 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b91007-245c-47c3-bd6e-2ab392291de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:07.954653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b91007-245c-47c3-bd6e-2ab392291de2 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:07.955564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b91007-245c-47c3-bd6e-2ab392291de2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:07.956164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b91007-245c-47c3-bd6e-2ab392291de2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:07.957582 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b91007-245c-47c3-bd6e-2ab392291de2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:07.971021 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 408/821] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:07.971656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b91007-245c-47c3-bd6e-2ab392291de2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:07.976710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6eecc5-e7b2-4acb-8b30-f7d6f53a5c23 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:08.015347 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc406a-fe8f-4798-950c-0c4f3c07511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:08.016003 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc406a-fe8f-4798-950c-0c4f3c07511c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:08.016277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc406a-fe8f-4798-950c-0c4f3c07511c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:08.016551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc406a-fe8f-4798-950c-0c4f3c07511c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:08.023282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc406a-fe8f-4798-950c-0c4f3c07511c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:08.024719 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc406a-fe8f-4798-950c-0c4f3c07511c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:08.035918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-53dc406a-fe8f-4798-950c-0c4f3c07511c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:08.035918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:08.035918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:08.035918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:08.035918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:08.035918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:08.035918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:08.035918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:08.035918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:08.035918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:08.035918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:08.035918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:08.035918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:11:08.035918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:11:08.035918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:08.036798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:08.038245 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:11:08.038245 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:11:08.038245 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:11:08.038245 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:11:08.038245 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:11:08.038245 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:11:08.038245 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:08.038245 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:08.038245 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 414/822] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:08.038245 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc406a-fe8f-4798-950c-0c4f3c07511c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:08.075835 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:08.087419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b91007-245c-47c3-bd6e-2ab392291de2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:08.125511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a56d6-bcbb-4b5e-b741-d1801f1bc5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:08.126230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a56d6-bcbb-4b5e-b741-d1801f1bc5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:08.126570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a56d6-bcbb-4b5e-b741-d1801f1bc5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:08.126906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a56d6-bcbb-4b5e-b741-d1801f1bc5c8 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:08.127703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a56d6-bcbb-4b5e-b741-d1801f1bc5c8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:08.128171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a56d6-bcbb-4b5e-b741-d1801f1bc5c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:08.129578 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a56d6-bcbb-4b5e-b741-d1801f1bc5c8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:08.134808 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 409/823] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Sep 27 17:11:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:08.134808 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a56d6-bcbb-4b5e-b741-d1801f1bc5c8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:08.152431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc406a-fe8f-4798-950c-0c4f3c07511c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:08.167722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:08.189445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cae081-7b88-4757-94c8-58907cfcc1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:08.190146 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cae081-7b88-4757-94c8-58907cfcc1ad None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:08.190421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cae081-7b88-4757-94c8-58907cfcc1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:08.190688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cae081-7b88-4757-94c8-58907cfcc1ad None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:08.191423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cae081-7b88-4757-94c8-58907cfcc1ad None admin] RBAC: Adding query filter params (name=network) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:08.191718 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cae081-7b88-4757-94c8-58907cfcc1ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:08.193197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cae081-7b88-4757-94c8-58907cfcc1ad None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:08.199753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 415/824] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Sep 27 17:11:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:08.200668 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cae081-7b88-4757-94c8-58907cfcc1ad None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:08.255330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a56d6-bcbb-4b5e-b741-d1801f1bc5c8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:08.295035 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31420fbc-d704-4552-9c6f-bde43f2fa74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:08.295671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31420fbc-d704-4552-9c6f-bde43f2fa74f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:08.295948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31420fbc-d704-4552-9c6f-bde43f2fa74f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:08.296219 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31420fbc-d704-4552-9c6f-bde43f2fa74f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:08.303042 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31420fbc-d704-4552-9c6f-bde43f2fa74f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:08.304483 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31420fbc-d704-4552-9c6f-bde43f2fa74f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:08.306373 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cae081-7b88-4757-94c8-58907cfcc1ad None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:08.316863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-31420fbc-d704-4552-9c6f-bde43f2fa74f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:08.316863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:08.316863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:08.316863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:08.316863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:08.316863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:08.316863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:08.316863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:08.316863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:08.316863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:08.316863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:08.316863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:08.316863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:11:08.316863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:11:08.316863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:08.318134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:08.320099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:11:08.320099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:11:08.320099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:11:08.320099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:11:08.320099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:11:08.320099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:11:08.320099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:08.320099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:08.320099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 410/825] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:08.320099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31420fbc-d704-4552-9c6f-bde43f2fa74f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:08.340846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:08.347035 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062821f-6917-4f4d-9cf2-5c399f50bdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:08.347640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062821f-6917-4f4d-9cf2-5c399f50bdf1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:08.347916 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062821f-6917-4f4d-9cf2-5c399f50bdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:08.348182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062821f-6917-4f4d-9cf2-5c399f50bdf1 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:08.348858 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062821f-6917-4f4d-9cf2-5c399f50bdf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:08.349169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062821f-6917-4f4d-9cf2-5c399f50bdf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:08.350670 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062821f-6917-4f4d-9cf2-5c399f50bdf1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:08.363496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 416/826] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:11:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:08.364294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062821f-6917-4f4d-9cf2-5c399f50bdf1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:08.407586 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:08.446413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31420fbc-d704-4552-9c6f-bde43f2fa74f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:08.476493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062821f-6917-4f4d-9cf2-5c399f50bdf1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:08.482805 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d022dfb-139b-410c-bd4c-2356390ffbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:08.483522 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d022dfb-139b-410c-bd4c-2356390ffbad None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:08.483923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d022dfb-139b-410c-bd4c-2356390ffbad None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:08.484306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d022dfb-139b-410c-bd4c-2356390ffbad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:08.485065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d022dfb-139b-410c-bd4c-2356390ffbad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:08.486552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d022dfb-139b-410c-bd4c-2356390ffbad None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:08.511629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 411/827] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:11:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:11:08.512683 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d022dfb-139b-410c-bd4c-2356390ffbad None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:08.531666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b69b7-02e6-4910-8909-562c6f049263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:08.532867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b69b7-02e6-4910-8909-562c6f049263 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:08.533317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b69b7-02e6-4910-8909-562c6f049263 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:08.533819 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b69b7-02e6-4910-8909-562c6f049263 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:08.534894 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b69b7-02e6-4910-8909-562c6f049263 None admin] RBAC: Adding query filter params (type=network) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:08.535823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b69b7-02e6-4910-8909-562c6f049263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:08.537402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b69b7-02e6-4910-8909-562c6f049263 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:08.550025 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 417/828] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Sep 27 17:11:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:08.552165 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b69b7-02e6-4910-8909-562c6f049263 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:08.600581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:08.637854 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d022dfb-139b-410c-bd4c-2356390ffbad None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:08.674543 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403cc0e-cb93-4dd2-bc58-8ff8aaa3abd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:08.675480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403cc0e-cb93-4dd2-bc58-8ff8aaa3abd0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:08.676014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403cc0e-cb93-4dd2-bc58-8ff8aaa3abd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:08.676428 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403cc0e-cb93-4dd2-bc58-8ff8aaa3abd0 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:08.676729 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b69b7-02e6-4910-8909-562c6f049263 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:08.677445 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403cc0e-cb93-4dd2-bc58-8ff8aaa3abd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:08.677918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403cc0e-cb93-4dd2-bc58-8ff8aaa3abd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:08.679539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403cc0e-cb93-4dd2-bc58-8ff8aaa3abd0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:08.694025 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 412/829] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:11:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:08.695178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403cc0e-cb93-4dd2-bc58-8ff8aaa3abd0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:08.696314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:08.726502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78797ac4-076e-4613-ad02-c165ce9af07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:08.727324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78797ac4-076e-4613-ad02-c165ce9af07f None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:08.727699 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78797ac4-076e-4613-ad02-c165ce9af07f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:08.727980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78797ac4-076e-4613-ad02-c165ce9af07f None admin] PATH_INFO: `/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/fa016315ab6f4175974ed15311341e33/roles/f384ed869fc647d9b0187a4d586cd119` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:08.750595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78797ac4-076e-4613-ad02-c165ce9af07f None admin] RBAC: Authorizing `identity:create_grant(project_id=20fffa15f44b4f519ac7e29a48a7a596, user_id=fa016315ab6f4175974ed15311341e33, role_id=f384ed869fc647d9b0187a4d586cd119)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:08.752050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78797ac4-076e-4613-ad02-c165ce9af07f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:08.773810 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 418/830] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:11:08 2022] PUT /identity/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/fa016315ab6f4175974ed15311341e33/roles/f384ed869fc647d9b0187a4d586cd119 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:11:08.773810 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78797ac4-076e-4613-ad02-c165ce9af07f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:08.826094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403cc0e-cb93-4dd2-bc58-8ff8aaa3abd0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:08.864244 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:08.871626 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb6fa8-d544-4f6e-8e43-22e946d87e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:08.872270 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb6fa8-d544-4f6e-8e43-22e946d87e93 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:08.872696 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb6fa8-d544-4f6e-8e43-22e946d87e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:08.872995 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb6fa8-d544-4f6e-8e43-22e946d87e93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:08.873725 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb6fa8-d544-4f6e-8e43-22e946d87e93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:08.875419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb6fa8-d544-4f6e-8e43-22e946d87e93 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:08.901248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 413/831] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:11:08 2022] POST /identity/v3/endpoints => generated 337 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:11:08.919059 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78797ac4-076e-4613-ad02-c165ce9af07f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:08.968718 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958700f-03f8-4aa7-ae68-8ab5ffc98267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:08.969565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958700f-03f8-4aa7-ae68-8ab5ffc98267 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:08.970046 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958700f-03f8-4aa7-ae68-8ab5ffc98267 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:08.970466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958700f-03f8-4aa7-ae68-8ab5ffc98267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:08.971430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958700f-03f8-4aa7-ae68-8ab5ffc98267 None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=e75b03fde75e411bace8d406237a7e50) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:08.971891 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958700f-03f8-4aa7-ae68-8ab5ffc98267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:08.973770 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958700f-03f8-4aa7-ae68-8ab5ffc98267 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:08.981997 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 419/832] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:11:08 2022] GET /identity/v3/role_assignments?user.id=e75b03fde75e411bace8d406237a7e50&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:09.650752 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e441a-fc38-4b43-be43-1b52766351c0 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:09.651337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e441a-fc38-4b43-be43-1b52766351c0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:09.651429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e441a-fc38-4b43-be43-1b52766351c0 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:09.653098 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 414/833] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:09.658543 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850b0f2-0319-41bd-87f9-18880a5a2b71 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:09.658962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850b0f2-0319-41bd-87f9-18880a5a2b71 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:09.659099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850b0f2-0319-41bd-87f9-18880a5a2b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:09.677965 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5850b0f2-0319-41bd-87f9-18880a5a2b71 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:09.679161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5850b0f2-0319-41bd-87f9-18880a5a2b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:09.681465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:09.756644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 420/834] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:10.025444 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e441a-fc38-4b43-be43-1b52766351c0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:10.137429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e441a-fc38-4b43-be43-1b52766351c0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:10.170703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716405f-ade4-48c4-b755-353461b2d0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:10.171331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716405f-ade4-48c4-b755-353461b2d0fa None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:10.171610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716405f-ade4-48c4-b755-353461b2d0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:10.171882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716405f-ade4-48c4-b755-353461b2d0fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:10.186754 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716405f-ade4-48c4-b755-353461b2d0fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-f716405f-ade4-48c4-b755-353461b2d0fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:11:10.191982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:10.192888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:10.193733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:10.193733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:10.193733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:10.193733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:10.193733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:11:10.193733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:11:10.193733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:11:10.193733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:11:10.193733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:11:10.193733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:11:10.193733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:11:10.193733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:10.193733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 415/835] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:11:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:10.200284 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850b0f2-0319-41bd-87f9-18880a5a2b71 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:10.308448 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850b0f2-0319-41bd-87f9-18880a5a2b71 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:10.344642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba4008-e7e5-4807-922f-4066400e4064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:10.345257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba4008-e7e5-4807-922f-4066400e4064 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:10.345540 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba4008-e7e5-4807-922f-4066400e4064 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:10.345844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba4008-e7e5-4807-922f-4066400e4064 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:10.346505 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba4008-e7e5-4807-922f-4066400e4064 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:10.346809 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba4008-e7e5-4807-922f-4066400e4064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:10.348190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba4008-e7e5-4807-922f-4066400e4064 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:10.353334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:10.357521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 421/836] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:11:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:10.363528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716405f-ade4-48c4-b755-353461b2d0fa None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:10.423680 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:10.472813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716405f-ade4-48c4-b755-353461b2d0fa None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:10.507975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221367b-24f7-4f31-9ee6-6b0e0f93d83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:10.508607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221367b-24f7-4f31-9ee6-6b0e0f93d83d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:10.508885 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221367b-24f7-4f31-9ee6-6b0e0f93d83d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:10.509155 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221367b-24f7-4f31-9ee6-6b0e0f93d83d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:10.520063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221367b-24f7-4f31-9ee6-6b0e0f93d83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:10.521502 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221367b-24f7-4f31-9ee6-6b0e0f93d83d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-7221367b-24f7-4f31-9ee6-6b0e0f93d83d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:10.537220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:10.538222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:10.539119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:10.539119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:10.539119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:10.539119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 416/837] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:10.546338 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba4008-e7e5-4807-922f-4066400e4064 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:10.656686 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba4008-e7e5-4807-922f-4066400e4064 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:10.691060 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31892ea5-0e48-4dd2-99f1-f534224a15d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:10.691677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31892ea5-0e48-4dd2-99f1-f534224a15d6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:10.691917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31892ea5-0e48-4dd2-99f1-f534224a15d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:10.692184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31892ea5-0e48-4dd2-99f1-f534224a15d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:10.692813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31892ea5-0e48-4dd2-99f1-f534224a15d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:10.693109 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31892ea5-0e48-4dd2-99f1-f534224a15d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:10.694482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31892ea5-0e48-4dd2-99f1-f534224a15d6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:10.706922 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 422/838] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:10.712661 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221367b-24f7-4f31-9ee6-6b0e0f93d83d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:10.817453 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:10.821966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221367b-24f7-4f31-9ee6-6b0e0f93d83d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:10.858401 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b288b19-bd76-4e21-ba27-693b6aec39af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:10.859032 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b288b19-bd76-4e21-ba27-693b6aec39af None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:10.859309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b288b19-bd76-4e21-ba27-693b6aec39af None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:10.859582 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b288b19-bd76-4e21-ba27-693b6aec39af None admin] PATH_INFO: `/v3/users/swift` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:10.867126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b288b19-bd76-4e21-ba27-693b6aec39af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:10.868544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b288b19-bd76-4e21-ba27-693b6aec39af None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-9b288b19-bd76-4e21-ba27-693b6aec39af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:11:10.880673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:10.881631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:10.882623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:10.882623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:10.882623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:11:10.882623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:11:10.882623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:11:10.882623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:11:10.882623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:11:10.882623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:11:10.882623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 27 17:11:10.882623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:10.882623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 417/839] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:11:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:10.888057 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31892ea5-0e48-4dd2-99f1-f534224a15d6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:10.956178 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:11.001855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31892ea5-0e48-4dd2-99f1-f534224a15d6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:11.041077 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e77d98-3568-4c36-82a3-a1971b2d7c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:11.041710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e77d98-3568-4c36-82a3-a1971b2d7c5f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:11.042545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e77d98-3568-4c36-82a3-a1971b2d7c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:11.042815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e77d98-3568-4c36-82a3-a1971b2d7c5f None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:11.043787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e77d98-3568-4c36-82a3-a1971b2d7c5f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:11.044094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e77d98-3568-4c36-82a3-a1971b2d7c5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:11.045767 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e77d98-3568-4c36-82a3-a1971b2d7c5f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:11.047464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb3a55-90c4-45a7-9b1d-5699f382cee1 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:11.047737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb3a55-90c4-45a7-9b1d-5699f382cee1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:11.048014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb3a55-90c4-45a7-9b1d-5699f382cee1 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:11.049559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 418/840] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:11.055510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d66f8-24bf-43b1-81f2-0cffee03631a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:11.055817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d66f8-24bf-43b1-81f2-0cffee03631a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:11.056297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d66f8-24bf-43b1-81f2-0cffee03631a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:11.072005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 423/841] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Sep 27 17:11:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:11.079075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e77d98-3568-4c36-82a3-a1971b2d7c5f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:11.080769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d87d66f8-24bf-43b1-81f2-0cffee03631a None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:11.082029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d87d66f8-24bf-43b1-81f2-0cffee03631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:11.171044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 419/842] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:11.172353 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a17dd-8846-442b-a0df-85d5f847cd87 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:11.172642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a17dd-8846-442b-a0df-85d5f847cd87 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:11.172933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a17dd-8846-442b-a0df-85d5f847cd87 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:11.174581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 420/843] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:11.180486 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3416be-3fae-4818-bb16-6e4cc05a83c3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:11.180774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3416be-3fae-4818-bb16-6e4cc05a83c3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:11.181047 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3416be-3fae-4818-bb16-6e4cc05a83c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:11.198474 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e77d98-3568-4c36-82a3-a1971b2d7c5f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:11.203820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4a3416be-3fae-4818-bb16-6e4cc05a83c3 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:11.205001 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4a3416be-3fae-4818-bb16-6e4cc05a83c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:11.217835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:11.238176 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24219fc4-dd0f-4e2d-aa7b-68dd92a27312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:11.239145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24219fc4-dd0f-4e2d-aa7b-68dd92a27312 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:11.239532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24219fc4-dd0f-4e2d-aa7b-68dd92a27312 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:11.239825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24219fc4-dd0f-4e2d-aa7b-68dd92a27312 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:11.300956 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 421/844] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:11.320790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24219fc4-dd0f-4e2d-aa7b-68dd92a27312 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:11.322270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24219fc4-dd0f-4e2d-aa7b-68dd92a27312 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:11.442725 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 424/845] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:11:11 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 17:11:11.448109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3416be-3fae-4818-bb16-6e4cc05a83c3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:11.458642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24219fc4-dd0f-4e2d-aa7b-68dd92a27312 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:11.471174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:11.485184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:11.563420 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3416be-3fae-4818-bb16-6e4cc05a83c3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:11.583738 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24219fc4-dd0f-4e2d-aa7b-68dd92a27312 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:11.597449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490a9d1-299a-4f9a-844f-787ac4929208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:11.598109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490a9d1-299a-4f9a-844f-787ac4929208 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:11.598385 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490a9d1-299a-4f9a-844f-787ac4929208 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:11.598652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490a9d1-299a-4f9a-844f-787ac4929208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:11.609056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490a9d1-299a-4f9a-844f-787ac4929208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:11.610537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490a9d1-299a-4f9a-844f-787ac4929208 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:11.618593 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de40028-47c5-4d36-b4a7-22a71b8a1d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:11.619211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40028-47c5-4d36-b4a7-22a71b8a1d26 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:11.619488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40028-47c5-4d36-b4a7-22a71b8a1d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:11.619756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40028-47c5-4d36-b4a7-22a71b8a1d26 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:11.620420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de40028-47c5-4d36-b4a7-22a71b8a1d26 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:11.621792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de40028-47c5-4d36-b4a7-22a71b8a1d26 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-2490a9d1-299a-4f9a-844f-787ac4929208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:11.624912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:11.625870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:11.626765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:11.626765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:11.626765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:11.626765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 422/846] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:11.627382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa205ab-457b-4ce1-ac26-1eccdcc02a8b None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:11.627477 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa205ab-457b-4ce1-ac26-1eccdcc02a8b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:11.627682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa205ab-457b-4ce1-ac26-1eccdcc02a8b None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:11.632951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 423/847] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:11.632951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa205ab-457b-4ce1-ac26-1eccdcc02a8b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-0de40028-47c5-4d36-b4a7-22a71b8a1d26 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:11.633160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:11.634452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:11.635533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:11.635533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:11.635533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:11.635533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:11.635533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:11.635533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:11.635533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:11.635533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:11.635533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:11.635533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:11.635533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:11.635533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:11.635533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 17:11:11.635533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:11.637288 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 425/848] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:11:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:11.637767 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de40028-47c5-4d36-b4a7-22a71b8a1d26 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:11.706295 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:11.718332 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:11.736548 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de40028-47c5-4d36-b4a7-22a71b8a1d26 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:11.739186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa205ab-457b-4ce1-ac26-1eccdcc02a8b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:11.770813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80154af-6cff-478c-ba1d-64055af745e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:11.771423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80154af-6cff-478c-ba1d-64055af745e1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:11.771761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80154af-6cff-478c-ba1d-64055af745e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:11.772036 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80154af-6cff-478c-ba1d-64055af745e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:11.772665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80154af-6cff-478c-ba1d-64055af745e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:11.772934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6285ab4-efaa-46a5-b44a-b54a9c1df672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:11.773042 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80154af-6cff-478c-ba1d-64055af745e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:11.773559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285ab4-efaa-46a5-b44a-b54a9c1df672 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:11.773859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285ab4-efaa-46a5-b44a-b54a9c1df672 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:11.774128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285ab4-efaa-46a5-b44a-b54a9c1df672 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:11.774348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80154af-6cff-478c-ba1d-64055af745e1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:11.783879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6285ab4-efaa-46a5-b44a-b54a9c1df672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:11:11.786271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 426/849] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:11.787399 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f582b2-5a27-446a-9379-89b9869dc336 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:11.787682 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f582b2-5a27-446a-9379-89b9869dc336 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:11.787954 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f582b2-5a27-446a-9379-89b9869dc336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-a6285ab4-efaa-46a5-b44a-b54a9c1df672 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:11:11.788581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:11.789463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:11.790327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:11.790327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:11.790327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:11.790327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:11.790327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:11:11.790327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:11:11.790327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:11:11.790327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:11:11.790327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:11:11.790327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:11:11.790327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:11:11.790327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:11.795012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 424/850] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:11:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:11.795704 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6285ab4-efaa-46a5-b44a-b54a9c1df672 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:11.808932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-89f582b2-5a27-446a-9379-89b9869dc336 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:11.810479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-89f582b2-5a27-446a-9379-89b9869dc336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:11.876530 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 427/851] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:11.877345 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f582b2-5a27-446a-9379-89b9869dc336 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:11.894681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6285ab4-efaa-46a5-b44a-b54a9c1df672 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:11.924003 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:11.931788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ed511-c9ac-421a-a712-3a034c3b8f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:11.932968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ed511-c9ac-421a-a712-3a034c3b8f58 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:11.933251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ed511-c9ac-421a-a712-3a034c3b8f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:11.933520 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ed511-c9ac-421a-a712-3a034c3b8f58 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:11.934179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ed511-c9ac-421a-a712-3a034c3b8f58 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:11.934479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ed511-c9ac-421a-a712-3a034c3b8f58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:11.935891 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ed511-c9ac-421a-a712-3a034c3b8f58 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:11.944960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 425/852] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:11:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:11.945868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ed511-c9ac-421a-a712-3a034c3b8f58 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:11.960555 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:11.991639 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f582b2-5a27-446a-9379-89b9869dc336 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:12.026274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60ca7e-d547-4f06-ba9e-7007d45c3a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:12.027292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60ca7e-d547-4f06-ba9e-7007d45c3a9b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:12.027292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60ca7e-d547-4f06-ba9e-7007d45c3a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:12.027603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60ca7e-d547-4f06-ba9e-7007d45c3a9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:12.035734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60ca7e-d547-4f06-ba9e-7007d45c3a9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:12.037241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60ca7e-d547-4f06-ba9e-7007d45c3a9b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:12.048855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-4c60ca7e-d547-4f06-ba9e-7007d45c3a9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:12.048855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:12.048855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:12.048855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:12.048855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:12.048855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:12.048855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:12.048855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:12.048855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:12.048855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:12.048855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:12.048855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:12.048855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:11:12.048855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:11:12.048855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:12.049765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:12.050664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:11:12.050664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:11:12.050664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:11:12.050664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:11:12.050664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:11:12.050664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:11:12.050664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:12.050664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:12.050664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 428/853] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:12.051150 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60ca7e-d547-4f06-ba9e-7007d45c3a9b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:12.058970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ed511-c9ac-421a-a712-3a034c3b8f58 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:12.097414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16d073-4aaf-44d5-bafd-3b53bba7ac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:12.098057 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16d073-4aaf-44d5-bafd-3b53bba7ac91 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:12.098331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16d073-4aaf-44d5-bafd-3b53bba7ac91 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:12.098594 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16d073-4aaf-44d5-bafd-3b53bba7ac91 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:12.099282 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16d073-4aaf-44d5-bafd-3b53bba7ac91 None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:12.099548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16d073-4aaf-44d5-bafd-3b53bba7ac91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:12.100909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16d073-4aaf-44d5-bafd-3b53bba7ac91 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:12.113728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 426/854] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:11:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:12.113728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16d073-4aaf-44d5-bafd-3b53bba7ac91 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:12.159868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60ca7e-d547-4f06-ba9e-7007d45c3a9b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:12.171778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:12.188698 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:12.194142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbaf61-59d6-40a4-ab8b-0d0060c7d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:12.194751 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbaf61-59d6-40a4-ab8b-0d0060c7d88b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:12.195030 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbaf61-59d6-40a4-ab8b-0d0060c7d88b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:12.195300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbaf61-59d6-40a4-ab8b-0d0060c7d88b None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:12.195924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbaf61-59d6-40a4-ab8b-0d0060c7d88b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:12.196224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbaf61-59d6-40a4-ab8b-0d0060c7d88b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:12.197577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbaf61-59d6-40a4-ab8b-0d0060c7d88b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:12.202082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 429/855] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:11:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:12.209191 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbaf61-59d6-40a4-ab8b-0d0060c7d88b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:12.219195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16d073-4aaf-44d5-bafd-3b53bba7ac91 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:12.258579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51076b-e6e0-4f7e-a9e3-980b4a2a085d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:12.259125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51076b-e6e0-4f7e-a9e3-980b4a2a085d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:12.259406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51076b-e6e0-4f7e-a9e3-980b4a2a085d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:12.259676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51076b-e6e0-4f7e-a9e3-980b4a2a085d None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:12.260416 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51076b-e6e0-4f7e-a9e3-980b4a2a085d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:12.260805 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51076b-e6e0-4f7e-a9e3-980b4a2a085d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:12.262365 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51076b-e6e0-4f7e-a9e3-980b4a2a085d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:12.281445 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 427/856] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:11:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:12.281445 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51076b-e6e0-4f7e-a9e3-980b4a2a085d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:12.338094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbaf61-59d6-40a4-ab8b-0d0060c7d88b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:12.376679 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad932d-32d6-48b8-b727-87b71ca117f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:12.377310 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad932d-32d6-48b8-b727-87b71ca117f3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:12.377583 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad932d-32d6-48b8-b727-87b71ca117f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:12.377883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad932d-32d6-48b8-b727-87b71ca117f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:12.398137 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51076b-e6e0-4f7e-a9e3-980b4a2a085d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:12.420762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:12.446606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8df246-7695-417a-9264-d5684e5e21a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:12.447259 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8df246-7695-417a-9264-d5684e5e21a0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:12.447539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8df246-7695-417a-9264-d5684e5e21a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:12.447810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8df246-7695-417a-9264-d5684e5e21a0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:12.448752 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8df246-7695-417a-9264-d5684e5e21a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:12.450179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8df246-7695-417a-9264-d5684e5e21a0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-2e8df246-7695-417a-9264-d5684e5e21a0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:12.460191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:12.461196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:12.462116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:12.462116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:12.462116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:12.462116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:12.462116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:12.462116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:12.462116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:12.462116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:12.462116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:12.462116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:12.462116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:12.462116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:12.462116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 17:11:12.462116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:12.462116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 428/857] 10.222.0.57 () {56 vars in 1132 bytes} [Tue Sep 27 17:11:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:12.462900 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8df246-7695-417a-9264-d5684e5e21a0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:12.509629 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad932d-32d6-48b8-b727-87b71ca117f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:12.511760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad932d-32d6-48b8-b727-87b71ca117f3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b5ad932d-32d6-48b8-b727-87b71ca117f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:12.526051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:12.527759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:12.529500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:12.529500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:12.529500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:12.529500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 430/858] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:12.529500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad932d-32d6-48b8-b727-87b71ca117f3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:12.575554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8df246-7695-417a-9264-d5684e5e21a0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:12.581812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:12.621347 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43050b94-8099-49e3-8681-e89a20841558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:12.621976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43050b94-8099-49e3-8681-e89a20841558 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:12.622255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43050b94-8099-49e3-8681-e89a20841558 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:12.622525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43050b94-8099-49e3-8681-e89a20841558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:12.623233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43050b94-8099-49e3-8681-e89a20841558 None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=87a74ab0288847a7bb8b63756985e509) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:12.623547 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43050b94-8099-49e3-8681-e89a20841558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:12.624952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43050b94-8099-49e3-8681-e89a20841558 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:12.631086 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 429/859] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:11:12 2022] GET /identity/v3/role_assignments?user.id=87a74ab0288847a7bb8b63756985e509&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:12.631661 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43050b94-8099-49e3-8681-e89a20841558 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:12.651557 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad932d-32d6-48b8-b727-87b71ca117f3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:12.690115 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:12.706459 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447b8ba-f467-4ea8-9ffc-ac1be99bd6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:12.708029 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447b8ba-f467-4ea8-9ffc-ac1be99bd6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:12.708923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447b8ba-f467-4ea8-9ffc-ac1be99bd6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:12.709695 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447b8ba-f467-4ea8-9ffc-ac1be99bd6f3 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:12.710568 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447b8ba-f467-4ea8-9ffc-ac1be99bd6f3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:12.711300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447b8ba-f467-4ea8-9ffc-ac1be99bd6f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:12.713710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447b8ba-f467-4ea8-9ffc-ac1be99bd6f3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:12.725937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 431/860] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Sep 27 17:11:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:12.730769 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447b8ba-f467-4ea8-9ffc-ac1be99bd6f3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:12.761377 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43050b94-8099-49e3-8681-e89a20841558 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:12.802087 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec2a48-7dc1-4427-bca9-17560835d871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:12.802704 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec2a48-7dc1-4427-bca9-17560835d871 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:12.802981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec2a48-7dc1-4427-bca9-17560835d871 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:12.803251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec2a48-7dc1-4427-bca9-17560835d871 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:12.804006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec2a48-7dc1-4427-bca9-17560835d871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:12.804372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec2a48-7dc1-4427-bca9-17560835d871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:12.805874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec2a48-7dc1-4427-bca9-17560835d871 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:12.821801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 430/861] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:12.828173 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec2a48-7dc1-4427-bca9-17560835d871 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:12.867544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447b8ba-f467-4ea8-9ffc-ac1be99bd6f3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:12.882793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:12.917787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f05e8f-ce8e-4ff0-acb1-d6d8a3abbe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:12.918419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f05e8f-ce8e-4ff0-acb1-d6d8a3abbe89 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:12.918699 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f05e8f-ce8e-4ff0-acb1-d6d8a3abbe89 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:12.918968 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f05e8f-ce8e-4ff0-acb1-d6d8a3abbe89 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:12.919598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f05e8f-ce8e-4ff0-acb1-d6d8a3abbe89 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:12.919895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f05e8f-ce8e-4ff0-acb1-d6d8a3abbe89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:12.921257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f05e8f-ce8e-4ff0-acb1-d6d8a3abbe89 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:12.933720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 432/862] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Sep 27 17:11:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:12.956939 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec2a48-7dc1-4427-bca9-17560835d871 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:12.959983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:12.999324 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f685059-2d51-4016-938d-9b3dc20afadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:12.999981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f685059-2d51-4016-938d-9b3dc20afadf None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:13.000260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f685059-2d51-4016-938d-9b3dc20afadf None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:13.000532 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f685059-2d51-4016-938d-9b3dc20afadf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:13.009074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f685059-2d51-4016-938d-9b3dc20afadf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:13.011291 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f685059-2d51-4016-938d-9b3dc20afadf None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-7f685059-2d51-4016-938d-9b3dc20afadf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:11:13.025079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:13.026330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:13.028157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:13.028157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:13.028157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:11:13.028157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:11:13.028157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:11:13.028157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:11:13.028157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:11:13.028157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:11:13.028157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 17:11:13.028157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:13.028157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 431/863] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Sep 27 17:11:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:13.034890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f05e8f-ce8e-4ff0-acb1-d6d8a3abbe89 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:13.160210 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f05e8f-ce8e-4ff0-acb1-d6d8a3abbe89 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:13.196484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa51c4-514c-4b72-8c37-9a2f774fc5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:13.197094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa51c4-514c-4b72-8c37-9a2f774fc5cd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:13.197372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa51c4-514c-4b72-8c37-9a2f774fc5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:13.197643 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa51c4-514c-4b72-8c37-9a2f774fc5cd None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:13.199116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa51c4-514c-4b72-8c37-9a2f774fc5cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:13.199539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa51c4-514c-4b72-8c37-9a2f774fc5cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:13.201003 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa51c4-514c-4b72-8c37-9a2f774fc5cd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:13.219536 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 433/864] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Sep 27 17:11:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:13.225273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f685059-2d51-4016-938d-9b3dc20afadf None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:13.329529 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f685059-2d51-4016-938d-9b3dc20afadf None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:13.365132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0d6a9-bb6c-4dda-a952-f9f2a6e16f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:13.366077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0d6a9-bb6c-4dda-a952-f9f2a6e16f86 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:13.366532 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0d6a9-bb6c-4dda-a952-f9f2a6e16f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:13.367004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0d6a9-bb6c-4dda-a952-f9f2a6e16f86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:13.399528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:13.439490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0d6a9-bb6c-4dda-a952-f9f2a6e16f86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:13.440945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0d6a9-bb6c-4dda-a952-f9f2a6e16f86 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:13.544134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 432/865] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:11:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:11:13.549702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa51c4-514c-4b72-8c37-9a2f774fc5cd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:13.585849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:13.659664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa51c4-514c-4b72-8c37-9a2f774fc5cd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:13.697294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0caa66d-2bb9-435e-a6d2-33233be8abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:13.698560 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caa66d-2bb9-435e-a6d2-33233be8abb9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:13.698850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caa66d-2bb9-435e-a6d2-33233be8abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:13.699145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caa66d-2bb9-435e-a6d2-33233be8abb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:13.709672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0caa66d-2bb9-435e-a6d2-33233be8abb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:13.711113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0caa66d-2bb9-435e-a6d2-33233be8abb9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b0caa66d-2bb9-435e-a6d2-33233be8abb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:13.725884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:13.727316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:13.728220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:13.728220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:13.728220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:13.728220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 434/866] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:13.734834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0d6a9-bb6c-4dda-a952-f9f2a6e16f86 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:13.796020 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:13.835368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0d6a9-bb6c-4dda-a952-f9f2a6e16f86 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:13.871722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225cc6f-bd76-4975-9d70-36c29dab6889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:13.872696 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225cc6f-bd76-4975-9d70-36c29dab6889 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:13.873185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225cc6f-bd76-4975-9d70-36c29dab6889 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:13.873668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225cc6f-bd76-4975-9d70-36c29dab6889 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:13.874591 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225cc6f-bd76-4975-9d70-36c29dab6889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:13.875114 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225cc6f-bd76-4975-9d70-36c29dab6889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:13.876743 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225cc6f-bd76-4975-9d70-36c29dab6889 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:13.889436 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 433/867] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:13.895253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0caa66d-2bb9-435e-a6d2-33233be8abb9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:13.987331 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:14.004318 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0caa66d-2bb9-435e-a6d2-33233be8abb9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:14.038957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b49e9-e1f4-4584-b9c3-aeab4ab5b6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:14.039578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b49e9-e1f4-4584-b9c3-aeab4ab5b6db None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:14.039853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b49e9-e1f4-4584-b9c3-aeab4ab5b6db None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:14.040114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b49e9-e1f4-4584-b9c3-aeab4ab5b6db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:14.048634 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b49e9-e1f4-4584-b9c3-aeab4ab5b6db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:14.050118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b49e9-e1f4-4584-b9c3-aeab4ab5b6db None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:14.062971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-d88b49e9-e1f4-4584-b9c3-aeab4ab5b6db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:14.062971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:14.062971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:14.062971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:14.062971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:14.062971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:14.062971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:14.062971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:14.062971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:14.062971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:14.062971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:14.062971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:14.062971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:11:14.062971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:11:14.062971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:14.063907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:14.064789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:11:14.064789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:11:14.064789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:11:14.064789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:11:14.064789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:11:14.064789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:11:14.064789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:14.064789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:14.064789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 435/868] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:14.071655 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225cc6f-bd76-4975-9d70-36c29dab6889 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:14.177320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225cc6f-bd76-4975-9d70-36c29dab6889 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:14.201842 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:14.212973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a00b47-3898-483a-b614-85ea097d1d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:14.213661 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a00b47-3898-483a-b614-85ea097d1d2a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:14.213973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a00b47-3898-483a-b614-85ea097d1d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:14.214248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a00b47-3898-483a-b614-85ea097d1d2a None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:14.214942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a00b47-3898-483a-b614-85ea097d1d2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:14.215248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a00b47-3898-483a-b614-85ea097d1d2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:14.216731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a00b47-3898-483a-b614-85ea097d1d2a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:14.229653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 434/869] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:11:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:14.235969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b49e9-e1f4-4584-b9c3-aeab4ab5b6db None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:14.349534 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b49e9-e1f4-4584-b9c3-aeab4ab5b6db None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:14.386537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b4e63-4148-46ec-b2a7-53c4fd775ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:14.387426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b4e63-4148-46ec-b2a7-53c4fd775ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:14.387713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b4e63-4148-46ec-b2a7-53c4fd775ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:14.387985 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b4e63-4148-46ec-b2a7-53c4fd775ec9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:14.388708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b4e63-4148-46ec-b2a7-53c4fd775ec9 None admin] RBAC: Adding query filter params (role.id=f384ed869fc647d9b0187a4d586cd119, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=fa016315ab6f4175974ed15311341e33) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:14.389018 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b4e63-4148-46ec-b2a7-53c4fd775ec9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:14.390476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b4e63-4148-46ec-b2a7-53c4fd775ec9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:14.396731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 436/870] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:11:14 2022] GET /identity/v3/role_assignments?user.id=fa016315ab6f4175974ed15311341e33&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f384ed869fc647d9b0187a4d586cd119 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:14.455944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce07ca4-6dbe-42f5-b576-88c6a8af943a None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:14.456291 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce07ca4-6dbe-42f5-b576-88c6a8af943a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:14.456503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce07ca4-6dbe-42f5-b576-88c6a8af943a None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:14.458444 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 435/871] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:14.464767 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecfa91-69ba-447b-a8ae-a67213ccbe70 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:14.465066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecfa91-69ba-447b-a8ae-a67213ccbe70 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:14.465318 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecfa91-69ba-447b-a8ae-a67213ccbe70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:14.485706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-21ecfa91-69ba-447b-a8ae-a67213ccbe70 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:14.486938 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-21ecfa91-69ba-447b-a8ae-a67213ccbe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:14.491272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:14.570304 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 437/872] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:14.840586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce07ca4-6dbe-42f5-b576-88c6a8af943a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:14.946392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce07ca4-6dbe-42f5-b576-88c6a8af943a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:14.984285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189fb40-580c-43cc-b9f7-0bf1c4b01d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:14.985345 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189fb40-580c-43cc-b9f7-0bf1c4b01d1e None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:14.985862 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189fb40-580c-43cc-b9f7-0bf1c4b01d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:14.986456 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189fb40-580c-43cc-b9f7-0bf1c4b01d1e None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:14.987358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189fb40-580c-43cc-b9f7-0bf1c4b01d1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:14.988970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189fb40-580c-43cc-b9f7-0bf1c4b01d1e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:15.007777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 436/873] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Sep 27 17:11:14 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:11:15.106959 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da0e6c-5f2f-4e81-b29b-60fb9ecf6137 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:15.107473 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da0e6c-5f2f-4e81-b29b-60fb9ecf6137 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:15.107473 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da0e6c-5f2f-4e81-b29b-60fb9ecf6137 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:15.109067 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 438/874] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:15.116366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f78ce-461d-4eeb-98f8-2049034c48c0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:15.116970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f78ce-461d-4eeb-98f8-2049034c48c0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:15.117442 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f78ce-461d-4eeb-98f8-2049034c48c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:15.137709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f57f78ce-461d-4eeb-98f8-2049034c48c0 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:15.139261 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f57f78ce-461d-4eeb-98f8-2049034c48c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:15.188049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:15.189251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b5e72-96f2-4fb8-bbd8-d75c0ae142f6 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:15.189251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b5e72-96f2-4fb8-bbd8-d75c0ae142f6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:15.189454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b5e72-96f2-4fb8-bbd8-d75c0ae142f6 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:15.192124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 439/875] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:15.196405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf5fb0-39ec-4dc4-a113-b8ce00ef06bd None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:15.196686 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf5fb0-39ec-4dc4-a113-b8ce00ef06bd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:15.198001 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf5fb0-39ec-4dc4-a113-b8ce00ef06bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:15.219954 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-21bf5fb0-39ec-4dc4-a113-b8ce00ef06bd None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:15.221280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-21bf5fb0-39ec-4dc4-a113-b8ce00ef06bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:15.227319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 437/876] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:15 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:15.302994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 440/877] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:15 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:15.506828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f78ce-461d-4eeb-98f8-2049034c48c0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:15.590167 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf5fb0-39ec-4dc4-a113-b8ce00ef06bd None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:15.624174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f78ce-461d-4eeb-98f8-2049034c48c0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:15.663431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:15.670988 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab389600-5144-404d-bff2-a8d5cd3c637d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:15.671638 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab389600-5144-404d-bff2-a8d5cd3c637d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:15.672457 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab389600-5144-404d-bff2-a8d5cd3c637d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:15.672739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab389600-5144-404d-bff2-a8d5cd3c637d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:15.673332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab389600-5144-404d-bff2-a8d5cd3c637d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:15.675184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab389600-5144-404d-bff2-a8d5cd3c637d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-ab389600-5144-404d-bff2-a8d5cd3c637d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:15.686855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:15.687895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:15.688737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:15.688737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:15.688737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:15.688737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:15.688737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:15.688737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:15.688737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:15.688737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:15.688737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:15.688737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:15.688737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:15.688737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:15.688737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 17:11:15.688737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:15.693576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 438/878] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Sep 27 17:11:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:15.694925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab389600-5144-404d-bff2-a8d5cd3c637d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:15.701554 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf5fb0-39ec-4dc4-a113-b8ce00ef06bd None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:15.737976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:15.747806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524ea4b-7695-4d8d-874b-5b7b45d5d586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:15.748425 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524ea4b-7695-4d8d-874b-5b7b45d5d586 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:15.748703 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524ea4b-7695-4d8d-874b-5b7b45d5d586 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:15.748979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524ea4b-7695-4d8d-874b-5b7b45d5d586 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:15.749795 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524ea4b-7695-4d8d-874b-5b7b45d5d586 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:15.751170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524ea4b-7695-4d8d-874b-5b7b45d5d586 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:15.774234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 441/879] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Sep 27 17:11:15 2022] POST /identity/v3/services => generated 269 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:11:15.815138 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab389600-5144-404d-bff2-a8d5cd3c637d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:15.862764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21520fc9-ef46-4a22-ac23-0a20ae66523e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:15.863577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21520fc9-ef46-4a22-ac23-0a20ae66523e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:15.863738 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21520fc9-ef46-4a22-ac23-0a20ae66523e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:15.863971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21520fc9-ef46-4a22-ac23-0a20ae66523e None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:15.864622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21520fc9-ef46-4a22-ac23-0a20ae66523e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:15.864925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21520fc9-ef46-4a22-ac23-0a20ae66523e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:15.866348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21520fc9-ef46-4a22-ac23-0a20ae66523e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:15.872122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 439/880] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Sep 27 17:11:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:15.877579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524ea4b-7695-4d8d-874b-5b7b45d5d586 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:15.991663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524ea4b-7695-4d8d-874b-5b7b45d5d586 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:16.023050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:16.031143 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83677e-f771-4b28-a401-1f6593b56a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:16.031759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83677e-f771-4b28-a401-1f6593b56a18 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:16.032049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83677e-f771-4b28-a401-1f6593b56a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:16.032324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83677e-f771-4b28-a401-1f6593b56a18 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:16.033442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83677e-f771-4b28-a401-1f6593b56a18 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:16.033773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83677e-f771-4b28-a401-1f6593b56a18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:16.035255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83677e-f771-4b28-a401-1f6593b56a18 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:16.040667 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 442/881] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Sep 27 17:11:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:16.732007 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24303c8c-750c-4989-ba64-46fa3ce99038 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:16.732347 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24303c8c-750c-4989-ba64-46fa3ce99038 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:16.732568 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24303c8c-750c-4989-ba64-46fa3ce99038 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:16.734189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 440/882] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:16.739659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32466071-f571-4a37-a0e0-7e87de18c39a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:16.740114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32466071-f571-4a37-a0e0-7e87de18c39a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:16.740209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32466071-f571-4a37-a0e0-7e87de18c39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:16.760214 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-32466071-f571-4a37-a0e0-7e87de18c39a None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:16.761446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-32466071-f571-4a37-a0e0-7e87de18c39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:16.836788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 443/883] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:17.105461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24303c8c-750c-4989-ba64-46fa3ce99038 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:17.209608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:17.218679 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24303c8c-750c-4989-ba64-46fa3ce99038 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:17.254505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e750848-5587-4ce0-aba5-8f79c1998f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:17.255134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e750848-5587-4ce0-aba5-8f79c1998f2d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:17.255418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e750848-5587-4ce0-aba5-8f79c1998f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:17.255794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e750848-5587-4ce0-aba5-8f79c1998f2d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:17.267116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e750848-5587-4ce0-aba5-8f79c1998f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-5e750848-5587-4ce0-aba5-8f79c1998f2d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:11:17.271871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:17.272801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:17.273658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:17.273658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:17.273658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:17.273658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:17.273658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:11:17.273658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:11:17.273658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:11:17.273658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:11:17.273658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:11:17.273658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:11:17.273658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 17:11:17.273658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:17.273658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 441/884] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Sep 27 17:11:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:17.279412 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32466071-f571-4a37-a0e0-7e87de18c39a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:17.309019 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abc71e-6100-410f-a9f8-1d4264adbc18 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:17.309527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abc71e-6100-410f-a9f8-1d4264adbc18 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:17.309975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abc71e-6100-410f-a9f8-1d4264adbc18 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:17.311462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 442/885] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:11:17.316411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1220f2-9e48-47e8-9d4e-15513f07a94c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:17.316880 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1220f2-9e48-47e8-9d4e-15513f07a94c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:17.317304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1220f2-9e48-47e8-9d4e-15513f07a94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:17.337322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2e1220f2-9e48-47e8-9d4e-15513f07a94c None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:17.338817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2e1220f2-9e48-47e8-9d4e-15513f07a94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:17.394917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32466071-f571-4a37-a0e0-7e87de18c39a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:17.422638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:17.442393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2105e60-c964-463b-844a-ab32b6ff903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:17.443003 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2105e60-c964-463b-844a-ab32b6ff903e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:17.443277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2105e60-c964-463b-844a-ab32b6ff903e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:17.443546 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2105e60-c964-463b-844a-ab32b6ff903e None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:17.444212 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2105e60-c964-463b-844a-ab32b6ff903e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:17.444512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2105e60-c964-463b-844a-ab32b6ff903e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:17.445895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2105e60-c964-463b-844a-ab32b6ff903e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:17.450022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 443/886] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:17.460101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 444/887] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Sep 27 17:11:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:17.466121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1220f2-9e48-47e8-9d4e-15513f07a94c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:17.551590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:17.568266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1220f2-9e48-47e8-9d4e-15513f07a94c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:17.606978 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacab2c7-f8b8-42b8-9ad5-4d9e921582e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:17.607977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab2c7-f8b8-42b8-9ad5-4d9e921582e6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:17.608476 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab2c7-f8b8-42b8-9ad5-4d9e921582e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:17.608941 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab2c7-f8b8-42b8-9ad5-4d9e921582e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:17.619461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacab2c7-f8b8-42b8-9ad5-4d9e921582e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:17.621159 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacab2c7-f8b8-42b8-9ad5-4d9e921582e6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-dacab2c7-f8b8-42b8-9ad5-4d9e921582e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:17.635923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:17.636937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:17.637861 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:17.637861 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:17.637861 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:17.639874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 444/888] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:17.645242 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2105e60-c964-463b-844a-ab32b6ff903e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:17.749004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2105e60-c964-463b-844a-ab32b6ff903e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:17.767105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacab2c7-f8b8-42b8-9ad5-4d9e921582e6 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:17.788638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8ab3-2daf-40d2-b69c-2cfaf83a2f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:17.789254 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8ab3-2daf-40d2-b69c-2cfaf83a2f9b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:17.789529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8ab3-2daf-40d2-b69c-2cfaf83a2f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:17.789826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8ab3-2daf-40d2-b69c-2cfaf83a2f9b None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:17.790464 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8ab3-2daf-40d2-b69c-2cfaf83a2f9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:17.790761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8ab3-2daf-40d2-b69c-2cfaf83a2f9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:17.792740 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8ab3-2daf-40d2-b69c-2cfaf83a2f9b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:17.813265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 445/889] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:17.814600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8ab3-2daf-40d2-b69c-2cfaf83a2f9b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:17.867750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:17.892266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacab2c7-f8b8-42b8-9ad5-4d9e921582e6 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:17.932436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8ab3-2daf-40d2-b69c-2cfaf83a2f9b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:17.933105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcac0af-0d43-4ddb-a9fe-2351b72ba1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:17.934066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcac0af-0d43-4ddb-a9fe-2351b72ba1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:17.934550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcac0af-0d43-4ddb-a9fe-2351b72ba1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:17.935039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcac0af-0d43-4ddb-a9fe-2351b72ba1b7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:17.935833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcac0af-0d43-4ddb-a9fe-2351b72ba1b7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:17.937385 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcac0af-0d43-4ddb-a9fe-2351b72ba1b7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:17.940656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-4dcac0af-0d43-4ddb-a9fe-2351b72ba1b7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:17.949601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:17.950658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:17.951508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:17.951508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:17.951508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:17.951508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:17.951508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:17.951508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:17.951508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:17.951508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:17.951508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:17.951508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:17.951508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:17.951508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:17.951508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 17:11:17.951508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:17.959729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 445/890] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:11:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:17.961231 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcac0af-0d43-4ddb-a9fe-2351b72ba1b7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:17.975287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263746a-5726-44ee-84ec-ae4f63d839f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:17.976187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263746a-5726-44ee-84ec-ae4f63d839f8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:17.976611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263746a-5726-44ee-84ec-ae4f63d839f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:17.977022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263746a-5726-44ee-84ec-ae4f63d839f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:17.988465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263746a-5726-44ee-84ec-ae4f63d839f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:17.990257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263746a-5726-44ee-84ec-ae4f63d839f8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-5263746a-5726-44ee-84ec-ae4f63d839f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:11:18.007927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:18.008931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:18.009902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:18.009902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:18.009902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:11:18.009902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:11:18.009902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:11:18.009902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:11:18.009902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:11:18.009902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:11:18.009902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 17:11:18.009902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:18.014043 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 446/891] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Sep 27 17:11:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:18.016917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263746a-5726-44ee-84ec-ae4f63d839f8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:18.097391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcac0af-0d43-4ddb-a9fe-2351b72ba1b7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:18.136583 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51d6e8-8c67-4079-8a34-fa1a9d57b920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:18.137216 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51d6e8-8c67-4079-8a34-fa1a9d57b920 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:18.137449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51d6e8-8c67-4079-8a34-fa1a9d57b920 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:18.137930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51d6e8-8c67-4079-8a34-fa1a9d57b920 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:18.138050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263746a-5726-44ee-84ec-ae4f63d839f8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:18.138564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51d6e8-8c67-4079-8a34-fa1a9d57b920 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:18.138868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51d6e8-8c67-4079-8a34-fa1a9d57b920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:18.140233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51d6e8-8c67-4079-8a34-fa1a9d57b920 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:18.145037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 446/892] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:11:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:18.146234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf4e24-05b9-435f-9356-97c8d180ec29 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:18.146514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf4e24-05b9-435f-9356-97c8d180ec29 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:18.146783 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf4e24-05b9-435f-9356-97c8d180ec29 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:18.152103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 447/893] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:18.152103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf4e24-05b9-435f-9356-97c8d180ec29 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:18.152413 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:18.186150 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61855ff8-7299-4338-af38-f3662609ccdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:18.186779 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61855ff8-7299-4338-af38-f3662609ccdf None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:18.187062 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61855ff8-7299-4338-af38-f3662609ccdf None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:18.187331 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61855ff8-7299-4338-af38-f3662609ccdf None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:18.188068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61855ff8-7299-4338-af38-f3662609ccdf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:18.188460 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61855ff8-7299-4338-af38-f3662609ccdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:18.189875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61855ff8-7299-4338-af38-f3662609ccdf None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:18.217045 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 447/894] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Sep 27 17:11:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:18.218711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9894a1d-1298-4d58-aa8c-868915475cf0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:18.218998 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9894a1d-1298-4d58-aa8c-868915475cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:18.219269 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9894a1d-1298-4d58-aa8c-868915475cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:18.225475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:18.238347 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f9894a1d-1298-4d58-aa8c-868915475cf0 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:18.239512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f9894a1d-1298-4d58-aa8c-868915475cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:18.272964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf4e24-05b9-435f-9356-97c8d180ec29 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:18.308570 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 448/895] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:18.309422 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9894a1d-1298-4d58-aa8c-868915475cf0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:18.309538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45587c5b-c943-47cc-8885-30934c70c562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:18.310180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45587c5b-c943-47cc-8885-30934c70c562 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:18.310464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45587c5b-c943-47cc-8885-30934c70c562 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:18.310739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45587c5b-c943-47cc-8885-30934c70c562 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:18.311368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45587c5b-c943-47cc-8885-30934c70c562 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:18.311687 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45587c5b-c943-47cc-8885-30934c70c562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:18.313285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45587c5b-c943-47cc-8885-30934c70c562 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:18.317811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 448/896] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:11:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:18.318980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f688ca4-7b03-4ccd-854a-8e3e5d639bb1 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:18.319498 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f688ca4-7b03-4ccd-854a-8e3e5d639bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:18.319772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f688ca4-7b03-4ccd-854a-8e3e5d639bb1 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:18.321097 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 449/897] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:18.326689 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f688ca4-7b03-4ccd-854a-8e3e5d639bb1 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:18.420116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:18.428083 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9894a1d-1298-4d58-aa8c-868915475cf0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:18.443952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f688ca4-7b03-4ccd-854a-8e3e5d639bb1 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:18.464806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada28de6-5792-4e3a-934d-b78b55d094a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:18.465414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada28de6-5792-4e3a-934d-b78b55d094a1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:18.465771 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada28de6-5792-4e3a-934d-b78b55d094a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:18.466018 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada28de6-5792-4e3a-934d-b78b55d094a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:18.472922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:18.483817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328a41e-1ba6-42a2-a677-b75ccbe25ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:18.484718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328a41e-1ba6-42a2-a677-b75ccbe25ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:18.485170 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328a41e-1ba6-42a2-a677-b75ccbe25ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:18.485633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328a41e-1ba6-42a2-a677-b75ccbe25ee4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:18.486471 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328a41e-1ba6-42a2-a677-b75ccbe25ee4 None admin] RBAC: Adding query filter params (interface=public, service_id=77097296555d4ff8ac5fd73671cccb32, region_id=RegionOne) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:18.486851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328a41e-1ba6-42a2-a677-b75ccbe25ee4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:18.488252 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328a41e-1ba6-42a2-a677-b75ccbe25ee4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:18.498935 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 450/898] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Sep 27 17:11:18 2022] GET /identity/v3/endpoints?service_id=77097296555d4ff8ac5fd73671cccb32&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:18.498935 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ce2d3-b4e3-4fb7-b7bc-dd7b3386a849 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:18.498935 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ce2d3-b4e3-4fb7-b7bc-dd7b3386a849 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:18.498935 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ce2d3-b4e3-4fb7-b7bc-dd7b3386a849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:18.515470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-425ce2d3-b4e3-4fb7-b7bc-dd7b3386a849 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:18.516645 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-425ce2d3-b4e3-4fb7-b7bc-dd7b3386a849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:18.542121 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada28de6-5792-4e3a-934d-b78b55d094a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:18.543559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada28de6-5792-4e3a-934d-b78b55d094a1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:18.593470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 451/899] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:18.594342 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ce2d3-b4e3-4fb7-b7bc-dd7b3386a849 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:18.637894 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:18.646029 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 449/900] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:11:18 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:11:18.647022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada28de6-5792-4e3a-934d-b78b55d094a1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:18.713864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ce2d3-b4e3-4fb7-b7bc-dd7b3386a849 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:18.738575 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:18.750437 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada28de6-5792-4e3a-934d-b78b55d094a1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:18.752857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcf517-50bb-4551-bd2a-dae2377fd7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:18.753549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcf517-50bb-4551-bd2a-dae2377fd7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:18.753882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcf517-50bb-4551-bd2a-dae2377fd7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:18.754153 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcf517-50bb-4551-bd2a-dae2377fd7f0 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:18.754755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcf517-50bb-4551-bd2a-dae2377fd7f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:18.756136 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcf517-50bb-4551-bd2a-dae2377fd7f0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:18.766242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 452/901] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Sep 27 17:11:18 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:11:18.767691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcf517-50bb-4551-bd2a-dae2377fd7f0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:18.791044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d790c50-2588-4736-811f-3a16a2448d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:18.791967 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d790c50-2588-4736-811f-3a16a2448d36 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:18.792180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d790c50-2588-4736-811f-3a16a2448d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:18.792451 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d790c50-2588-4736-811f-3a16a2448d36 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:18.793063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d790c50-2588-4736-811f-3a16a2448d36 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:18.795034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d790c50-2588-4736-811f-3a16a2448d36 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9d790c50-2588-4736-811f-3a16a2448d36 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:18.806396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:18.807476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:18.808394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:18.808394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:18.808394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:18.808394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:18.808394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:18.808394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:18.808394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:18.808394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:18.808394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:18.808394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:18.808394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:18.808394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:18.808394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 17:11:18.808394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:18.812744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 450/902] 10.222.0.57 () {56 vars in 1132 bytes} [Tue Sep 27 17:11:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:18.813809 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d790c50-2588-4736-811f-3a16a2448d36 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:18.883078 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:18.909669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcf517-50bb-4551-bd2a-dae2377fd7f0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:18.930907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d790c50-2588-4736-811f-3a16a2448d36 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:18.951410 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ef08b-58d7-41a8-bcd8-c41b04255ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:18.952620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ef08b-58d7-41a8-bcd8-c41b04255ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:18.952620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ef08b-58d7-41a8-bcd8-c41b04255ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:18.952620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ef08b-58d7-41a8-bcd8-c41b04255ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:18.966246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ef08b-58d7-41a8-bcd8-c41b04255ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:18.967605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ef08b-58d7-41a8-bcd8-c41b04255ae0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:18.969335 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0aa497-223a-412b-b6b7-fddba82c4bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:18.969994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0aa497-223a-412b-b6b7-fddba82c4bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:18.970271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0aa497-223a-412b-b6b7-fddba82c4bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:18.970541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0aa497-223a-412b-b6b7-fddba82c4bc3 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:18.971164 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0aa497-223a-412b-b6b7-fddba82c4bc3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:18.971471 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0aa497-223a-412b-b6b7-fddba82c4bc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:18.972817 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0aa497-223a-412b-b6b7-fddba82c4bc3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:18.978557 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 451/903] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Sep 27 17:11:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:18.979654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0aa497-223a-412b-b6b7-fddba82c4bc3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-583ef08b-58d7-41a8-bcd8-c41b04255ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:18.984846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:18.986062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:18.986964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:18.986964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:18.986964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:18.986964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 453/904] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:18.987199 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ef08b-58d7-41a8-bcd8-c41b04255ae0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:19.042197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:19.090797 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0aa497-223a-412b-b6b7-fddba82c4bc3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:19.107757 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ef08b-58d7-41a8-bcd8-c41b04255ae0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:19.115968 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:19.130883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa8591-8f30-4e5b-85d2-7e37236d6dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:19.131492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa8591-8f30-4e5b-85d2-7e37236d6dff None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:19.131768 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa8591-8f30-4e5b-85d2-7e37236d6dff None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:19.132298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa8591-8f30-4e5b-85d2-7e37236d6dff None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:19.132681 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa8591-8f30-4e5b-85d2-7e37236d6dff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:19.134330 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa8591-8f30-4e5b-85d2-7e37236d6dff None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:19.144520 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e8609-3820-4136-8734-2a5a2198e2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:19.145225 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e8609-3820-4136-8734-2a5a2198e2ab None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:19.145515 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e8609-3820-4136-8734-2a5a2198e2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:19.145817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e8609-3820-4136-8734-2a5a2198e2ab None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:19.146443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e8609-3820-4136-8734-2a5a2198e2ab None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:19.146752 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e8609-3820-4136-8734-2a5a2198e2ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:19.148276 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e8609-3820-4136-8734-2a5a2198e2ab None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:19.161749 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 452/905] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Sep 27 17:11:18 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:11:19.161749 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa8591-8f30-4e5b-85d2-7e37236d6dff None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:19.162063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 454/906] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Sep 27 17:11:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:19.162063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e8609-3820-4136-8734-2a5a2198e2ab None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:19.273281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e8609-3820-4136-8734-2a5a2198e2ab None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:19.275120 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:19.319235 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa8591-8f30-4e5b-85d2-7e37236d6dff None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:19.324550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66686835-5d9b-433b-ac92-63aee19df22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:19.325176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66686835-5d9b-433b-ac92-63aee19df22e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:19.325454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66686835-5d9b-433b-ac92-63aee19df22e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:19.325749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66686835-5d9b-433b-ac92-63aee19df22e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:19.326460 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66686835-5d9b-433b-ac92-63aee19df22e None admin] RBAC: Adding query filter params (interface=public, service_id=1c03a13f252c4fa7ab8dff4a613ae163, region_id=RegionOne) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:19.326765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66686835-5d9b-433b-ac92-63aee19df22e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:19.328246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66686835-5d9b-433b-ac92-63aee19df22e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:19.340033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 455/907] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Sep 27 17:11:19 2022] GET /identity/v3/endpoints?service_id=1c03a13f252c4fa7ab8dff4a613ae163&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:19.341455 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66686835-5d9b-433b-ac92-63aee19df22e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:19.360613 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a155544-b645-45e6-abcd-10de0b8e5759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:19.361231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a155544-b645-45e6-abcd-10de0b8e5759 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:19.361509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a155544-b645-45e6-abcd-10de0b8e5759 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:19.362130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a155544-b645-45e6-abcd-10de0b8e5759 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:19.362555 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a155544-b645-45e6-abcd-10de0b8e5759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:19.363095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a155544-b645-45e6-abcd-10de0b8e5759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:19.364372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a155544-b645-45e6-abcd-10de0b8e5759 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:19.378609 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 453/908] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:19.385876 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a155544-b645-45e6-abcd-10de0b8e5759 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:19.431286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:19.475822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66686835-5d9b-433b-ac92-63aee19df22e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:19.499185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a155544-b645-45e6-abcd-10de0b8e5759 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:19.523809 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecf513-c1f2-440b-a3dc-713fac8b88fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:19.524367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecf513-c1f2-440b-a3dc-713fac8b88fc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:19.524642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecf513-c1f2-440b-a3dc-713fac8b88fc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:19.524913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecf513-c1f2-440b-a3dc-713fac8b88fc None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:19.525583 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecf513-c1f2-440b-a3dc-713fac8b88fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:19.527055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecf513-c1f2-440b-a3dc-713fac8b88fc None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:19.536407 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 456/909] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Sep 27 17:11:19 2022] GET /identity/v3/services => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:11:19.550748 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876a020-ea78-438c-9b15-976890c1b92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:19.551400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876a020-ea78-438c-9b15-976890c1b92c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:19.551676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876a020-ea78-438c-9b15-976890c1b92c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:19.552015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876a020-ea78-438c-9b15-976890c1b92c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:19.561444 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876a020-ea78-438c-9b15-976890c1b92c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:19.563043 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876a020-ea78-438c-9b15-976890c1b92c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:19.576707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-0876a020-ea78-438c-9b15-976890c1b92c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:19.576707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:19.576707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:19.576707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:19.576707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:19.576707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:19.576707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:19.576707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:19.576707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:19.576707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:19.576707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:19.576707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:19.576707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:11:19.576707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:11:19.576707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:19.577774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:19.578741 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:11:19.578741 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:11:19.578741 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:11:19.578741 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:11:19.578741 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:11:19.578741 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:11:19.578741 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:19.578741 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:19.578741 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 454/910] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:19.586121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecf513-c1f2-440b-a3dc-713fac8b88fc None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:19.624347 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:19.705945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecf513-c1f2-440b-a3dc-713fac8b88fc None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:19.745897 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e99858-2fad-4412-9252-3bfe233dda2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:19.746518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e99858-2fad-4412-9252-3bfe233dda2e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:19.746804 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e99858-2fad-4412-9252-3bfe233dda2e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:19.747082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e99858-2fad-4412-9252-3bfe233dda2e None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:19.747787 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e99858-2fad-4412-9252-3bfe233dda2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:19.748095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e99858-2fad-4412-9252-3bfe233dda2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:19.749520 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e99858-2fad-4412-9252-3bfe233dda2e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:19.763063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 457/911] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:11:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:19.769159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876a020-ea78-438c-9b15-976890c1b92c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:19.879923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:19.883926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876a020-ea78-438c-9b15-976890c1b92c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:19.920259 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0dc130-f4e8-4319-be67-37840d1a60af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:19.920869 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dc130-f4e8-4319-be67-37840d1a60af None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:19.921153 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dc130-f4e8-4319-be67-37840d1a60af None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:19.921426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dc130-f4e8-4319-be67-37840d1a60af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:19.922188 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0dc130-f4e8-4319-be67-37840d1a60af None admin] RBAC: Adding query filter params (role.id=f93bdd156ab34beea98ecf5280cca56b, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=fa016315ab6f4175974ed15311341e33) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:19.922499 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0dc130-f4e8-4319-be67-37840d1a60af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:19.924004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0dc130-f4e8-4319-be67-37840d1a60af None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:19.930088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 455/912] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:11:19 2022] GET /identity/v3/role_assignments?user.id=fa016315ab6f4175974ed15311341e33&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f93bdd156ab34beea98ecf5280cca56b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:21.489461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20867cec-fc8d-43ac-8c2d-42353067578e None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:21.490280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20867cec-fc8d-43ac-8c2d-42353067578e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:21.490280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20867cec-fc8d-43ac-8c2d-42353067578e None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:21.491572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 458/913] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:11:21.497562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a12d39-f255-4717-a069-774a6bcc3f59 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:21.498214 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a12d39-f255-4717-a069-774a6bcc3f59 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:21.498214 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a12d39-f255-4717-a069-774a6bcc3f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:21.517603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-84a12d39-f255-4717-a069-774a6bcc3f59 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:21.518805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-84a12d39-f255-4717-a069-774a6bcc3f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:21.558172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b506fa6-07ab-4e18-a89a-6893cac8a09c None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:21.558631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b506fa6-07ab-4e18-a89a-6893cac8a09c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:21.559116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b506fa6-07ab-4e18-a89a-6893cac8a09c None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:21.563590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 459/914] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:11:21.569924 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ede678-7a2d-4aca-ae19-bc504fbe527a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:21.570411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ede678-7a2d-4aca-ae19-bc504fbe527a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:21.570894 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ede678-7a2d-4aca-ae19-bc504fbe527a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:21.590183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 456/915] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:21.600677 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f8ede678-7a2d-4aca-ae19-bc504fbe527a None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:21.602669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f8ede678-7a2d-4aca-ae19-bc504fbe527a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:21.720515 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 460/916] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:21.821308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd14669-f1db-405c-99d9-e847677d4331 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:21.821745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd14669-f1db-405c-99d9-e847677d4331 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:21.821987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd14669-f1db-405c-99d9-e847677d4331 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:21.824036 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 457/917] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:21.829193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fc311-c843-45b3-88e5-85eec62ba83e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:21.829474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fc311-c843-45b3-88e5-85eec62ba83e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:21.829780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fc311-c843-45b3-88e5-85eec62ba83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:21.848842 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-852fc311-c843-45b3-88e5-85eec62ba83e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:21.850058 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-852fc311-c843-45b3-88e5-85eec62ba83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:21.865055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:21.921865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd14669-f1db-405c-99d9-e847677d4331 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:21.924862 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 461/918] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:22.070784 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:22.081142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd14669-f1db-405c-99d9-e847677d4331 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:22.116811 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241704f-6fe7-4e3d-a437-53944f491550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:22.117434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241704f-6fe7-4e3d-a437-53944f491550 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:22.117722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241704f-6fe7-4e3d-a437-53944f491550 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:22.118003 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241704f-6fe7-4e3d-a437-53944f491550 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:22.118580 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241704f-6fe7-4e3d-a437-53944f491550 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:22.120851 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241704f-6fe7-4e3d-a437-53944f491550 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-3241704f-6fe7-4e3d-a437-53944f491550 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:22.129594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:22.131552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:22.133111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:22.133111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:22.133111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:22.133111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:22.133111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:22.133111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:22.133111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:22.133111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:22.133111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:22.133111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:22.133111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:22.133111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:22.133111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 17:11:22.133111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:22.133111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 458/919] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Sep 27 17:11:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:22.145401 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fc311-c843-45b3-88e5-85eec62ba83e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:22.202657 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241704f-6fe7-4e3d-a437-53944f491550 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:22.285731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fc311-c843-45b3-88e5-85eec62ba83e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:22.321586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3200a6d-415e-4e78-825e-393a29b2af3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:22.322676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3200a6d-415e-4e78-825e-393a29b2af3d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:22.323148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3200a6d-415e-4e78-825e-393a29b2af3d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:22.323456 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3200a6d-415e-4e78-825e-393a29b2af3d None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:22.324092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3200a6d-415e-4e78-825e-393a29b2af3d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:22.324400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3200a6d-415e-4e78-825e-393a29b2af3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:22.325785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3200a6d-415e-4e78-825e-393a29b2af3d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:22.326866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241704f-6fe7-4e3d-a437-53944f491550 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:22.330530 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 462/920] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Sep 27 17:11:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:22.331394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3200a6d-415e-4e78-825e-393a29b2af3d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:22.349894 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:22.366332 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f44862-05e7-4176-b602-b0f1ed8a4985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:22.367060 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f44862-05e7-4176-b602-b0f1ed8a4985 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:22.367340 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f44862-05e7-4176-b602-b0f1ed8a4985 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:22.367606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f44862-05e7-4176-b602-b0f1ed8a4985 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:22.368189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f44862-05e7-4176-b602-b0f1ed8a4985 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:22.370201 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f44862-05e7-4176-b602-b0f1ed8a4985 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-85f44862-05e7-4176-b602-b0f1ed8a4985 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:22.378987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:22.379977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:22.380826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:22.380826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:22.380826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:22.380826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:22.380826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:22.380826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:22.380826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:22.380826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:22.380826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:22.380826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:22.380826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:22.380826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:22.380826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 17:11:22.380826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:22.380826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 459/921] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:11:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:22.381650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f44862-05e7-4176-b602-b0f1ed8a4985 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:22.405620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:22.454948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3200a6d-415e-4e78-825e-393a29b2af3d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:22.489781 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f44862-05e7-4176-b602-b0f1ed8a4985 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:22.491662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5da4f8-1830-4645-98ba-c949bbe08115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:22.492970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5da4f8-1830-4645-98ba-c949bbe08115 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:22.492970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5da4f8-1830-4645-98ba-c949bbe08115 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:22.492970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5da4f8-1830-4645-98ba-c949bbe08115 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:22.493394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5da4f8-1830-4645-98ba-c949bbe08115 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:22.495080 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5da4f8-1830-4645-98ba-c949bbe08115 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-6c5da4f8-1830-4645-98ba-c949bbe08115 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:22.504275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:22.505201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:22.506234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:22.506234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:22.506234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:22.506234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:22.506234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:22.506234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:22.506234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:22.506234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:22.506234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:22.506234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:22.506234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:22.506234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:22.506234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 17:11:22.506234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:22.506234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 463/922] 10.222.0.57 () {56 vars in 1132 bytes} [Tue Sep 27 17:11:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:22.507085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5da4f8-1830-4645-98ba-c949bbe08115 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:22.533922 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa8357-6b7d-4a5a-9024-6bf46fd87b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:22.535114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa8357-6b7d-4a5a-9024-6bf46fd87b3c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:22.535398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa8357-6b7d-4a5a-9024-6bf46fd87b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:22.535673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa8357-6b7d-4a5a-9024-6bf46fd87b3c None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:22.536299 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa8357-6b7d-4a5a-9024-6bf46fd87b3c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:22.536604 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa8357-6b7d-4a5a-9024-6bf46fd87b3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:22.538027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa8357-6b7d-4a5a-9024-6bf46fd87b3c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:22.543208 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 460/923] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Sep 27 17:11:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:22.543799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa8357-6b7d-4a5a-9024-6bf46fd87b3c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:22.599098 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:22.623897 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5da4f8-1830-4645-98ba-c949bbe08115 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:22.637609 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:22.653913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa8357-6b7d-4a5a-9024-6bf46fd87b3c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:22.663828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd05ad-3433-4bb0-913a-78e3da078ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:22.664445 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd05ad-3433-4bb0-913a-78e3da078ceb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:22.665135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd05ad-3433-4bb0-913a-78e3da078ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:22.665409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd05ad-3433-4bb0-913a-78e3da078ceb None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:22.666531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd05ad-3433-4bb0-913a-78e3da078ceb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:22.666836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd05ad-3433-4bb0-913a-78e3da078ceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:22.668233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd05ad-3433-4bb0-913a-78e3da078ceb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:22.673249 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 464/924] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:11:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:22.678643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd05ad-3433-4bb0-913a-78e3da078ceb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:22.690171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adacb5-09c9-4b88-8ee6-73df93ffb545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:22.690778 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adacb5-09c9-4b88-8ee6-73df93ffb545 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:22.691057 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adacb5-09c9-4b88-8ee6-73df93ffb545 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:22.691326 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adacb5-09c9-4b88-8ee6-73df93ffb545 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:22.691948 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adacb5-09c9-4b88-8ee6-73df93ffb545 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:22.692250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adacb5-09c9-4b88-8ee6-73df93ffb545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:22.693609 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adacb5-09c9-4b88-8ee6-73df93ffb545 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:22.701733 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 461/925] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Sep 27 17:11:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:22.701733 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adacb5-09c9-4b88-8ee6-73df93ffb545 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:22.792521 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd05ad-3433-4bb0-913a-78e3da078ceb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:22.805397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adacb5-09c9-4b88-8ee6-73df93ffb545 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:22.828478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1d31a-256f-4390-8ba6-96bbcae430bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:22.829085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d31a-256f-4390-8ba6-96bbcae430bc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:22.829534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d31a-256f-4390-8ba6-96bbcae430bc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:22.829839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d31a-256f-4390-8ba6-96bbcae430bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:22.830873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1d31a-256f-4390-8ba6-96bbcae430bc None admin] RBAC: Adding query filter params (interface=public, service_id=52ce2eb5bb2442e3a7ae142204105abb, region_id=RegionOne) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:22.831186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1d31a-256f-4390-8ba6-96bbcae430bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:22.832813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1d31a-256f-4390-8ba6-96bbcae430bc None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:22.838397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 465/926] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Sep 27 17:11:22 2022] GET /identity/v3/endpoints?service_id=52ce2eb5bb2442e3a7ae142204105abb&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:22.839278 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1d31a-256f-4390-8ba6-96bbcae430bc None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:22.846527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005ee13-9b8f-44b9-98df-3ef3df4b6341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:22.847145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005ee13-9b8f-44b9-98df-3ef3df4b6341 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:22.847419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005ee13-9b8f-44b9-98df-3ef3df4b6341 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:22.847686 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005ee13-9b8f-44b9-98df-3ef3df4b6341 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:22.848315 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005ee13-9b8f-44b9-98df-3ef3df4b6341 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:22.848617 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005ee13-9b8f-44b9-98df-3ef3df4b6341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:22.850052 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005ee13-9b8f-44b9-98df-3ef3df4b6341 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:22.851045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:22.860503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 462/927] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Sep 27 17:11:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:22.860503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005ee13-9b8f-44b9-98df-3ef3df4b6341 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:22.873427 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:22.945189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1d31a-256f-4390-8ba6-96bbcae430bc None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:22.957676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005ee13-9b8f-44b9-98df-3ef3df4b6341 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:22.978773 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78950260-881d-4759-9fb5-fc0ccbbe671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:22.979382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78950260-881d-4759-9fb5-fc0ccbbe671b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:22.979665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78950260-881d-4759-9fb5-fc0ccbbe671b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:22.979932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78950260-881d-4759-9fb5-fc0ccbbe671b None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:22.980552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78950260-881d-4759-9fb5-fc0ccbbe671b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:22.980852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78950260-881d-4759-9fb5-fc0ccbbe671b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:22.982240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78950260-881d-4759-9fb5-fc0ccbbe671b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:22.987005 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 466/928] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Sep 27 17:11:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:22.988205 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107470e-ced8-4f4e-a297-5ba1165e87e5 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:22.988487 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107470e-ced8-4f4e-a297-5ba1165e87e5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:22.988759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107470e-ced8-4f4e-a297-5ba1165e87e5 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:22.989969 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 467/929] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:22.990641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107470e-ced8-4f4e-a297-5ba1165e87e5 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:22.995797 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977743f-2498-4b42-8bd0-c6a794e79493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:22.996402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977743f-2498-4b42-8bd0-c6a794e79493 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:22.996678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977743f-2498-4b42-8bd0-c6a794e79493 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:22.996944 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977743f-2498-4b42-8bd0-c6a794e79493 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:22.997555 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977743f-2498-4b42-8bd0-c6a794e79493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:22.998921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977743f-2498-4b42-8bd0-c6a794e79493 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:23.004901 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 463/930] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Sep 27 17:11:22 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:11:23.005640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977743f-2498-4b42-8bd0-c6a794e79493 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:23.074023 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:23.093951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:23.111811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107470e-ced8-4f4e-a297-5ba1165e87e5 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:23.122716 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977743f-2498-4b42-8bd0-c6a794e79493 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:23.150120 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2c72d-c0c9-4842-b923-59f29d3ce901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:23.150776 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c72d-c0c9-4842-b923-59f29d3ce901 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:23.151061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c72d-c0c9-4842-b923-59f29d3ce901 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:23.151338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c72d-c0c9-4842-b923-59f29d3ce901 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:23.152027 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2c72d-c0c9-4842-b923-59f29d3ce901 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:23.153430 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2c72d-c0c9-4842-b923-59f29d3ce901 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:23.164971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120cb84-e7eb-45b8-81c5-0169e70cebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:23.165536 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120cb84-e7eb-45b8-81c5-0169e70cebf2 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:23.166397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120cb84-e7eb-45b8-81c5-0169e70cebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:23.166631 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120cb84-e7eb-45b8-81c5-0169e70cebf2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:23.167521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120cb84-e7eb-45b8-81c5-0169e70cebf2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:23.168998 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120cb84-e7eb-45b8-81c5-0169e70cebf2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:23.185904 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 468/931] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:11:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:11:23.187544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3427cf-3763-4b27-9a98-3525483a484a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:23.187906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3427cf-3763-4b27-9a98-3525483a484a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:23.188310 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3427cf-3763-4b27-9a98-3525483a484a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:23.200903 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 464/932] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:11:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:11:23.215825 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2c3427cf-3763-4b27-9a98-3525483a484a None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:23.217123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2c3427cf-3763-4b27-9a98-3525483a484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:23.319034 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 469/933] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:23.595091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120cb84-e7eb-45b8-81c5-0169e70cebf2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:23.702812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120cb84-e7eb-45b8-81c5-0169e70cebf2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:23.735138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:23.740222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62499e1-250a-44dd-9d4a-67f5e80859e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:23.740847 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62499e1-250a-44dd-9d4a-67f5e80859e3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:23.741370 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62499e1-250a-44dd-9d4a-67f5e80859e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:23.741646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62499e1-250a-44dd-9d4a-67f5e80859e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:23.755592 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62499e1-250a-44dd-9d4a-67f5e80859e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c62499e1-250a-44dd-9d4a-67f5e80859e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:11:23.761039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:23.762139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:23.762990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:23.762990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:23.762990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:23.762990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:23.762990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:11:23.762990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:11:23.762990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:11:23.762990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:11:23.762990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:11:23.762990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:11:23.762990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 17:11:23.762990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:23.765856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 465/934] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Sep 27 17:11:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:23.771435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3427cf-3763-4b27-9a98-3525483a484a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:23.828953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:23.880910 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3427cf-3763-4b27-9a98-3525483a484a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:23.918684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93229931-f28f-4779-8af4-cd4fbb08c23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:23.919702 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93229931-f28f-4779-8af4-cd4fbb08c23a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:23.920192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93229931-f28f-4779-8af4-cd4fbb08c23a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:23.920670 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93229931-f28f-4779-8af4-cd4fbb08c23a None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:23.921546 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93229931-f28f-4779-8af4-cd4fbb08c23a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:23.922090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93229931-f28f-4779-8af4-cd4fbb08c23a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:23.923659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93229931-f28f-4779-8af4-cd4fbb08c23a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:23.932810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 470/935] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Sep 27 17:11:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:23.938327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62499e1-250a-44dd-9d4a-67f5e80859e3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:24.050559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62499e1-250a-44dd-9d4a-67f5e80859e3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:24.088549 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c7741-d2aa-4c0e-9832-246b8b40f32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:24.089558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c7741-d2aa-4c0e-9832-246b8b40f32e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:24.090071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c7741-d2aa-4c0e-9832-246b8b40f32e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:24.090547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c7741-d2aa-4c0e-9832-246b8b40f32e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:24.102055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c7741-d2aa-4c0e-9832-246b8b40f32e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:24.104683 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c7741-d2aa-4c0e-9832-246b8b40f32e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-6b1c7741-d2aa-4c0e-9832-246b8b40f32e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:24.119655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:24.120647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:24.121546 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:24.121546 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:24.121546 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:24.123822 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 466/936] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:24.131328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93229931-f28f-4779-8af4-cd4fbb08c23a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:24.238680 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93229931-f28f-4779-8af4-cd4fbb08c23a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:24.253200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:24.284254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af3a0b-0603-4e56-87ff-ccb4e456044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:24.284873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af3a0b-0603-4e56-87ff-ccb4e456044e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:24.285156 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af3a0b-0603-4e56-87ff-ccb4e456044e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:24.285428 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af3a0b-0603-4e56-87ff-ccb4e456044e None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:24.286385 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af3a0b-0603-4e56-87ff-ccb4e456044e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:24.286691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af3a0b-0603-4e56-87ff-ccb4e456044e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:24.288050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af3a0b-0603-4e56-87ff-ccb4e456044e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:24.301316 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 471/937] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:24.307033 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c7741-d2aa-4c0e-9832-246b8b40f32e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:24.355247 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:24.415396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c7741-d2aa-4c0e-9832-246b8b40f32e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:24.451158 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254389a1-b5bc-4070-b8a5-1a717aeb745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:24.452152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254389a1-b5bc-4070-b8a5-1a717aeb745e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:24.452624 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254389a1-b5bc-4070-b8a5-1a717aeb745e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:24.453087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254389a1-b5bc-4070-b8a5-1a717aeb745e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:24.461125 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254389a1-b5bc-4070-b8a5-1a717aeb745e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:24.463323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254389a1-b5bc-4070-b8a5-1a717aeb745e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-254389a1-b5bc-4070-b8a5-1a717aeb745e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:11:24.474999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:24.475915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:24.476841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:24.476841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:24.476841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:11:24.476841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:11:24.476841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:11:24.476841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:11:24.476841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:11:24.476841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:11:24.476841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 17:11:24.476841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:24.479709 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 467/938] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Sep 27 17:11:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:24.487796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af3a0b-0603-4e56-87ff-ccb4e456044e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:24.594685 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af3a0b-0603-4e56-87ff-ccb4e456044e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:24.630511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd473a9-118c-4d79-b0a0-3f2fcb11431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:24.631488 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd473a9-118c-4d79-b0a0-3f2fcb11431b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:24.631964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd473a9-118c-4d79-b0a0-3f2fcb11431b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:24.632431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd473a9-118c-4d79-b0a0-3f2fcb11431b None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:24.633341 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd473a9-118c-4d79-b0a0-3f2fcb11431b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:24.633887 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd473a9-118c-4d79-b0a0-3f2fcb11431b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:24.636116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd473a9-118c-4d79-b0a0-3f2fcb11431b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:24.654499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 472/939] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Sep 27 17:11:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:24.662984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254389a1-b5bc-4070-b8a5-1a717aeb745e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:24.771208 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254389a1-b5bc-4070-b8a5-1a717aeb745e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:24.773800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:24.809056 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aa0f0-a4b6-446f-9d86-327b7f1c1fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:24.810004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aa0f0-a4b6-446f-9d86-327b7f1c1fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:24.810423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aa0f0-a4b6-446f-9d86-327b7f1c1fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:24.810866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aa0f0-a4b6-446f-9d86-327b7f1c1fa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:24.822880 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95aa0f0-a4b6-446f-9d86-327b7f1c1fa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:24.824683 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95aa0f0-a4b6-446f-9d86-327b7f1c1fa3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e95aa0f0-a4b6-446f-9d86-327b7f1c1fa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:24.839926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:24.841075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:24.842175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:24.842175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:24.842175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:24.843834 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 468/940] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:24.849592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd473a9-118c-4d79-b0a0-3f2fcb11431b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:24.883069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:24.956051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd473a9-118c-4d79-b0a0-3f2fcb11431b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:24.992258 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58d272-7f52-402d-92cb-d71c63b33d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:24.992870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58d272-7f52-402d-92cb-d71c63b33d6b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:24.993401 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58d272-7f52-402d-92cb-d71c63b33d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:24.993715 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58d272-7f52-402d-92cb-d71c63b33d6b None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:24.995127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58d272-7f52-402d-92cb-d71c63b33d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:24.995549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58d272-7f52-402d-92cb-d71c63b33d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:24.996907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58d272-7f52-402d-92cb-d71c63b33d6b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:25.008907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 473/941] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:25.014990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aa0f0-a4b6-446f-9d86-327b7f1c1fa3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:25.123221 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aa0f0-a4b6-446f-9d86-327b7f1c1fa3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:25.159258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb3031-ef80-4f1a-ac08-e11ffa909f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:25.160238 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb3031-ef80-4f1a-ac08-e11ffa909f0c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:25.160738 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb3031-ef80-4f1a-ac08-e11ffa909f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:25.161202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb3031-ef80-4f1a-ac08-e11ffa909f0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:25.169721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb3031-ef80-4f1a-ac08-e11ffa909f0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:25.171387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb3031-ef80-4f1a-ac08-e11ffa909f0c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:25.183421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1cfb3031-ef80-4f1a-ac08-e11ffa909f0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:25.183421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:25.183421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:25.183421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:25.183421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:25.183421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:25.183421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:25.183421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:25.183421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:25.183421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:25.183421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:25.183421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:25.183421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:11:25.183421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:11:25.183421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:25.184355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:25.185240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:11:25.185240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:11:25.185240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:11:25.185240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:11:25.185240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:11:25.185240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:11:25.185240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:25.185240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:25.187603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 469/942] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:25.193723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58d272-7f52-402d-92cb-d71c63b33d6b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:25.295693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:25.305063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58d272-7f52-402d-92cb-d71c63b33d6b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:25.345840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdb9c0-aacf-4433-bc59-7cc6064cc721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:25.346463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdb9c0-aacf-4433-bc59-7cc6064cc721 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:25.346817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdb9c0-aacf-4433-bc59-7cc6064cc721 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:25.347092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdb9c0-aacf-4433-bc59-7cc6064cc721 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:25.347792 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdb9c0-aacf-4433-bc59-7cc6064cc721 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:25.348099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdb9c0-aacf-4433-bc59-7cc6064cc721 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:25.349516 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdb9c0-aacf-4433-bc59-7cc6064cc721 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:25.354673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4a259-0985-409c-b46b-6df2d373a077 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:25.355263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4a259-0985-409c-b46b-6df2d373a077 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:25.355742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4a259-0985-409c-b46b-6df2d373a077 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:25.357492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 470/943] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:25.362909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4253b-c06e-4ac3-baaf-792e769d77ab None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:25.363135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 474/944] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:11:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:25.363624 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4253b-c06e-4ac3-baaf-792e769d77ab None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:25.364093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4253b-c06e-4ac3-baaf-792e769d77ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:25.369397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdb9c0-aacf-4433-bc59-7cc6064cc721 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:25.384261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-22f4253b-c06e-4ac3-baaf-792e769d77ab None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:25.386722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-22f4253b-c06e-4ac3-baaf-792e769d77ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:25.399834 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:25.472951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 471/945] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:25.474251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5ee02-f9d3-4497-a248-c881d949b6d8 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:25.474531 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5ee02-f9d3-4497-a248-c881d949b6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:25.474801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5ee02-f9d3-4497-a248-c881d949b6d8 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:25.476160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 472/946] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:25.482164 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb2070-c0a3-40ce-bc3a-05b61ad1d5e9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:25.482445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb2070-c0a3-40ce-bc3a-05b61ad1d5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:25.482781 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb2070-c0a3-40ce-bc3a-05b61ad1d5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:25.489336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdb9c0-aacf-4433-bc59-7cc6064cc721 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:25.501460 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-27eb2070-c0a3-40ce-bc3a-05b61ad1d5e9 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:25.502685 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-27eb2070-c0a3-40ce-bc3a-05b61ad1d5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:25.530330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2908f3-8ff4-48df-895b-5187792db25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:25.531785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2908f3-8ff4-48df-895b-5187792db25d None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:25.532230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2908f3-8ff4-48df-895b-5187792db25d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:25.532663 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2908f3-8ff4-48df-895b-5187792db25d None admin] PATH_INFO: `/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/fa016315ab6f4175974ed15311341e33/roles/f93bdd156ab34beea98ecf5280cca56b` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:25.534964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2908f3-8ff4-48df-895b-5187792db25d None admin] RBAC: Authorizing `identity:create_grant(project_id=20fffa15f44b4f519ac7e29a48a7a596, user_id=fa016315ab6f4175974ed15311341e33, role_id=f93bdd156ab34beea98ecf5280cca56b)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:25.536509 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2908f3-8ff4-48df-895b-5187792db25d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:25.558979 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 475/947] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:11:25 2022] PUT /identity/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/fa016315ab6f4175974ed15311341e33/roles/f93bdd156ab34beea98ecf5280cca56b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:11:25.560712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4d364-9423-41f5-b71e-152c9a14e59a None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:25.560993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4d364-9423-41f5-b71e-152c9a14e59a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:25.561273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4d364-9423-41f5-b71e-152c9a14e59a None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:25.566859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 476/948] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:25.568690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b02094-cebd-488b-a221-85abf67369ad None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:25.568979 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b02094-cebd-488b-a221-85abf67369ad None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:25.569257 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b02094-cebd-488b-a221-85abf67369ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:25.584865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 473/949] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:25.588916 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-20b02094-cebd-488b-a221-85abf67369ad None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:25.590177 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-20b02094-cebd-488b-a221-85abf67369ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:25.609896 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:25.676121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 477/950] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:25.751943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb2070-c0a3-40ce-bc3a-05b61ad1d5e9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:25.857183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb2070-c0a3-40ce-bc3a-05b61ad1d5e9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:25.860742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:25.874550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b02094-cebd-488b-a221-85abf67369ad None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:25.903206 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501874a-62c9-43b5-8e84-98600f049187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:25.904166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501874a-62c9-43b5-8e84-98600f049187 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:25.904447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501874a-62c9-43b5-8e84-98600f049187 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:25.904718 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501874a-62c9-43b5-8e84-98600f049187 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:25.905560 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501874a-62c9-43b5-8e84-98600f049187 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:25.907124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501874a-62c9-43b5-8e84-98600f049187 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9501874a-62c9-43b5-8e84-98600f049187 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:25.918574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:25.919567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:25.920419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:25.920419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:25.920419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:25.920419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:25.920419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:25.920419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:25.920419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:25.920419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:25.920419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:25.920419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:25.920419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:25.920419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:25.920419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 17:11:25.920419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:25.920419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 474/951] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Sep 27 17:11:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:25.925627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501874a-62c9-43b5-8e84-98600f049187 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:25.992777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b02094-cebd-488b-a221-85abf67369ad None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:26.030022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906fa77-dbe6-474a-82c9-0ea83b769a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:26.030628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906fa77-dbe6-474a-82c9-0ea83b769a21 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:26.030906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906fa77-dbe6-474a-82c9-0ea83b769a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:26.031176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906fa77-dbe6-474a-82c9-0ea83b769a21 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:26.031821 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906fa77-dbe6-474a-82c9-0ea83b769a21 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:26.032218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501874a-62c9-43b5-8e84-98600f049187 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:26.033239 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9906fa77-dbe6-474a-82c9-0ea83b769a21 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:26.035855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: WARNING keystone.server.flask.common [None req-9906fa77-dbe6-474a-82c9-0ea83b769a21 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 27 17:11:26.049994 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:26.055066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.sql.core [None req-9906fa77-dbe6-474a-82c9-0ea83b769a21 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 27 17:11:26.055066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 27 17:11:26.055066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [parameters: {'id': '2024ac331f9d4f1e933bfcd790c09dc3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 27 17:11:26.055066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81378) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 27 17:11:26.068579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe0db5-9491-46b8-b4df-7809d025f3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:26.069240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe0db5-9491-46b8-b4df-7809d025f3fe None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:26.069523 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe0db5-9491-46b8-b4df-7809d025f3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:26.069829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe0db5-9491-46b8-b4df-7809d025f3fe None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:26.070463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe0db5-9491-46b8-b4df-7809d025f3fe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:26.070782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe0db5-9491-46b8-b4df-7809d025f3fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:26.072710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe0db5-9491-46b8-b4df-7809d025f3fe None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:26.074099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-9906fa77-dbe6-474a-82c9-0ea83b769a21 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2024ac331f9d4f1e933bfcd790c09dc3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2024ac331f9d4f1e933bfcd790c09dc3. Sep 27 17:11:26.074099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:26.074099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 17:11:26.074099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 17:11:26.074099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 17:11:26.074099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 17:11:26.074099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 17:11:26.074099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 17:11:26.074099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 17:11:26.074099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application conn.query(q) Sep 27 17:11:26.074099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 17:11:26.074099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 17:11:26.074099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application result.read() Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 27 17:11:26.074930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application next(self.gen) Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application yield resource Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application next(self.gen) Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self.session.rollback() Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self.force_reraise() Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise self.value Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application session.commit() Sep 27 17:11:26.075923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._prepare_impl() Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self.session.flush() Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._flush(objects) Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application compat.raise_( Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application flush_context.execute() Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 27 17:11:26.076847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rec.execute(self) Sep 27 17:11:26.078762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 27 17:11:26.078762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 27 17:11:26.078762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 27 17:11:26.078762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 27 17:11:26.078762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 27 17:11:26.078762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 27 17:11:26.078762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 27 17:11:26.078762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 27 17:11:26.078762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 27 17:11:26.078762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 27 17:11:26.078762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 27 17:11:26.078762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 27 17:11:26.078762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 27 17:11:26.078762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 27 17:11:26.078762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application conn.query(q) Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application result.read() Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 17:11:26.080079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 17:11:26.083847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 17:11:26.083847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 17:11:26.083847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 17:11:26.083847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 17:11:26.083847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 17:11:26.083847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 17:11:26.083847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 27 17:11:26.083847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 27 17:11:26.083847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [parameters: {'id': '2024ac331f9d4f1e933bfcd790c09dc3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 27 17:11:26.083847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 27 17:11:26.083847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:26.083847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:26.083847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:26.083847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:26.083847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:26.090709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:26.091845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:26.091845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 27 17:11:26.091845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 27 17:11:26.091845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:26.091845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:26.091845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 27 17:11:26.091845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 27 17:11:26.091845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2024ac331f9d4f1e933bfcd790c09dc3. Sep 27 17:11:26.091845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:26.091845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 478/952] 10.222.0.57 () {60 vars in 1140 bytes} [Tue Sep 27 17:11:25 2022] POST /identity/v3/projects => generated 262 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:26.091845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906fa77-dbe6-474a-82c9-0ea83b769a21 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:26.092773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 475/953] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Sep 27 17:11:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:26.092773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe0db5-9491-46b8-b4df-7809d025f3fe None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:26.094688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:26.187766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906fa77-dbe6-474a-82c9-0ea83b769a21 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:26.204044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe0db5-9491-46b8-b4df-7809d025f3fe None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:26.224948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988adb23-5ec3-4e4e-972d-eac4849174b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:26.225762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988adb23-5ec3-4e4e-972d-eac4849174b3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:26.226179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988adb23-5ec3-4e4e-972d-eac4849174b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:26.226533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988adb23-5ec3-4e4e-972d-eac4849174b3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:26.227288 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988adb23-5ec3-4e4e-972d-eac4849174b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:26.229663 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988adb23-5ec3-4e4e-972d-eac4849174b3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:26.237845 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5ab25-bb8a-48fa-a5ff-7c481d27ce34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:26.238542 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5ab25-bb8a-48fa-a5ff-7c481d27ce34 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:26.238892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5ab25-bb8a-48fa-a5ff-7c481d27ce34 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:26.239234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5ab25-bb8a-48fa-a5ff-7c481d27ce34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-988adb23-5ec3-4e4e-972d-eac4849174b3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:26.239393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:26.240665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:26.241959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:26.241959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:26.241959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:26.241959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:26.241959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:26.241959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:26.241959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:26.241959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:26.241959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:26.241959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:26.241959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:26.241959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:26.241959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 17:11:26.241959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:26.247344 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 479/954] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:26.247936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988adb23-5ec3-4e4e-972d-eac4849174b3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:26.249348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5ab25-bb8a-48fa-a5ff-7c481d27ce34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:26.250915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5ab25-bb8a-48fa-a5ff-7c481d27ce34 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:26.263223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-33d5ab25-bb8a-48fa-a5ff-7c481d27ce34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:26.263223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:26.263223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:26.263223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:26.263223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:26.263223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:26.263223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:26.263223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:26.263223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:26.263223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:26.263223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:26.263223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:26.263223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:11:26.263223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:11:26.263223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:26.264414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:26.265551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:11:26.265551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:11:26.265551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:11:26.265551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:11:26.265551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:11:26.265551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:11:26.265551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:26.265551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:26.270798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 476/955] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:26.270798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5ab25-bb8a-48fa-a5ff-7c481d27ce34 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:26.320966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:26.336564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:26.365734 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988adb23-5ec3-4e4e-972d-eac4849174b3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:26.380534 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5ab25-bb8a-48fa-a5ff-7c481d27ce34 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:26.408326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f67519-0567-4a34-8b8a-9e6369f38750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:26.408932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f67519-0567-4a34-8b8a-9e6369f38750 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:26.409218 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f67519-0567-4a34-8b8a-9e6369f38750 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:26.409509 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f67519-0567-4a34-8b8a-9e6369f38750 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:26.410184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f67519-0567-4a34-8b8a-9e6369f38750 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:26.410504 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f67519-0567-4a34-8b8a-9e6369f38750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:26.411841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f67519-0567-4a34-8b8a-9e6369f38750 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:26.422048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1395fd-b181-442a-a663-b1786bc8bd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:26.429828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 480/956] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Sep 27 17:11:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:26.429982 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1395fd-b181-442a-a663-b1786bc8bd3c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:26.429982 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1395fd-b181-442a-a663-b1786bc8bd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:26.429982 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1395fd-b181-442a-a663-b1786bc8bd3c None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:26.430215 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f67519-0567-4a34-8b8a-9e6369f38750 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:26.430320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1395fd-b181-442a-a663-b1786bc8bd3c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:26.430320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1395fd-b181-442a-a663-b1786bc8bd3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:26.430320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1395fd-b181-442a-a663-b1786bc8bd3c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:26.439269 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 477/957] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Sep 27 17:11:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:26.439269 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1395fd-b181-442a-a663-b1786bc8bd3c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:26.541985 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1395fd-b181-442a-a663-b1786bc8bd3c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:26.553175 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f67519-0567-4a34-8b8a-9e6369f38750 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:26.569543 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:26.578289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f897c1-6297-4a20-a1cd-fbf270923a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:26.578889 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f897c1-6297-4a20-a1cd-fbf270923a7b None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:26.579166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f897c1-6297-4a20-a1cd-fbf270923a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:26.579440 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f897c1-6297-4a20-a1cd-fbf270923a7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:26.580155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f897c1-6297-4a20-a1cd-fbf270923a7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:26.581543 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f897c1-6297-4a20-a1cd-fbf270923a7b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:26.582744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:26.592119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f03ee-9733-4e1b-80ce-22dbb5c4deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:26.592875 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f03ee-9733-4e1b-80ce-22dbb5c4deaa None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:26.593158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f03ee-9733-4e1b-80ce-22dbb5c4deaa None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:26.593528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f03ee-9733-4e1b-80ce-22dbb5c4deaa None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:26.594374 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f03ee-9733-4e1b-80ce-22dbb5c4deaa None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:26.594700 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f03ee-9733-4e1b-80ce-22dbb5c4deaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:26.596335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f03ee-9733-4e1b-80ce-22dbb5c4deaa None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:26.613728 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 478/958] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:11:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:11:26.613728 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f897c1-6297-4a20-a1cd-fbf270923a7b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:26.625739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 481/959] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Sep 27 17:11:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:26.723794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f897c1-6297-4a20-a1cd-fbf270923a7b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:26.764179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ab3a5-33f8-4f8a-bc67-22fefbea2648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:26.764830 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ab3a5-33f8-4f8a-bc67-22fefbea2648 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:26.765074 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ab3a5-33f8-4f8a-bc67-22fefbea2648 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:26.765350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ab3a5-33f8-4f8a-bc67-22fefbea2648 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:26.766028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ab3a5-33f8-4f8a-bc67-22fefbea2648 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:26.766332 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ab3a5-33f8-4f8a-bc67-22fefbea2648 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:26.767741 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ab3a5-33f8-4f8a-bc67-22fefbea2648 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:26.773503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 479/960] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Sep 27 17:11:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:27.836108 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6f31c-9252-4aab-bd45-ddacc0ec3696 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:27.836631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6f31c-9252-4aab-bd45-ddacc0ec3696 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:27.836631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6f31c-9252-4aab-bd45-ddacc0ec3696 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:27.838312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 482/961] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:27.843567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72790e32-013b-44cf-acfd-b21bfcd0e638 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:27.843987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72790e32-013b-44cf-acfd-b21bfcd0e638 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:27.844095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72790e32-013b-44cf-acfd-b21bfcd0e638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:27.862667 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-72790e32-013b-44cf-acfd-b21bfcd0e638 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:27.863839 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-72790e32-013b-44cf-acfd-b21bfcd0e638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:27.903881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:27.934156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 480/962] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:28.208208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6f31c-9252-4aab-bd45-ddacc0ec3696 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:28.316110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6f31c-9252-4aab-bd45-ddacc0ec3696 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:28.354464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628f58b-8d0a-4589-926f-5939713ebbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:28.355495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628f58b-8d0a-4589-926f-5939713ebbfb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:28.355981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628f58b-8d0a-4589-926f-5939713ebbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:28.356507 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628f58b-8d0a-4589-926f-5939713ebbfb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:28.367531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628f58b-8d0a-4589-926f-5939713ebbfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-0628f58b-8d0a-4589-926f-5939713ebbfb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:11:28.372684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:28.373628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:28.374524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:28.374524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:28.374524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:28.374524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:28.374524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:11:28.374524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:11:28.374524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:11:28.374524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:11:28.374524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:11:28.374524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:11:28.374524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 17:11:28.374524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:28.377233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 483/963] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Sep 27 17:11:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:28.385827 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72790e32-013b-44cf-acfd-b21bfcd0e638 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:28.487435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72790e32-013b-44cf-acfd-b21bfcd0e638 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:28.522423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03fc72-4fa0-4e52-9a9b-68b844dd885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:28.523030 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03fc72-4fa0-4e52-9a9b-68b844dd885d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:28.523304 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03fc72-4fa0-4e52-9a9b-68b844dd885d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:28.523572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03fc72-4fa0-4e52-9a9b-68b844dd885d None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:28.524229 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03fc72-4fa0-4e52-9a9b-68b844dd885d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:28.524528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03fc72-4fa0-4e52-9a9b-68b844dd885d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:28.526020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03fc72-4fa0-4e52-9a9b-68b844dd885d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:28.534674 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 481/964] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Sep 27 17:11:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:28.540916 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628f58b-8d0a-4589-926f-5939713ebbfb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:28.592774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:28.651061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628f58b-8d0a-4589-926f-5939713ebbfb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:28.687363 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881f03d-3b84-4f7f-9d83-7d1b1f1d5a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:28.688373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881f03d-3b84-4f7f-9d83-7d1b1f1d5a71 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:28.688861 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881f03d-3b84-4f7f-9d83-7d1b1f1d5a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:28.689337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881f03d-3b84-4f7f-9d83-7d1b1f1d5a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:28.700421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881f03d-3b84-4f7f-9d83-7d1b1f1d5a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:28.702136 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881f03d-3b84-4f7f-9d83-7d1b1f1d5a71 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-3881f03d-3b84-4f7f-9d83-7d1b1f1d5a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:28.718077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:28.719083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:28.720022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:28.720022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:28.720022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:28.722126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 484/965] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:28.730738 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03fc72-4fa0-4e52-9a9b-68b844dd885d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:28.765131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:28.838462 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03fc72-4fa0-4e52-9a9b-68b844dd885d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:28.878136 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52970994-2a32-45c7-a243-bce08d90fcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:28.878763 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52970994-2a32-45c7-a243-bce08d90fcff None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:28.879037 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52970994-2a32-45c7-a243-bce08d90fcff None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:28.879271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52970994-2a32-45c7-a243-bce08d90fcff None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:28.879915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52970994-2a32-45c7-a243-bce08d90fcff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:28.880219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52970994-2a32-45c7-a243-bce08d90fcff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:28.881579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52970994-2a32-45c7-a243-bce08d90fcff None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:28.898101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 482/966] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:28.902854 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881f03d-3b84-4f7f-9d83-7d1b1f1d5a71 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:28.933866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fb3c1-21ee-4f76-b048-69fd88d94839 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:28.934432 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fb3c1-21ee-4f76-b048-69fd88d94839 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:28.934875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fb3c1-21ee-4f76-b048-69fd88d94839 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:28.936711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 483/967] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:28.942463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a93e9-0d2d-4b9e-8063-27a0c9a82cf4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:28.942832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a93e9-0d2d-4b9e-8063-27a0c9a82cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:28.943001 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a93e9-0d2d-4b9e-8063-27a0c9a82cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:28.962105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d40a93e9-0d2d-4b9e-8063-27a0c9a82cf4 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:28.964185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d40a93e9-0d2d-4b9e-8063-27a0c9a82cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:29.014399 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:29.020207 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881f03d-3b84-4f7f-9d83-7d1b1f1d5a71 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:29.040157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 484/968] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:29.042416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef4482-de74-4d42-ae8d-2acb9e059b8a None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:29.042707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef4482-de74-4d42-ae8d-2acb9e059b8a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:29.042984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef4482-de74-4d42-ae8d-2acb9e059b8a None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:29.044387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 485/969] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:29.049534 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200cc2a-4e4a-472a-85ec-1869a3c8b5d1 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:29.049852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200cc2a-4e4a-472a-85ec-1869a3c8b5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:29.050165 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200cc2a-4e4a-472a-85ec-1869a3c8b5d1 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:29.051426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 486/970] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:29.052423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05f9c2-04f9-49a3-b9f9-583e9a14c102 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:29.052704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05f9c2-04f9-49a3-b9f9-583e9a14c102 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:29.052975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05f9c2-04f9-49a3-b9f9-583e9a14c102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:29.068239 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dae03-47b9-42b8-8bc0-54e8b97221d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:29.069106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dae03-47b9-42b8-8bc0-54e8b97221d1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:29.069401 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dae03-47b9-42b8-8bc0-54e8b97221d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:29.069671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dae03-47b9-42b8-8bc0-54e8b97221d1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:29.072305 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6f05f9c2-04f9-49a3-b9f9-583e9a14c102 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:29.073769 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6f05f9c2-04f9-49a3-b9f9-583e9a14c102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:29.077771 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dae03-47b9-42b8-8bc0-54e8b97221d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:29.079212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dae03-47b9-42b8-8bc0-54e8b97221d1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-109dae03-47b9-42b8-8bc0-54e8b97221d1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:11:29.091788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:29.098393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:29.099449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:29.099449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:29.099449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:11:29.099449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:11:29.099449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:11:29.099449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:11:29.099449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:11:29.099449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:11:29.099449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 17:11:29.099449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:29.099449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 485/971] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Sep 27 17:11:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:29.099449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984820fa-4757-438f-b3df-2f432e5e5ed6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:29.099449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984820fa-4757-438f-b3df-2f432e5e5ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:29.100269 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984820fa-4757-438f-b3df-2f432e5e5ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:29.102056 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:29.116657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-984820fa-4757-438f-b3df-2f432e5e5ed6 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:29.118237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-984820fa-4757-438f-b3df-2f432e5e5ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:29.152410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 487/972] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:29.153604 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05f9c2-04f9-49a3-b9f9-583e9a14c102 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:29.205710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 486/973] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:29.274840 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05f9c2-04f9-49a3-b9f9-583e9a14c102 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:29.317343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9127f-cc49-496f-86a5-24b5e8276e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:29.318416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9127f-cc49-496f-86a5-24b5e8276e43 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:29.318783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9127f-cc49-496f-86a5-24b5e8276e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:29.319013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9127f-cc49-496f-86a5-24b5e8276e43 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:29.319926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9127f-cc49-496f-86a5-24b5e8276e43 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:29.320434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9127f-cc49-496f-86a5-24b5e8276e43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:29.323412 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9127f-cc49-496f-86a5-24b5e8276e43 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:29.329078 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984820fa-4757-438f-b3df-2f432e5e5ed6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:29.346159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 488/974] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Sep 27 17:11:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:29.351915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9127f-cc49-496f-86a5-24b5e8276e43 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:29.378828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:29.447248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:29.465957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984820fa-4757-438f-b3df-2f432e5e5ed6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:29.470632 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9127f-cc49-496f-86a5-24b5e8276e43 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:29.507469 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38c653-dbab-4d7b-a7fd-a6f107259d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:29.508462 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38c653-dbab-4d7b-a7fd-a6f107259d7b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:29.508762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38c653-dbab-4d7b-a7fd-a6f107259d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:29.509060 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38c653-dbab-4d7b-a7fd-a6f107259d7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:29.511479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abefb72-8061-4d70-ac2a-4a59c42897b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:29.512529 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abefb72-8061-4d70-ac2a-4a59c42897b7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:29.513018 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abefb72-8061-4d70-ac2a-4a59c42897b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:29.513566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abefb72-8061-4d70-ac2a-4a59c42897b7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:29.514252 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abefb72-8061-4d70-ac2a-4a59c42897b7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:29.515617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abefb72-8061-4d70-ac2a-4a59c42897b7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-7abefb72-8061-4d70-ac2a-4a59c42897b7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:29.525590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:29.530479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:29.532723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:29.532723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:29.532723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:29.532723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:29.532723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:29.532723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:29.532723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:29.532723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:29.532723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:29.532723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:29.532723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:29.532723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:29.532723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 17:11:29.532723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:29.532723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 487/975] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Sep 27 17:11:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:29.533573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abefb72-8061-4d70-ac2a-4a59c42897b7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:29.594282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38c653-dbab-4d7b-a7fd-a6f107259d7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:29.595727 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38c653-dbab-4d7b-a7fd-a6f107259d7b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:29.615341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:29.640081 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abefb72-8061-4d70-ac2a-4a59c42897b7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:29.676541 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c13b0e-d699-4b48-a8b0-80375361559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:29.677315 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c13b0e-d699-4b48-a8b0-80375361559c None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:29.677595 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c13b0e-d699-4b48-a8b0-80375361559c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:29.677905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c13b0e-d699-4b48-a8b0-80375361559c None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:29.678551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c13b0e-d699-4b48-a8b0-80375361559c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:29.679975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c13b0e-d699-4b48-a8b0-80375361559c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:29.699128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.sql.core [None req-30c13b0e-d699-4b48-a8b0-80375361559c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 27 17:11:29.699128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 27 17:11:29.699128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [parameters: {'user_id': '490a794e275246d393ccb18b92f1c64b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 27 17:11:29.699128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81378) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 27 17:11:29.708150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-30c13b0e-d699-4b48-a8b0-80375361559c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 27 17:11:29.708150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:29.708150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 17:11:29.708150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 17:11:29.708150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 17:11:29.708150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 17:11:29.708150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 17:11:29.708150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 17:11:29.708150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 17:11:29.708150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application conn.query(q) Sep 27 17:11:29.708150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 17:11:29.708150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 17:11:29.708150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 17:11:29.708150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application result.read() Sep 27 17:11:29.708150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 17:11:29.709103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application next(self.gen) Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application yield resource Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application next(self.gen) Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self.session.rollback() Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self.force_reraise() Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise self.value Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application session.commit() Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 27 17:11:29.710599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._prepare_impl() Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self.session.flush() Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._flush(objects) Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application compat.raise_( Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application flush_context.execute() Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rec.execute(self) Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 27 17:11:29.711690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 27 17:11:29.713172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application result = self._query(query) Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application conn.query(q) Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application result.read() Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 27 17:11:29.714431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 27 17:11:29.716227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 27 17:11:29.716227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 27 17:11:29.716227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 27 17:11:29.716227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 27 17:11:29.716227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 27 17:11:29.716227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 27 17:11:29.716227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [parameters: {'user_id': '490a794e275246d393ccb18b92f1c64b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 27 17:11:29.716227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 27 17:11:29.716227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:29.716227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:29.716227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:29.716227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:29.716227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:29.716227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:29.716227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 27 17:11:29.718431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 27 17:11:29.721413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 27 17:11:29.721413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 27 17:11:29.721413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 27 17:11:29.721413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 27 17:11:29.721413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 27 17:11:29.721413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:29.721413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 488/976] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Sep 27 17:11:29 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:29.721413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c13b0e-d699-4b48-a8b0-80375361559c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:29.722274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 489/977] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:11:29 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 17:11:29.722274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38c653-dbab-4d7b-a7fd-a6f107259d7b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:29.733963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:29.835319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c13b0e-d699-4b48-a8b0-80375361559c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:29.841120 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38c653-dbab-4d7b-a7fd-a6f107259d7b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:29.856626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:29.877510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421b30e-4bdb-4d04-8e0b-af03fe1c9a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:29.878161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421b30e-4bdb-4d04-8e0b-af03fe1c9a65 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:29.878436 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421b30e-4bdb-4d04-8e0b-af03fe1c9a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:29.878705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421b30e-4bdb-4d04-8e0b-af03fe1c9a65 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:29.879350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421b30e-4bdb-4d04-8e0b-af03fe1c9a65 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:29.879556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3797b5-218a-437c-b8ec-5bc0a8d0395a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:29.880178 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3797b5-218a-437c-b8ec-5bc0a8d0395a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:29.880458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3797b5-218a-437c-b8ec-5bc0a8d0395a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:29.880726 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3797b5-218a-437c-b8ec-5bc0a8d0395a None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:29.880892 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421b30e-4bdb-4d04-8e0b-af03fe1c9a65 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:29.881378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3797b5-218a-437c-b8ec-5bc0a8d0395a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:29.881679 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3797b5-218a-437c-b8ec-5bc0a8d0395a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:29.883098 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3797b5-218a-437c-b8ec-5bc0a8d0395a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:29.889226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 490/978] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Sep 27 17:11:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:29.891466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3797b5-218a-437c-b8ec-5bc0a8d0395a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:29.904064 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 489/979] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Sep 27 17:11:29 2022] POST /identity/v3/services => generated 242 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:11:29.904910 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421b30e-4bdb-4d04-8e0b-af03fe1c9a65 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:30.007983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:30.013191 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3797b5-218a-437c-b8ec-5bc0a8d0395a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:30.052633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421b30e-4bdb-4d04-8e0b-af03fe1c9a65 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:30.054645 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52f96e-50a3-4107-827b-57dfd73f598d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:30.055316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52f96e-50a3-4107-827b-57dfd73f598d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:30.055595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52f96e-50a3-4107-827b-57dfd73f598d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:30.055865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52f96e-50a3-4107-827b-57dfd73f598d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:30.067415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52f96e-50a3-4107-827b-57dfd73f598d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:30.068927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52f96e-50a3-4107-827b-57dfd73f598d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-bb52f96e-50a3-4107-827b-57dfd73f598d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:11:30.083094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:30.084906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:30.086072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:30.086072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:30.086072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:11:30.086072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:11:30.086072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:11:30.086072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:11:30.086072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:11:30.086072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:11:30.086072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 17:11:30.086072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:30.086072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 491/980] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:11:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:30.086072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52f96e-50a3-4107-827b-57dfd73f598d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:30.105415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2897015-44a1-4d20-8ff3-c3d548eba20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:30.106112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2897015-44a1-4d20-8ff3-c3d548eba20c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:30.106403 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2897015-44a1-4d20-8ff3-c3d548eba20c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:30.106744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2897015-44a1-4d20-8ff3-c3d548eba20c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:30.119140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2897015-44a1-4d20-8ff3-c3d548eba20c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:30.120898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2897015-44a1-4d20-8ff3-c3d548eba20c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-b2897015-44a1-4d20-8ff3-c3d548eba20c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:30.141806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:30.142834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:30.143745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:30.143745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:30.143745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:30.143745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 490/981] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:30.144431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2897015-44a1-4d20-8ff3-c3d548eba20c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:30.145945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:30.215618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52f96e-50a3-4107-827b-57dfd73f598d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:30.251816 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25171f97-e902-48e7-8814-137ce8b3dcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:30.252432 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171f97-e902-48e7-8814-137ce8b3dcc7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:30.252712 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171f97-e902-48e7-8814-137ce8b3dcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:30.252988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171f97-e902-48e7-8814-137ce8b3dcc7 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:30.253617 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25171f97-e902-48e7-8814-137ce8b3dcc7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:30.253962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25171f97-e902-48e7-8814-137ce8b3dcc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:30.255320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25171f97-e902-48e7-8814-137ce8b3dcc7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:30.259958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2897015-44a1-4d20-8ff3-c3d548eba20c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:30.260223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 492/982] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Sep 27 17:11:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:30.261005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25171f97-e902-48e7-8814-137ce8b3dcc7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:30.289575 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:30.303739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfa4e7-182b-4154-8580-4e53b2f81342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:30.304353 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfa4e7-182b-4154-8580-4e53b2f81342 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:30.304634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfa4e7-182b-4154-8580-4e53b2f81342 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:30.304908 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfa4e7-182b-4154-8580-4e53b2f81342 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:30.305608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfa4e7-182b-4154-8580-4e53b2f81342 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:30.306035 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfa4e7-182b-4154-8580-4e53b2f81342 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:30.307467 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfa4e7-182b-4154-8580-4e53b2f81342 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:30.343100 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 491/983] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Sep 27 17:11:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:30.343858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfa4e7-182b-4154-8580-4e53b2f81342 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:30.393986 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25171f97-e902-48e7-8814-137ce8b3dcc7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:30.395862 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:30.454764 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131ddc6-9bc2-4e33-bab8-ffc202b2b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:30.455905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131ddc6-9bc2-4e33-bab8-ffc202b2b039 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:30.456638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131ddc6-9bc2-4e33-bab8-ffc202b2b039 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:30.456783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131ddc6-9bc2-4e33-bab8-ffc202b2b039 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:30.461708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131ddc6-9bc2-4e33-bab8-ffc202b2b039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:30.461708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131ddc6-9bc2-4e33-bab8-ffc202b2b039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:30.461708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131ddc6-9bc2-4e33-bab8-ffc202b2b039 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:30.476703 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 493/984] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:30.487157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131ddc6-9bc2-4e33-bab8-ffc202b2b039 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:30.511396 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfa4e7-182b-4154-8580-4e53b2f81342 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:30.550656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea069b17-aab1-40ab-969a-6f07022b468a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:30.551272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea069b17-aab1-40ab-969a-6f07022b468a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:30.551593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea069b17-aab1-40ab-969a-6f07022b468a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:30.551864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea069b17-aab1-40ab-969a-6f07022b468a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:30.552637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea069b17-aab1-40ab-969a-6f07022b468a None admin] RBAC: Adding query filter params (interface=admin, service_id=52ce2eb5bb2442e3a7ae142204105abb, region_id=RegionOne) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:30.552945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea069b17-aab1-40ab-969a-6f07022b468a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:30.555263 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea069b17-aab1-40ab-969a-6f07022b468a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:30.563258 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 492/985] 10.222.0.57 () {56 vars in 1249 bytes} [Tue Sep 27 17:11:30 2022] GET /identity/v3/endpoints?service_id=52ce2eb5bb2442e3a7ae142204105abb&interface=admin®ion_id=RegionOne => generated 193 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:30.568620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea069b17-aab1-40ab-969a-6f07022b468a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:30.633471 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131ddc6-9bc2-4e33-bab8-ffc202b2b039 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:30.634736 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:30.682394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47700a4-52a2-4044-856f-a0f127e6c92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:30.683332 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47700a4-52a2-4044-856f-a0f127e6c92a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:30.683817 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47700a4-52a2-4044-856f-a0f127e6c92a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:30.684314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47700a4-52a2-4044-856f-a0f127e6c92a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:30.691885 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47700a4-52a2-4044-856f-a0f127e6c92a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:30.693586 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47700a4-52a2-4044-856f-a0f127e6c92a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:30.703306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea069b17-aab1-40ab-969a-6f07022b468a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:30.706515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b47700a4-52a2-4044-856f-a0f127e6c92a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:30.706515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:30.706515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:30.706515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:30.706515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:30.706515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:30.706515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:30.706515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:30.706515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:30.706515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:30.706515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:30.706515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:30.706515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:11:30.706515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:11:30.706515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:30.707739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:30.708829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:11:30.708829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:11:30.708829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:11:30.708829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:11:30.708829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:11:30.708829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:11:30.708829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:30.708829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:30.710894 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 494/986] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:30.716357 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47700a4-52a2-4044-856f-a0f127e6c92a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:30.741758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:30.744276 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7fb53-3406-4195-be65-4b76a08b8387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:30.745222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7fb53-3406-4195-be65-4b76a08b8387 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:30.745643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7fb53-3406-4195-be65-4b76a08b8387 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:30.746717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7fb53-3406-4195-be65-4b76a08b8387 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:30.747575 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7fb53-3406-4195-be65-4b76a08b8387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:30.749189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7fb53-3406-4195-be65-4b76a08b8387 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:30.756459 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 493/987] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Sep 27 17:11:30 2022] GET /identity/v3/services => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:11:30.834696 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47700a4-52a2-4044-856f-a0f127e6c92a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:30.871742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227396d0-17a3-4cd1-95bb-8ff06c89decb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:30.872364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227396d0-17a3-4cd1-95bb-8ff06c89decb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:30.872640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227396d0-17a3-4cd1-95bb-8ff06c89decb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:30.872907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227396d0-17a3-4cd1-95bb-8ff06c89decb None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:30.873603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227396d0-17a3-4cd1-95bb-8ff06c89decb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:30.873930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227396d0-17a3-4cd1-95bb-8ff06c89decb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:30.875407 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227396d0-17a3-4cd1-95bb-8ff06c89decb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:30.889375 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 495/988] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:11:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:30.895144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7fb53-3406-4195-be65-4b76a08b8387 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:31.004504 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7fb53-3406-4195-be65-4b76a08b8387 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:31.014420 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:31.039811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59fe40-4268-42e8-a494-ed09c7e401fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:31.040582 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59fe40-4268-42e8-a494-ed09c7e401fe None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:31.040870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59fe40-4268-42e8-a494-ed09c7e401fe None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:31.041142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59fe40-4268-42e8-a494-ed09c7e401fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:31.041889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59fe40-4268-42e8-a494-ed09c7e401fe None admin] RBAC: Adding query filter params (role.id=f93bdd156ab34beea98ecf5280cca56b, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=fa016315ab6f4175974ed15311341e33) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:31.042202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59fe40-4268-42e8-a494-ed09c7e401fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:31.043619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59fe40-4268-42e8-a494-ed09c7e401fe None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:31.057774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 494/989] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:11:30 2022] GET /identity/v3/role_assignments?user.id=fa016315ab6f4175974ed15311341e33&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f93bdd156ab34beea98ecf5280cca56b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:32.185571 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75d92-7f7a-43ad-b908-32e030af692d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:32.186129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75d92-7f7a-43ad-b908-32e030af692d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:32.186129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf75d92-7f7a-43ad-b908-32e030af692d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:32.187600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 496/990] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:32.192824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a95a9-4c45-4e52-a36d-9cd8fb55bb25 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:32.193242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a95a9-4c45-4e52-a36d-9cd8fb55bb25 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:32.193411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a95a9-4c45-4e52-a36d-9cd8fb55bb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:32.213109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6f0a95a9-4c45-4e52-a36d-9cd8fb55bb25 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:32.214650 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6f0a95a9-4c45-4e52-a36d-9cd8fb55bb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:32.282431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 495/991] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:32.557553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf75d92-7f7a-43ad-b908-32e030af692d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:32.641858 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:32.661964 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf75d92-7f7a-43ad-b908-32e030af692d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:32.695537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bb592-8b9a-4cd1-bf2f-69a081a781f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:32.696155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bb592-8b9a-4cd1-bf2f-69a081a781f4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:32.697126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bb592-8b9a-4cd1-bf2f-69a081a781f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:32.697414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bb592-8b9a-4cd1-bf2f-69a081a781f4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:32.698014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bb592-8b9a-4cd1-bf2f-69a081a781f4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:32.699371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bb592-8b9a-4cd1-bf2f-69a081a781f4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1e9bb592-8b9a-4cd1-bf2f-69a081a781f4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:32.708218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:32.709194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:32.710621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:32.710621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:32.710621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:32.710621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:32.710621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:32.710621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:32.710621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:32.710621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:32.710621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:32.710621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:32.710621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:32.710621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:32.710621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 17:11:32.710621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:32.710621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 497/992] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:32.715515 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a95a9-4c45-4e52-a36d-9cd8fb55bb25 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:32.816496 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a95a9-4c45-4e52-a36d-9cd8fb55bb25 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:32.818193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:32.857327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f496fc0-838b-48a0-8e84-664e579003a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:32.857966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f496fc0-838b-48a0-8e84-664e579003a9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:32.858241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f496fc0-838b-48a0-8e84-664e579003a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:32.858508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f496fc0-838b-48a0-8e84-664e579003a9 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:32.859128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f496fc0-838b-48a0-8e84-664e579003a9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:32.859426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f496fc0-838b-48a0-8e84-664e579003a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:32.860767 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f496fc0-838b-48a0-8e84-664e579003a9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:32.870854 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 496/993] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Sep 27 17:11:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:32.871813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bb592-8b9a-4cd1-bf2f-69a081a781f4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:32.940268 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842070c3-12e1-4b53-9f53-fbe2fb875efa None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:32.940614 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842070c3-12e1-4b53-9f53-fbe2fb875efa None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:32.940821 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842070c3-12e1-4b53-9f53-fbe2fb875efa None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:32.942194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 497/994] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:11:32.947668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a985b-f9f5-46c5-8585-c630a19d92c1 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:32.947952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a985b-f9f5-46c5-8585-c630a19d92c1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:32.948226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a985b-f9f5-46c5-8585-c630a19d92c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:32.967368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2f4a985b-f9f5-46c5-8585-c630a19d92c1 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:32.968554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2f4a985b-f9f5-46c5-8585-c630a19d92c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:32.975872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bb592-8b9a-4cd1-bf2f-69a081a781f4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:33.011068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433f7a-7170-4dd7-b8f5-a01519b96d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:33.011664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433f7a-7170-4dd7-b8f5-a01519b96d35 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:33.011936 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433f7a-7170-4dd7-b8f5-a01519b96d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:33.012206 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433f7a-7170-4dd7-b8f5-a01519b96d35 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:33.012819 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59433f7a-7170-4dd7-b8f5-a01519b96d35 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:33.013115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59433f7a-7170-4dd7-b8f5-a01519b96d35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:33.014497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59433f7a-7170-4dd7-b8f5-a01519b96d35 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:33.019312 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 498/995] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Sep 27 17:11:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:33.025183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433f7a-7170-4dd7-b8f5-a01519b96d35 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:33.037443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:33.045751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 498/996] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:33.133485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433f7a-7170-4dd7-b8f5-a01519b96d35 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:33.173179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d0999-450b-4f8c-af70-7bbd08d870d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:33.173807 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d0999-450b-4f8c-af70-7bbd08d870d9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:33.174087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d0999-450b-4f8c-af70-7bbd08d870d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:33.174354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d0999-450b-4f8c-af70-7bbd08d870d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:33.175049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d0999-450b-4f8c-af70-7bbd08d870d9 None admin] RBAC: Adding query filter params (interface=public, service_id=d53e55a90d7f4ec4b95fc3e31bce8335, region_id=RegionOne) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:33.175351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d0999-450b-4f8c-af70-7bbd08d870d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:33.176714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d0999-450b-4f8c-af70-7bbd08d870d9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:33.182729 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 499/997] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Sep 27 17:11:33 2022] GET /identity/v3/endpoints?service_id=d53e55a90d7f4ec4b95fc3e31bce8335&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:33.188639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a985b-f9f5-46c5-8585-c630a19d92c1 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:33.249307 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd485e-c7b0-41bd-91ef-3a6bce5df9b6 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:33.249855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd485e-c7b0-41bd-91ef-3a6bce5df9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:33.249985 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd485e-c7b0-41bd-91ef-3a6bce5df9b6 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:33.251361 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 500/998] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:11:33.255994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed577539-34ca-4d34-958a-b49ffca09b39 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:33.256276 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed577539-34ca-4d34-958a-b49ffca09b39 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:33.256555 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed577539-34ca-4d34-958a-b49ffca09b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:33.277416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ed577539-34ca-4d34-958a-b49ffca09b39 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:33.278854 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ed577539-34ca-4d34-958a-b49ffca09b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:33.289239 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:33.296323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a985b-f9f5-46c5-8585-c630a19d92c1 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:33.333890 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154af889-6ccd-4c35-861b-9288b7400973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:33.334504 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154af889-6ccd-4c35-861b-9288b7400973 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:33.334785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154af889-6ccd-4c35-861b-9288b7400973 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:33.335056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154af889-6ccd-4c35-861b-9288b7400973 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:33.335664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154af889-6ccd-4c35-861b-9288b7400973 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:33.337188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154af889-6ccd-4c35-861b-9288b7400973 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:33.343389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 499/999] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Sep 27 17:11:33 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:11:33.344081 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154af889-6ccd-4c35-861b-9288b7400973 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:33.349271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 501/1000] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:33.468563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154af889-6ccd-4c35-861b-9288b7400973 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:33.505418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b629d-c7c4-4cba-b4d8-5451aa40bad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:33.506101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b629d-c7c4-4cba-b4d8-5451aa40bad0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:33.506379 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b629d-c7c4-4cba-b4d8-5451aa40bad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:33.506651 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b629d-c7c4-4cba-b4d8-5451aa40bad0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:33.507237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b629d-c7c4-4cba-b4d8-5451aa40bad0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:33.508597 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b629d-c7c4-4cba-b4d8-5451aa40bad0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-5c5b629d-c7c4-4cba-b4d8-5451aa40bad0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:33.518731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:33.519751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:33.520603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:33.520603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:33.520603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:33.520603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:33.520603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:33.520603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:33.520603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:33.520603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:33.520603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:33.520603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:33.520603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:33.520603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:33.520603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 17:11:33.520603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:33.520603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 500/1001] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Sep 27 17:11:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:33.526151 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed577539-34ca-4d34-958a-b49ffca09b39 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:33.530922 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:33.620698 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b629d-c7c4-4cba-b4d8-5451aa40bad0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:33.631818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed577539-34ca-4d34-958a-b49ffca09b39 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:33.649192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:33.675883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f152507-a21a-4bb6-a1cb-090b40b14ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:33.676751 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f152507-a21a-4bb6-a1cb-090b40b14ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:33.677035 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f152507-a21a-4bb6-a1cb-090b40b14ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:33.677675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f152507-a21a-4bb6-a1cb-090b40b14ae3 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:33.678337 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f152507-a21a-4bb6-a1cb-090b40b14ae3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:33.678642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f152507-a21a-4bb6-a1cb-090b40b14ae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:33.680020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f152507-a21a-4bb6-a1cb-090b40b14ae3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:33.689699 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 502/1002] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Sep 27 17:11:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:33.694392 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f152507-a21a-4bb6-a1cb-090b40b14ae3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:33.735421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b629d-c7c4-4cba-b4d8-5451aa40bad0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:33.764174 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:33.772349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137ac35-210a-42db-8ea7-dbc982533766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:33.772987 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137ac35-210a-42db-8ea7-dbc982533766 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:33.773268 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137ac35-210a-42db-8ea7-dbc982533766 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:33.773541 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137ac35-210a-42db-8ea7-dbc982533766 None admin] PATH_INFO: `/v3/services/image` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:33.774194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137ac35-210a-42db-8ea7-dbc982533766 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:33.775747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137ac35-210a-42db-8ea7-dbc982533766 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-8137ac35-210a-42db-8ea7-dbc982533766 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:33.785579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:33.786774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:33.787730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:33.787730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:33.787730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:33.787730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:33.787730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:33.787730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:33.787730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:33.787730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:33.787730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:33.787730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:33.787730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:33.787730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:33.787730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 17:11:33.787730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:33.787730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 501/1003] 10.222.0.57 () {56 vars in 1105 bytes} [Tue Sep 27 17:11:33 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:33.793071 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137ac35-210a-42db-8ea7-dbc982533766 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:33.806333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f152507-a21a-4bb6-a1cb-090b40b14ae3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:33.844333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fafa4d-39f2-4e68-a69f-4692ddbadfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:33.845106 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fafa4d-39f2-4e68-a69f-4692ddbadfc5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:33.845389 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fafa4d-39f2-4e68-a69f-4692ddbadfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:33.845662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fafa4d-39f2-4e68-a69f-4692ddbadfc5 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:33.846693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fafa4d-39f2-4e68-a69f-4692ddbadfc5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:33.847002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fafa4d-39f2-4e68-a69f-4692ddbadfc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:33.848823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fafa4d-39f2-4e68-a69f-4692ddbadfc5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:33.857846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 503/1004] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Sep 27 17:11:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:33.864223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fafa4d-39f2-4e68-a69f-4692ddbadfc5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:33.897233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:33.910003 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137ac35-210a-42db-8ea7-dbc982533766 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:33.948499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137b7f-a7a9-4cde-8e25-b946e3d19747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:33.949348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137b7f-a7a9-4cde-8e25-b946e3d19747 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:33.949930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137b7f-a7a9-4cde-8e25-b946e3d19747 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:33.950212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b137b7f-a7a9-4cde-8e25-b946e3d19747 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:33.950843 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b137b7f-a7a9-4cde-8e25-b946e3d19747 None admin] RBAC: Adding query filter params (name=image) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:33.951155 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b137b7f-a7a9-4cde-8e25-b946e3d19747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:33.952511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b137b7f-a7a9-4cde-8e25-b946e3d19747 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:33.963404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 502/1005] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:33.964663 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137b7f-a7a9-4cde-8e25-b946e3d19747 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:33.971529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fafa4d-39f2-4e68-a69f-4692ddbadfc5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:34.004665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:34.009563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9000e6-a2fa-4e1e-b526-b129d411657f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:34.010280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9000e6-a2fa-4e1e-b526-b129d411657f None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:34.010565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9000e6-a2fa-4e1e-b526-b129d411657f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:34.010838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9000e6-a2fa-4e1e-b526-b129d411657f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:34.011504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9000e6-a2fa-4e1e-b526-b129d411657f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:34.012879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9000e6-a2fa-4e1e-b526-b129d411657f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:34.029710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 504/1006] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:11:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:11:34.088849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b137b7f-a7a9-4cde-8e25-b946e3d19747 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:34.132387 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e4705-f632-42a3-aeee-290796ef84f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:34.133004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e4705-f632-42a3-aeee-290796ef84f9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:34.133282 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e4705-f632-42a3-aeee-290796ef84f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:34.133554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e4705-f632-42a3-aeee-290796ef84f9 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:34.134945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e4705-f632-42a3-aeee-290796ef84f9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:34.135246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e4705-f632-42a3-aeee-290796ef84f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:34.136622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e4705-f632-42a3-aeee-290796ef84f9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:34.149715 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 503/1007] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:35.514416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08dbcd-0124-4ce3-96b3-d92875cb851d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:35.514981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08dbcd-0124-4ce3-96b3-d92875cb851d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:35.514981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08dbcd-0124-4ce3-96b3-d92875cb851d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:35.516413 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 505/1008] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:35.521343 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9587a7-93e1-4235-bd84-d4ce5656fa7d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:35.521817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9587a7-93e1-4235-bd84-d4ce5656fa7d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:35.521906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9587a7-93e1-4235-bd84-d4ce5656fa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:35.540182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8e9587a7-93e1-4235-bd84-d4ce5656fa7d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:35.541350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8e9587a7-93e1-4235-bd84-d4ce5656fa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:35.550087 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:35.612156 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 504/1009] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:35.879886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08dbcd-0124-4ce3-96b3-d92875cb851d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:35.987928 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08dbcd-0124-4ce3-96b3-d92875cb851d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:36.022046 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e7559-e6d0-4896-8c60-3de93d7ee925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:36.022677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e7559-e6d0-4896-8c60-3de93d7ee925 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:36.022954 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e7559-e6d0-4896-8c60-3de93d7ee925 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:36.023221 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e7559-e6d0-4896-8c60-3de93d7ee925 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:36.023787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e7559-e6d0-4896-8c60-3de93d7ee925 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:36.025590 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e7559-e6d0-4896-8c60-3de93d7ee925 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8f5e7559-e6d0-4896-8c60-3de93d7ee925 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:36.034319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:36.035309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:36.036161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:36.036161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:36.036161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:36.036161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:36.036161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:36.036161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:36.036161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:36.036161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:36.036161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:36.036161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:36.036161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:36.036161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:36.036161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 17:11:36.036161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:36.036161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 506/1010] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:36.041981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9587a7-93e1-4235-bd84-d4ce5656fa7d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:36.145211 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9587a7-93e1-4235-bd84-d4ce5656fa7d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:36.183599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce011ad-22b6-4509-a0d7-217376684efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:36.184240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce011ad-22b6-4509-a0d7-217376684efc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:36.184522 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce011ad-22b6-4509-a0d7-217376684efc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:36.184793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce011ad-22b6-4509-a0d7-217376684efc None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:36.185439 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce011ad-22b6-4509-a0d7-217376684efc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:36.185773 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce011ad-22b6-4509-a0d7-217376684efc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:36.187177 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce011ad-22b6-4509-a0d7-217376684efc None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:36.197431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 505/1011] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Sep 27 17:11:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:36.199024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e7559-e6d0-4896-8c60-3de93d7ee925 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:36.247280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a818ad-7e2b-4c9c-a3f5-b1941f3b80f6 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:36.247672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a818ad-7e2b-4c9c-a3f5-b1941f3b80f6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:36.247831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a818ad-7e2b-4c9c-a3f5-b1941f3b80f6 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:36.249415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 506/1012] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:11:36.254996 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146c159-d5e7-4c25-b246-4b9946f356bd None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:36.255286 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146c159-d5e7-4c25-b246-4b9946f356bd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:36.255558 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146c159-d5e7-4c25-b246-4b9946f356bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:36.259659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:36.269182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:36.279315 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-5146c159-d5e7-4c25-b246-4b9946f356bd None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:36.280495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5146c159-d5e7-4c25-b246-4b9946f356bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:36.308688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e7559-e6d0-4896-8c60-3de93d7ee925 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:36.342253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d20a86-fae7-417b-90a1-941c74912c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:36.342853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d20a86-fae7-417b-90a1-941c74912c27 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:36.343129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d20a86-fae7-417b-90a1-941c74912c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:36.343405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d20a86-fae7-417b-90a1-941c74912c27 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:36.344019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d20a86-fae7-417b-90a1-941c74912c27 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:36.344317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d20a86-fae7-417b-90a1-941c74912c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:36.345664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d20a86-fae7-417b-90a1-941c74912c27 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:36.347684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 507/1013] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:36 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:36.348826 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e9af8-c9a9-43d2-91f3-4ea801213917 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:36.349107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e9af8-c9a9-43d2-91f3-4ea801213917 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:36.349377 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e9af8-c9a9-43d2-91f3-4ea801213917 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:36.356120 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 507/1014] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Sep 27 17:11:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:36.356252 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 508/1015] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:36.356715 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e9af8-c9a9-43d2-91f3-4ea801213917 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:36.357093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68455fd7-2ab0-411d-84eb-b7b4a02a38b8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:36.357310 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68455fd7-2ab0-411d-84eb-b7b4a02a38b8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:36.357598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68455fd7-2ab0-411d-84eb-b7b4a02a38b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:36.376218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-68455fd7-2ab0-411d-84eb-b7b4a02a38b8 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:36.377408 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-68455fd7-2ab0-411d-84eb-b7b4a02a38b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:36.448304 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 508/1016] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:36 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:36.487025 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e9af8-c9a9-43d2-91f3-4ea801213917 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:36.522775 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94447f-2dd3-4f13-9c5d-98893a9a52c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:36.523373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94447f-2dd3-4f13-9c5d-98893a9a52c2 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:36.523637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94447f-2dd3-4f13-9c5d-98893a9a52c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:36.523905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94447f-2dd3-4f13-9c5d-98893a9a52c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:36.524926 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94447f-2dd3-4f13-9c5d-98893a9a52c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:36.526682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94447f-2dd3-4f13-9c5d-98893a9a52c2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:36.532538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:36.553721 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 509/1017] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:11:36 2022] POST /identity/v3/endpoints => generated 334 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:11:36.623832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68455fd7-2ab0-411d-84eb-b7b4a02a38b8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:36.678009 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:36.732175 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94447f-2dd3-4f13-9c5d-98893a9a52c2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:36.734200 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68455fd7-2ab0-411d-84eb-b7b4a02a38b8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:36.779316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095944c-f6f8-4d09-9368-31e4e533dffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:36.779553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095944c-f6f8-4d09-9368-31e4e533dffa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:36.779656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095944c-f6f8-4d09-9368-31e4e533dffa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:36.779938 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095944c-f6f8-4d09-9368-31e4e533dffa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:36.781048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095944c-f6f8-4d09-9368-31e4e533dffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:36.782629 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095944c-f6f8-4d09-9368-31e4e533dffa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:36.784189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 509/1018] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:36.790680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095944c-f6f8-4d09-9368-31e4e533dffa None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:36.851705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94447f-2dd3-4f13-9c5d-98893a9a52c2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:36.886711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ca294-5e31-46db-a6f4-4d13fe3fc4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:36.887352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ca294-5e31-46db-a6f4-4d13fe3fc4b5 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:36.887634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ca294-5e31-46db-a6f4-4d13fe3fc4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:36.887904 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ca294-5e31-46db-a6f4-4d13fe3fc4b5 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:36.888555 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ca294-5e31-46db-a6f4-4d13fe3fc4b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:36.889946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ca294-5e31-46db-a6f4-4d13fe3fc4b5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:36.910319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095944c-f6f8-4d09-9368-31e4e533dffa None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:36.910506 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 510/1019] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Sep 27 17:11:36 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:11:36.928190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:36.959359 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41c939-3410-4758-a96d-fe14a9a9f9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:36.960296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41c939-3410-4758-a96d-fe14a9a9f9b3 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:36.960890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41c939-3410-4758-a96d-fe14a9a9f9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:36.961371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41c939-3410-4758-a96d-fe14a9a9f9b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:36.963019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41c939-3410-4758-a96d-fe14a9a9f9b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:36.964753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41c939-3410-4758-a96d-fe14a9a9f9b3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:36.995870 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 510/1020] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Sep 27 17:11:36 2022] POST /identity/v3/projects => generated 311 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:11:38.811385 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c4fd6-4541-4a4a-ae85-506307df40f1 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:38.811909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c4fd6-4541-4a4a-ae85-506307df40f1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:38.811989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c4fd6-4541-4a4a-ae85-506307df40f1 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:38.813431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 511/1021] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:38.818939 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ab9c0-f629-4d7e-81d2-dc28ce50048f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:38.819784 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ab9c0-f629-4d7e-81d2-dc28ce50048f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:38.820255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ab9c0-f629-4d7e-81d2-dc28ce50048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:38.840241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-587ab9c0-f629-4d7e-81d2-dc28ce50048f None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:38.841815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-587ab9c0-f629-4d7e-81d2-dc28ce50048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:38.922015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 511/1022] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:39.101197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b11fa-35c7-472e-8b9f-437dba841815 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:39.101837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b11fa-35c7-472e-8b9f-437dba841815 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:39.102939 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b11fa-35c7-472e-8b9f-437dba841815 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:39.104773 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 512/1023] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:39.111958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02210e39-3c4b-462b-8887-bb0362ecc440 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:39.112609 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02210e39-3c4b-462b-8887-bb0362ecc440 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:39.113088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02210e39-3c4b-462b-8887-bb0362ecc440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:39.136097 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-02210e39-3c4b-462b-8887-bb0362ecc440 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:39.137319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-02210e39-3c4b-462b-8887-bb0362ecc440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:39.202580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b11fa-35c7-472e-8b9f-437dba841815 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:39.205644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 512/1024] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:39.238920 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466824-071e-417e-bbe7-c4b5d48342dc None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:39.239204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466824-071e-417e-bbe7-c4b5d48342dc None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:39.239484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466824-071e-417e-bbe7-c4b5d48342dc None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:39.240820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 513/1025] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:11:39.246370 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96575b4b-4d8e-47d7-a453-695034b900ce None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:39.246651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96575b4b-4d8e-47d7-a453-695034b900ce None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:39.246926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96575b4b-4d8e-47d7-a453-695034b900ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:39.259208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:39.265907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-96575b4b-4d8e-47d7-a453-695034b900ce None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:39.267095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-96575b4b-4d8e-47d7-a453-695034b900ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:39.283906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:39.312079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b11fa-35c7-472e-8b9f-437dba841815 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:39.336376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 514/1026] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:39.347085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc118f-a5c6-484d-a9d1-4f25b3f2e113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:39.347716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc118f-a5c6-484d-a9d1-4f25b3f2e113 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:39.347999 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc118f-a5c6-484d-a9d1-4f25b3f2e113 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:39.348273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc118f-a5c6-484d-a9d1-4f25b3f2e113 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:39.359317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc118f-a5c6-484d-a9d1-4f25b3f2e113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-b0fc118f-a5c6-484d-a9d1-4f25b3f2e113 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:11:39.364041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:39.365208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:39.366127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:39.366127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:39.366127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:39.366127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:39.366127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:11:39.366127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:11:39.366127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:11:39.366127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:11:39.366127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:11:39.366127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:11:39.366127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 17:11:39.366127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:39.366127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 513/1027] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Sep 27 17:11:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:39.371926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96575b4b-4d8e-47d7-a453-695034b900ce None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:39.475382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc118f-a5c6-484d-a9d1-4f25b3f2e113 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:39.480199 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96575b4b-4d8e-47d7-a453-695034b900ce None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:39.517084 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff5e66-9836-42c2-bf56-8d6a0dc75d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:39.517720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff5e66-9836-42c2-bf56-8d6a0dc75d9d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:39.517999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff5e66-9836-42c2-bf56-8d6a0dc75d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:39.518274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff5e66-9836-42c2-bf56-8d6a0dc75d9d None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:39.518931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff5e66-9836-42c2-bf56-8d6a0dc75d9d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:39.519234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff5e66-9836-42c2-bf56-8d6a0dc75d9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:39.520607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff5e66-9836-42c2-bf56-8d6a0dc75d9d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:39.528590 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 515/1028] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Sep 27 17:11:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:39.534129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff5e66-9836-42c2-bf56-8d6a0dc75d9d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:39.549971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:39.585491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc118f-a5c6-484d-a9d1-4f25b3f2e113 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:39.599542 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:39.623228 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45554b-1651-4bb6-855f-75706848a4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:39.623782 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45554b-1651-4bb6-855f-75706848a4aa None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:39.624061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45554b-1651-4bb6-855f-75706848a4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:39.624340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45554b-1651-4bb6-855f-75706848a4aa None admin] PATH_INFO: `/v3/services/image` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:39.624915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45554b-1651-4bb6-855f-75706848a4aa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:39.626313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45554b-1651-4bb6-855f-75706848a4aa None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-9d45554b-1651-4bb6-855f-75706848a4aa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:39.635414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:39.636482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:39.637833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:39.637833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:39.637833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:39.637833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:39.637833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:39.637833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:39.637833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:39.637833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:39.637833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:39.637833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:39.637833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:39.637833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:39.637833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 17:11:39.637833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:39.637833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 514/1029] 10.222.0.57 () {56 vars in 1105 bytes} [Tue Sep 27 17:11:39 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:39.638867 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45554b-1651-4bb6-855f-75706848a4aa None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:39.640984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff5e66-9836-42c2-bf56-8d6a0dc75d9d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:39.674145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1f2f-3833-4a2c-b544-4e6d5282922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:39.674767 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1f2f-3833-4a2c-b544-4e6d5282922d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:39.675047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1f2f-3833-4a2c-b544-4e6d5282922d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:39.675318 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1f2f-3833-4a2c-b544-4e6d5282922d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:39.685583 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb1f2f-3833-4a2c-b544-4e6d5282922d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:39.687047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb1f2f-3833-4a2c-b544-4e6d5282922d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f9fb1f2f-3833-4a2c-b544-4e6d5282922d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:39.701384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:39.702562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:39.703693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:39.703693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:39.703693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:39.703693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 516/1030] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:39.703693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1f2f-3833-4a2c-b544-4e6d5282922d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:39.739461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45554b-1651-4bb6-855f-75706848a4aa None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:39.772584 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cbcca-7faf-47e1-83e0-9e2951f00902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:39.773208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cbcca-7faf-47e1-83e0-9e2951f00902 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:39.773493 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cbcca-7faf-47e1-83e0-9e2951f00902 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:39.773796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cbcca-7faf-47e1-83e0-9e2951f00902 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:39.774801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:39.775685 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356cbcca-7faf-47e1-83e0-9e2951f00902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:39.777109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356cbcca-7faf-47e1-83e0-9e2951f00902 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:39.778704 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 515/1031] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:39.779455 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cbcca-7faf-47e1-83e0-9e2951f00902 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:39.810941 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1f2f-3833-4a2c-b544-4e6d5282922d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:39.824228 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:39.845103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c01fc-4823-48a5-8dfb-5ea061276cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:39.845725 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c01fc-4823-48a5-8dfb-5ea061276cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:39.846011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c01fc-4823-48a5-8dfb-5ea061276cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:39.846284 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c01fc-4823-48a5-8dfb-5ea061276cb6 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:39.846901 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c01fc-4823-48a5-8dfb-5ea061276cb6 None admin] RBAC: Adding query filter params (name=image) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:39.847203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c01fc-4823-48a5-8dfb-5ea061276cb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:39.848565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c01fc-4823-48a5-8dfb-5ea061276cb6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:39.853336 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 517/1032] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:39.854120 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c01fc-4823-48a5-8dfb-5ea061276cb6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:39.884662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cbcca-7faf-47e1-83e0-9e2951f00902 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:39.917073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c38752-99f8-4d7c-a06a-995d8fdfd1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:39.917660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c38752-99f8-4d7c-a06a-995d8fdfd1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:39.917985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c38752-99f8-4d7c-a06a-995d8fdfd1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:39.918255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c38752-99f8-4d7c-a06a-995d8fdfd1a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:39.918893 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c38752-99f8-4d7c-a06a-995d8fdfd1a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:39.919191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c38752-99f8-4d7c-a06a-995d8fdfd1a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:39.920539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c38752-99f8-4d7c-a06a-995d8fdfd1a6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:39.933226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 516/1033] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:39.934046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c38752-99f8-4d7c-a06a-995d8fdfd1a6 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:39.955522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c01fc-4823-48a5-8dfb-5ea061276cb6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:39.984089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:39.990520 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027e5b5-8d91-46bc-9f34-2af15b7ae995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:39.991120 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027e5b5-8d91-46bc-9f34-2af15b7ae995 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:39.991406 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027e5b5-8d91-46bc-9f34-2af15b7ae995 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:39.991678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027e5b5-8d91-46bc-9f34-2af15b7ae995 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:39.992327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027e5b5-8d91-46bc-9f34-2af15b7ae995 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:39.994455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027e5b5-8d91-46bc-9f34-2af15b7ae995 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:40.016840 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 518/1034] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:11:39 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:11:40.018118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027e5b5-8d91-46bc-9f34-2af15b7ae995 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:40.037127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c38752-99f8-4d7c-a06a-995d8fdfd1a6 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:40.040051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:40.082122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ba260-6f9f-4708-be00-340fd77c0553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:40.083173 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ba260-6f9f-4708-be00-340fd77c0553 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:40.083454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ba260-6f9f-4708-be00-340fd77c0553 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:40.084039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ba260-6f9f-4708-be00-340fd77c0553 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:40.084746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ba260-6f9f-4708-be00-340fd77c0553 None admin] RBAC: Adding query filter params (type=image) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:40.085056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ba260-6f9f-4708-be00-340fd77c0553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:40.086517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ba260-6f9f-4708-be00-340fd77c0553 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:40.092248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 517/1035] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:40.098478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ba260-6f9f-4708-be00-340fd77c0553 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:40.149400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027e5b5-8d91-46bc-9f34-2af15b7ae995 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:40.187693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a384f-de63-4a2a-8e5e-cfb7fb7e7ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:40.188336 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a384f-de63-4a2a-8e5e-cfb7fb7e7ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:40.188615 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a384f-de63-4a2a-8e5e-cfb7fb7e7ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:40.188889 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a384f-de63-4a2a-8e5e-cfb7fb7e7ff8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:40.198614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a384f-de63-4a2a-8e5e-cfb7fb7e7ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:40.199343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a384f-de63-4a2a-8e5e-cfb7fb7e7ff8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-a21a384f-de63-4a2a-8e5e-cfb7fb7e7ff8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:11:40.210868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:40.212430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:40.213573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:40.213573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:40.213573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:11:40.213573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:11:40.213573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:11:40.213573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:11:40.213573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:11:40.213573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:11:40.213573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:11:40.213573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:40.213573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 519/1036] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Sep 27 17:11:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:40.219010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a384f-de63-4a2a-8e5e-cfb7fb7e7ff8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:40.222755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ba260-6f9f-4708-be00-340fd77c0553 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:40.267697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e55d2d-799c-4b4b-8dc1-195471157886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:40.268373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e55d2d-799c-4b4b-8dc1-195471157886 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:40.269106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e55d2d-799c-4b4b-8dc1-195471157886 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:40.269391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e55d2d-799c-4b4b-8dc1-195471157886 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:40.270125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e55d2d-799c-4b4b-8dc1-195471157886 None admin] RBAC: Adding query filter params (interface=public, service_id=73500b9fb4fc4c07b68d3e0c2cdb1510, region_id=RegionOne) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:40.270442 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e55d2d-799c-4b4b-8dc1-195471157886 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:40.272521 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e55d2d-799c-4b4b-8dc1-195471157886 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:40.278501 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 518/1037] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Sep 27 17:11:40 2022] GET /identity/v3/endpoints?service_id=73500b9fb4fc4c07b68d3e0c2cdb1510&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:40.279042 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:40.284117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e55d2d-799c-4b4b-8dc1-195471157886 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:40.317053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:40.339357 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a384f-de63-4a2a-8e5e-cfb7fb7e7ff8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:40.375678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d8148-d315-439e-88a9-50cd2652487e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:40.376286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d8148-d315-439e-88a9-50cd2652487e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:40.376565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d8148-d315-439e-88a9-50cd2652487e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:40.376837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d8148-d315-439e-88a9-50cd2652487e None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:40.377564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d8148-d315-439e-88a9-50cd2652487e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:40.377974 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d8148-d315-439e-88a9-50cd2652487e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:40.379395 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d8148-d315-439e-88a9-50cd2652487e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:40.392977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e55d2d-799c-4b4b-8dc1-195471157886 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:40.398157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 520/1038] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Sep 27 17:11:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:40.404054 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d8148-d315-439e-88a9-50cd2652487e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:40.434704 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92471a06-58c1-4d56-bf23-3b1ade5b06af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:40.435748 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92471a06-58c1-4d56-bf23-3b1ade5b06af None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:40.436034 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92471a06-58c1-4d56-bf23-3b1ade5b06af None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:40.436306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92471a06-58c1-4d56-bf23-3b1ade5b06af None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:40.436913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92471a06-58c1-4d56-bf23-3b1ade5b06af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:40.438307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92471a06-58c1-4d56-bf23-3b1ade5b06af None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:40.451227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 519/1039] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Sep 27 17:11:40 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:11:40.516774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d8148-d315-439e-88a9-50cd2652487e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:40.520842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:40.557065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dad0ae-ae60-4f98-9d35-5214ec7ee58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:40.557703 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dad0ae-ae60-4f98-9d35-5214ec7ee58c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:40.558011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dad0ae-ae60-4f98-9d35-5214ec7ee58c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:40.558281 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dad0ae-ae60-4f98-9d35-5214ec7ee58c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:40.637945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dad0ae-ae60-4f98-9d35-5214ec7ee58c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:40.639393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dad0ae-ae60-4f98-9d35-5214ec7ee58c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:40.742102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 521/1040] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:11:40 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 17:11:40.748243 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92471a06-58c1-4d56-bf23-3b1ade5b06af None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:40.845054 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:40.852652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92471a06-58c1-4d56-bf23-3b1ade5b06af None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:40.886992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6085ab-3705-463d-8ce4-6b6c8073e3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:40.887621 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6085ab-3705-463d-8ce4-6b6c8073e3be None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:40.887898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6085ab-3705-463d-8ce4-6b6c8073e3be None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:40.888168 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6085ab-3705-463d-8ce4-6b6c8073e3be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:40.898235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6085ab-3705-463d-8ce4-6b6c8073e3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:40.899711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6085ab-3705-463d-8ce4-6b6c8073e3be None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-af6085ab-3705-463d-8ce4-6b6c8073e3be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:40.914830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:40.915946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:40.916853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:40.916853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:40.916853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:40.917756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 520/1041] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:40.921633 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dad0ae-ae60-4f98-9d35-5214ec7ee58c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:40.925763 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:41.031034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dad0ae-ae60-4f98-9d35-5214ec7ee58c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:41.066391 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a5b6f-607b-4905-a867-84e7c768fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:41.066997 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a5b6f-607b-4905-a867-84e7c768fd8d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:41.067278 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a5b6f-607b-4905-a867-84e7c768fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:41.067549 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a5b6f-607b-4905-a867-84e7c768fd8d None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:41.068180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a5b6f-607b-4905-a867-84e7c768fd8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:41.068483 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a5b6f-607b-4905-a867-84e7c768fd8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:41.069869 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a5b6f-607b-4905-a867-84e7c768fd8d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:41.081368 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 522/1042] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:41.087117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6085ab-3705-463d-8ce4-6b6c8073e3be None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:41.187143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6085ab-3705-463d-8ce4-6b6c8073e3be None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:41.220726 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220abed-799b-47bd-bab3-2b81caff04dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:41.221360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220abed-799b-47bd-bab3-2b81caff04dc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:41.221640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220abed-799b-47bd-bab3-2b81caff04dc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:41.221944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220abed-799b-47bd-bab3-2b81caff04dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:41.229320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220abed-799b-47bd-bab3-2b81caff04dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:41.230783 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220abed-799b-47bd-bab3-2b81caff04dc None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:41.241960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-e220abed-799b-47bd-bab3-2b81caff04dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:41.241960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:41.241960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:41.241960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:41.241960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:41.241960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:41.241960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:41.241960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:41.241960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:41.241960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:41.241960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:41.241960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:41.241960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:11:41.241960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:11:41.241960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:41.243048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:41.244143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:11:41.244143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:11:41.244143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:11:41.244143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:11:41.244143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:11:41.244143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:11:41.244143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:41.244143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:41.245158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 521/1043] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:41.249370 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a5b6f-607b-4905-a867-84e7c768fd8d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:41.311778 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:41.354305 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a5b6f-607b-4905-a867-84e7c768fd8d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:41.388700 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab529b33-dd3c-4b74-b2a4-a1269fef8d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:41.389309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab529b33-dd3c-4b74-b2a4-a1269fef8d24 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:41.389591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab529b33-dd3c-4b74-b2a4-a1269fef8d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:41.389893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab529b33-dd3c-4b74-b2a4-a1269fef8d24 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:41.390586 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab529b33-dd3c-4b74-b2a4-a1269fef8d24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:41.390895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab529b33-dd3c-4b74-b2a4-a1269fef8d24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:41.392317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab529b33-dd3c-4b74-b2a4-a1269fef8d24 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:41.404890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 523/1044] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:41.410762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220abed-799b-47bd-bab3-2b81caff04dc None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:41.425548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:41.517912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220abed-799b-47bd-bab3-2b81caff04dc None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:41.550630 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649914dd-3072-4053-ab36-91a64f4356b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:41.551226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649914dd-3072-4053-ab36-91a64f4356b3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:41.551500 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649914dd-3072-4053-ab36-91a64f4356b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:41.551770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649914dd-3072-4053-ab36-91a64f4356b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:41.552477 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649914dd-3072-4053-ab36-91a64f4356b3 None admin] RBAC: Adding query filter params (role.id=f93bdd156ab34beea98ecf5280cca56b, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=e75b03fde75e411bace8d406237a7e50) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:41.552781 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649914dd-3072-4053-ab36-91a64f4356b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:41.554269 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649914dd-3072-4053-ab36-91a64f4356b3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:41.561909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 522/1045] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:11:41 2022] GET /identity/v3/role_assignments?user.id=e75b03fde75e411bace8d406237a7e50&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f93bdd156ab34beea98ecf5280cca56b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:42.254950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0624cc-e79f-45f3-b6d8-868485a32274 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:42.255517 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0624cc-e79f-45f3-b6d8-868485a32274 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:42.255517 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0624cc-e79f-45f3-b6d8-868485a32274 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:42.256838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 524/1046] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:42.262553 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc15ac-1529-493f-a390-79029b9987d2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:42.262954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc15ac-1529-493f-a390-79029b9987d2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:42.263159 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc15ac-1529-493f-a390-79029b9987d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:42.283819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-89fc15ac-1529-493f-a390-79029b9987d2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:42.284999 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-89fc15ac-1529-493f-a390-79029b9987d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:42.355050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 523/1047] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:42.620152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7970c2-1590-4783-88fe-194448707ef0 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:42.620346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7970c2-1590-4783-88fe-194448707ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:42.620641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7970c2-1590-4783-88fe-194448707ef0 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:42.622008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 525/1048] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:42.626941 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7970c2-1590-4783-88fe-194448707ef0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:42.627054 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd43a60-99cf-4bcc-ac63-e353b15b939e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:42.627337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd43a60-99cf-4bcc-ac63-e353b15b939e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:42.627616 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd43a60-99cf-4bcc-ac63-e353b15b939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:42.634805 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:42.647868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-bcd43a60-99cf-4bcc-ac63-e353b15b939e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:42.649772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bcd43a60-99cf-4bcc-ac63-e353b15b939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:42.727316 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 524/1049] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:42.741107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7970c2-1590-4783-88fe-194448707ef0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:42.766831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:42.779534 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22930c5d-079b-42f6-bb92-a5a694407df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:42.780164 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22930c5d-079b-42f6-bb92-a5a694407df6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:42.780439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22930c5d-079b-42f6-bb92-a5a694407df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:42.780706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22930c5d-079b-42f6-bb92-a5a694407df6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:42.791075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22930c5d-079b-42f6-bb92-a5a694407df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-22930c5d-079b-42f6-bb92-a5a694407df6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:11:42.795844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:42.796802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:42.797653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:42.797653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:42.797653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:42.797653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:42.797653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:11:42.797653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:11:42.797653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:11:42.797653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:11:42.797653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:11:42.797653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:11:42.797653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:11:42.797653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:42.797653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 526/1050] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:11:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:42.802921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd43a60-99cf-4bcc-ac63-e353b15b939e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:42.903910 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd43a60-99cf-4bcc-ac63-e353b15b939e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:42.932571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:42.938408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702a41c-6cde-47cf-b1c2-225c85127280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:42.939009 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702a41c-6cde-47cf-b1c2-225c85127280 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:42.939287 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702a41c-6cde-47cf-b1c2-225c85127280 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:42.939551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702a41c-6cde-47cf-b1c2-225c85127280 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:42.940193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702a41c-6cde-47cf-b1c2-225c85127280 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:42.940491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702a41c-6cde-47cf-b1c2-225c85127280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:42.941854 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702a41c-6cde-47cf-b1c2-225c85127280 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:42.950777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 525/1051] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:11:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:42.956380 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22930c5d-079b-42f6-bb92-a5a694407df6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:43.000654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702a41c-6cde-47cf-b1c2-225c85127280 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:43.062356 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22930c5d-079b-42f6-bb92-a5a694407df6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:43.101302 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21933a4b-ab7a-47c6-afd9-e94ded7f7db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:43.102001 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21933a4b-ab7a-47c6-afd9-e94ded7f7db9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:43.102290 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21933a4b-ab7a-47c6-afd9-e94ded7f7db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:43.102545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21933a4b-ab7a-47c6-afd9-e94ded7f7db9 None admin] PATH_INFO: `/v3/users/c723540828d54ac38b6e182947f7959b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:43.108748 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702a41c-6cde-47cf-b1c2-225c85127280 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:43.115922 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21933a4b-ab7a-47c6-afd9-e94ded7f7db9 None admin] RBAC: Authorizing `identity:get_user(user_id=c723540828d54ac38b6e182947f7959b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:43.117881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21933a4b-ab7a-47c6-afd9-e94ded7f7db9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:43.119737 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 527/1052] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:11:42 2022] GET /identity/v3/users/c723540828d54ac38b6e182947f7959b => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:43.125117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21933a4b-ab7a-47c6-afd9-e94ded7f7db9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:43.146973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888f793-a630-4a8d-a7d0-2978d9d11eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:43.147613 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888f793-a630-4a8d-a7d0-2978d9d11eec None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:43.147916 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888f793-a630-4a8d-a7d0-2978d9d11eec None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:43.148163 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888f793-a630-4a8d-a7d0-2978d9d11eec None admin] PATH_INFO: `/v3/services/image` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:43.148836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888f793-a630-4a8d-a7d0-2978d9d11eec None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:43.150593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888f793-a630-4a8d-a7d0-2978d9d11eec None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-d888f793-a630-4a8d-a7d0-2978d9d11eec None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:43.159622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:43.160647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:43.161503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:43.161503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:43.161503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:43.161503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:43.161503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:43.161503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:43.161503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:43.161503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:43.161503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:43.161503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:43.161503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:11:43.161503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:11:43.161503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 17:11:43.161503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:43.161503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 526/1053] 10.222.0.57 () {56 vars in 1105 bytes} [Tue Sep 27 17:11:42 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:43.166802 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888f793-a630-4a8d-a7d0-2978d9d11eec None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:43.172540 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:43.230103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:43.237568 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21933a4b-ab7a-47c6-afd9-e94ded7f7db9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:43.274941 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888f793-a630-4a8d-a7d0-2978d9d11eec None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:43.276813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c94965-59bb-4d5a-87c6-67ae98225455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:43.277891 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c94965-59bb-4d5a-87c6-67ae98225455 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:43.278175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c94965-59bb-4d5a-87c6-67ae98225455 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:43.278446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c94965-59bb-4d5a-87c6-67ae98225455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:43.311474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a807a72-6ba5-44ff-baff-f61949e8b873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:43.312087 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a807a72-6ba5-44ff-baff-f61949e8b873 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:43.312367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a807a72-6ba5-44ff-baff-f61949e8b873 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:43.312638 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a807a72-6ba5-44ff-baff-f61949e8b873 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:43.313270 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a807a72-6ba5-44ff-baff-f61949e8b873 None admin] RBAC: Adding query filter params (name=image) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:43.313573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a807a72-6ba5-44ff-baff-f61949e8b873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:43.314962 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a807a72-6ba5-44ff-baff-f61949e8b873 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:43.319926 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 527/1054] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:43.326024 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a807a72-6ba5-44ff-baff-f61949e8b873 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:43.349565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c94965-59bb-4d5a-87c6-67ae98225455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:43.351234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c94965-59bb-4d5a-87c6-67ae98225455 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:43.403413 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:43.437778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a807a72-6ba5-44ff-baff-f61949e8b873 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:43.463264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:43.476676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 528/1055] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:11:43 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 17:11:43.478574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c94965-59bb-4d5a-87c6-67ae98225455 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:43.483156 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bee1e6-c661-4866-89e2-540b55d6e1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:43.483831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee1e6-c661-4866-89e2-540b55d6e1cf None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:43.484117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee1e6-c661-4866-89e2-540b55d6e1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:43.484387 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee1e6-c661-4866-89e2-540b55d6e1cf None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:43.485012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bee1e6-c661-4866-89e2-540b55d6e1cf None admin] RBAC: Adding query filter params (type=image) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:43.485313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bee1e6-c661-4866-89e2-540b55d6e1cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:43.486832 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bee1e6-c661-4866-89e2-540b55d6e1cf None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:43.497054 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 528/1056] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:43.497875 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bee1e6-c661-4866-89e2-540b55d6e1cf None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:43.585449 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c94965-59bb-4d5a-87c6-67ae98225455 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:43.601077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bee1e6-c661-4866-89e2-540b55d6e1cf None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:43.626307 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bdf69-3aac-4afd-bac2-a0d4d37fe907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:43.627044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bdf69-3aac-4afd-bac2-a0d4d37fe907 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:43.627321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bdf69-3aac-4afd-bac2-a0d4d37fe907 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:43.627700 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bdf69-3aac-4afd-bac2-a0d4d37fe907 None admin] PATH_INFO: `/v3/projects/6537023845c441fb9caf975bf69977af` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:43.628837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bdf69-3aac-4afd-bac2-a0d4d37fe907 None admin] RBAC: Authorizing `identity:get_project(project_id=6537023845c441fb9caf975bf69977af)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:43.630437 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bdf69-3aac-4afd-bac2-a0d4d37fe907 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:43.637217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 529/1057] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:11:43 2022] GET /identity/v3/projects/6537023845c441fb9caf975bf69977af => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:43.638026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bdf69-3aac-4afd-bac2-a0d4d37fe907 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:43.638862 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222e297-b0ff-4917-be3f-3e7e24f5484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:43.639471 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222e297-b0ff-4917-be3f-3e7e24f5484d None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:43.639751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222e297-b0ff-4917-be3f-3e7e24f5484d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:43.640021 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222e297-b0ff-4917-be3f-3e7e24f5484d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:43.640682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222e297-b0ff-4917-be3f-3e7e24f5484d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:43.642065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222e297-b0ff-4917-be3f-3e7e24f5484d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:43.650852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:43.663022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 529/1058] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:11:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:11:43.720179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abd415-04d7-44f6-9f34-e4483d4ceab3 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:43.720499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abd415-04d7-44f6-9f34-e4483d4ceab3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:43.720733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abd415-04d7-44f6-9f34-e4483d4ceab3 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:43.722332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 530/1059] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:11:43.728394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01085158-d531-4579-bfd2-e0e170cdd45c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:43.728696 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01085158-d531-4579-bfd2-e0e170cdd45c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:43.728953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01085158-d531-4579-bfd2-e0e170cdd45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:43.750652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-01085158-d531-4579-bfd2-e0e170cdd45c None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:43.753208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-01085158-d531-4579-bfd2-e0e170cdd45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:43.764076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bdf69-3aac-4afd-bac2-a0d4d37fe907 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:43.795847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:43.811312 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae2bdc-2dd0-4be3-b809-b746b12744e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:43.812094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae2bdc-2dd0-4be3-b809-b746b12744e1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:43.812778 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae2bdc-2dd0-4be3-b809-b746b12744e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:43.813069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae2bdc-2dd0-4be3-b809-b746b12744e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:43.813855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae2bdc-2dd0-4be3-b809-b746b12744e1 None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=6537023845c441fb9caf975bf69977af, user.id=c723540828d54ac38b6e182947f7959b) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:43.814168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae2bdc-2dd0-4be3-b809-b746b12744e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:43.815623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae2bdc-2dd0-4be3-b809-b746b12744e1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:43.833716 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 530/1060] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:11:43 2022] GET /identity/v3/role_assignments?user.id=c723540828d54ac38b6e182947f7959b&scope.project.id=6537023845c441fb9caf975bf69977af&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:43.847928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 531/1061] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:44.116362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae2bdc-2dd0-4be3-b809-b746b12744e1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:44.192067 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:44.226284 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae2bdc-2dd0-4be3-b809-b746b12744e1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:44.260806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b36118-c6f1-4b54-b1eb-f996c93d1650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:44.261430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b36118-c6f1-4b54-b1eb-f996c93d1650 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:44.261721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b36118-c6f1-4b54-b1eb-f996c93d1650 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:44.261993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b36118-c6f1-4b54-b1eb-f996c93d1650 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:44.272346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b36118-c6f1-4b54-b1eb-f996c93d1650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f2b36118-c6f1-4b54-b1eb-f996c93d1650 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:11:44.278145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:44.279561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:44.280466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:44.280466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:44.280466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:44.280466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:44.280466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:11:44.280466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:11:44.280466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:11:44.280466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:11:44.280466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:11:44.280466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:11:44.280466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 17:11:44.280466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:44.280466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 531/1062] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Sep 27 17:11:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:44.286418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01085158-d531-4579-bfd2-e0e170cdd45c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:44.384996 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01085158-d531-4579-bfd2-e0e170cdd45c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:44.423827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee78d4-85cb-4ec5-88d6-4bbdcd45637d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:44.424445 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee78d4-85cb-4ec5-88d6-4bbdcd45637d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:44.424722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee78d4-85cb-4ec5-88d6-4bbdcd45637d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:44.424989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee78d4-85cb-4ec5-88d6-4bbdcd45637d None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:44.425641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee78d4-85cb-4ec5-88d6-4bbdcd45637d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:44.426208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee78d4-85cb-4ec5-88d6-4bbdcd45637d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:44.429201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee78d4-85cb-4ec5-88d6-4bbdcd45637d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:44.444878 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 532/1063] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Sep 27 17:11:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:44.445086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b36118-c6f1-4b54-b1eb-f996c93d1650 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:44.549382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b36118-c6f1-4b54-b1eb-f996c93d1650 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:44.578300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:44.585344 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d082f-5565-4c1a-99bf-4a2ffe8bed94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:44.586513 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d082f-5565-4c1a-99bf-4a2ffe8bed94 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:44.586808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d082f-5565-4c1a-99bf-4a2ffe8bed94 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:44.587081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d082f-5565-4c1a-99bf-4a2ffe8bed94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:44.598523 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d082f-5565-4c1a-99bf-4a2ffe8bed94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:44.600019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d082f-5565-4c1a-99bf-4a2ffe8bed94 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-4f8d082f-5565-4c1a-99bf-4a2ffe8bed94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:44.616598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:44.622896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:44.623802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:44.623802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:44.623802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:44.623802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 532/1064] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:44.624054 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee78d4-85cb-4ec5-88d6-4bbdcd45637d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:44.658604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:44.729177 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee78d4-85cb-4ec5-88d6-4bbdcd45637d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:44.762161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d86fb-90c7-4e5c-812e-e3bed97807c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:44.762791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d86fb-90c7-4e5c-812e-e3bed97807c4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:44.763053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d86fb-90c7-4e5c-812e-e3bed97807c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:44.763327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d86fb-90c7-4e5c-812e-e3bed97807c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:44.763961 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d86fb-90c7-4e5c-812e-e3bed97807c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:44.764267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d86fb-90c7-4e5c-812e-e3bed97807c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:44.765628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d86fb-90c7-4e5c-812e-e3bed97807c4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:44.782064 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 533/1065] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:44.783204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d082f-5565-4c1a-99bf-4a2ffe8bed94 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:44.884092 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d082f-5565-4c1a-99bf-4a2ffe8bed94 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:44.917464 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b95e8-5b7c-46b2-b2e6-be9ceaa074f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:44.918047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b95e8-5b7c-46b2-b2e6-be9ceaa074f0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:44.918326 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b95e8-5b7c-46b2-b2e6-be9ceaa074f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:44.918599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b95e8-5b7c-46b2-b2e6-be9ceaa074f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:44.926115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b95e8-5b7c-46b2-b2e6-be9ceaa074f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:44.927550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b95e8-5b7c-46b2-b2e6-be9ceaa074f0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-117b95e8-5b7c-46b2-b2e6-be9ceaa074f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:11:44.938877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:44.939825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:44.940772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:44.940772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:44.940772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:11:44.940772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:11:44.940772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:11:44.940772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:11:44.940772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:11:44.940772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:11:44.940772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:11:44.940772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:44.940772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 533/1066] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Sep 27 17:11:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:44.948031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d86fb-90c7-4e5c-812e-e3bed97807c4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:45.042174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:45.049757 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d86fb-90c7-4e5c-812e-e3bed97807c4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:45.084855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13611d-6187-4163-864f-4f27c73d8de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:45.085460 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13611d-6187-4163-864f-4f27c73d8de2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:45.085763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13611d-6187-4163-864f-4f27c73d8de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:45.086088 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13611d-6187-4163-864f-4f27c73d8de2 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:45.087204 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13611d-6187-4163-864f-4f27c73d8de2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:45.087508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13611d-6187-4163-864f-4f27c73d8de2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:45.088915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13611d-6187-4163-864f-4f27c73d8de2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:45.111325 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 534/1067] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Sep 27 17:11:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:45.112505 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b95e8-5b7c-46b2-b2e6-be9ceaa074f0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:45.157301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:45.215443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b95e8-5b7c-46b2-b2e6-be9ceaa074f0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:45.248973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846f218-3752-401b-817d-0bd8d69d21e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:45.249810 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846f218-3752-401b-817d-0bd8d69d21e6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:45.250244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846f218-3752-401b-817d-0bd8d69d21e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:45.250670 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846f218-3752-401b-817d-0bd8d69d21e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:45.261211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846f218-3752-401b-817d-0bd8d69d21e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:45.262831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846f218-3752-401b-817d-0bd8d69d21e6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8846f218-3752-401b-817d-0bd8d69d21e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:45.277562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:45.279181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:45.280301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:45.280301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:45.280301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:45.281768 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 534/1068] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:45.287532 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13611d-6187-4163-864f-4f27c73d8de2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:45.388955 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13611d-6187-4163-864f-4f27c73d8de2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:45.431220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdaac6-22dc-4a17-8e9e-92f0770a3ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:45.431837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdaac6-22dc-4a17-8e9e-92f0770a3ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:45.432120 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdaac6-22dc-4a17-8e9e-92f0770a3ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:45.432392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdaac6-22dc-4a17-8e9e-92f0770a3ef3 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:45.433168 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdaac6-22dc-4a17-8e9e-92f0770a3ef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:45.433313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdaac6-22dc-4a17-8e9e-92f0770a3ef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:45.434711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdaac6-22dc-4a17-8e9e-92f0770a3ef3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:45.447287 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 535/1069] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:45.452811 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846f218-3752-401b-817d-0bd8d69d21e6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:45.552996 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:45.561774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846f218-3752-401b-817d-0bd8d69d21e6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:45.595795 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46904b47-081a-43e5-8588-9ddad79da675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:45.596433 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46904b47-081a-43e5-8588-9ddad79da675 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:45.596706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46904b47-081a-43e5-8588-9ddad79da675 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:45.596972 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46904b47-081a-43e5-8588-9ddad79da675 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:45.605614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46904b47-081a-43e5-8588-9ddad79da675 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:45.607083 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46904b47-081a-43e5-8588-9ddad79da675 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:45.618890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-46904b47-081a-43e5-8588-9ddad79da675 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:45.618890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:45.618890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:45.618890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:45.618890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:45.618890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:45.618890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:45.618890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:45.618890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:45.618890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:45.618890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:45.618890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:45.618890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:11:45.618890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:11:45.618890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:45.619821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:45.625960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:11:45.625960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:11:45.625960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:11:45.625960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:11:45.625960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:11:45.625960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:11:45.625960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:45.625960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:45.625960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 535/1070] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:45.626485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdaac6-22dc-4a17-8e9e-92f0770a3ef3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:45.642153 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:45.729648 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdaac6-22dc-4a17-8e9e-92f0770a3ef3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:45.762867 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eed056-0422-4674-b981-e1ac17c7002b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:45.763473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eed056-0422-4674-b981-e1ac17c7002b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:45.763750 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eed056-0422-4674-b981-e1ac17c7002b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:45.764080 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eed056-0422-4674-b981-e1ac17c7002b None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:45.764763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eed056-0422-4674-b981-e1ac17c7002b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:45.765122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eed056-0422-4674-b981-e1ac17c7002b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:45.766559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eed056-0422-4674-b981-e1ac17c7002b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:45.780688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 536/1071] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:11:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:45.786753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46904b47-081a-43e5-8588-9ddad79da675 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:45.899210 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46904b47-081a-43e5-8588-9ddad79da675 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:45.901357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2b273-325c-4d2c-8ca8-7e884358356b None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:45.901898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2b273-325c-4d2c-8ca8-7e884358356b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:45.902180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2b273-325c-4d2c-8ca8-7e884358356b None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:45.904482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 537/1072] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:45.909944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ed961-ccf1-4f89-a53a-0475c4ca2d21 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:45.910571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ed961-ccf1-4f89-a53a-0475c4ca2d21 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:45.910853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ed961-ccf1-4f89-a53a-0475c4ca2d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:45.931639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-132ed961-ccf1-4f89-a53a-0475c4ca2d21 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:45.932825 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-132ed961-ccf1-4f89-a53a-0475c4ca2d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:45.935713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2d2cd-4009-4cd9-98d3-597ad5523115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:45.936375 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2d2cd-4009-4cd9-98d3-597ad5523115 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:45.936651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2d2cd-4009-4cd9-98d3-597ad5523115 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:45.936918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2d2cd-4009-4cd9-98d3-597ad5523115 None admin] PATH_INFO: `/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/e75b03fde75e411bace8d406237a7e50/roles/f93bdd156ab34beea98ecf5280cca56b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:45.939052 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2d2cd-4009-4cd9-98d3-597ad5523115 None admin] RBAC: Authorizing `identity:create_grant(project_id=20fffa15f44b4f519ac7e29a48a7a596, user_id=e75b03fde75e411bace8d406237a7e50, role_id=f93bdd156ab34beea98ecf5280cca56b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:45.940474 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2d2cd-4009-4cd9-98d3-597ad5523115 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:45.954019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 536/1073] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:11:45 2022] PUT /identity/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/e75b03fde75e411bace8d406237a7e50/roles/f93bdd156ab34beea98ecf5280cca56b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:11:45.972766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c716b3-ae24-43bd-87d3-d3c63bbd2593 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:45.973504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c716b3-ae24-43bd-87d3-d3c63bbd2593 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:45.973843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c716b3-ae24-43bd-87d3-d3c63bbd2593 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:45.975329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 537/1074] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:11:45.981481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d099b5-769d-44f6-bb17-8541754e1311 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:45.981798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d099b5-769d-44f6-bb17-8541754e1311 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:45.982076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d099b5-769d-44f6-bb17-8541754e1311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:46.002213 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e4d099b5-769d-44f6-bb17-8541754e1311 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:46.003423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e4d099b5-769d-44f6-bb17-8541754e1311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:46.014696 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:46.025879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 538/1075] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:46.085204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 538/1076] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:46.286332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ed961-ccf1-4f89-a53a-0475c4ca2d21 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:46.288515 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:46.356655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d099b5-769d-44f6-bb17-8541754e1311 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:46.389955 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ed961-ccf1-4f89-a53a-0475c4ca2d21 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:46.429143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639310a6-7390-4c72-8182-684526f930dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:46.430246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639310a6-7390-4c72-8182-684526f930dd None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:46.430542 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639310a6-7390-4c72-8182-684526f930dd None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:46.430930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639310a6-7390-4c72-8182-684526f930dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:46.465088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d099b5-769d-44f6-bb17-8541754e1311 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:46.501792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f510061-9dce-4bae-8000-970f5a8cea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:46.502526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f510061-9dce-4bae-8000-970f5a8cea7b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:46.502810 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f510061-9dce-4bae-8000-970f5a8cea7b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:46.503321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f510061-9dce-4bae-8000-970f5a8cea7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:46.510191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639310a6-7390-4c72-8182-684526f930dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:46.511653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639310a6-7390-4c72-8182-684526f930dd None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:46.513620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:46.515047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f510061-9dce-4bae-8000-970f5a8cea7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1f510061-9dce-4bae-8000-970f5a8cea7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:11:46.519481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:46.520401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:46.522628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:46.522628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:46.522628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:46.522628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:46.522628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:11:46.522628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:11:46.522628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:11:46.522628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:11:46.522628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:11:46.522628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:11:46.522628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:11:46.522628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:46.522628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 539/1077] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:11:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:46.526686 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f510061-9dce-4bae-8000-970f5a8cea7b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:46.531665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:46.624543 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 539/1078] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:11:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:11:46.630662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639310a6-7390-4c72-8182-684526f930dd None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:46.640993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f510061-9dce-4bae-8000-970f5a8cea7b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:46.678156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1ebdf-fac5-4a52-8de9-9c910adb1d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:46.678769 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1ebdf-fac5-4a52-8de9-9c910adb1d1b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:46.679081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1ebdf-fac5-4a52-8de9-9c910adb1d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:46.679433 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1ebdf-fac5-4a52-8de9-9c910adb1d1b None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:46.680958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1ebdf-fac5-4a52-8de9-9c910adb1d1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:46.681323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1ebdf-fac5-4a52-8de9-9c910adb1d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:46.682731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1ebdf-fac5-4a52-8de9-9c910adb1d1b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:46.696515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 540/1079] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:11:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:46.697559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1ebdf-fac5-4a52-8de9-9c910adb1d1b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:46.740515 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639310a6-7390-4c72-8182-684526f930dd None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:46.742923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:46.767782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:46.777412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b89c0-c68f-4b27-820d-3bcb057ef987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:46.778079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b89c0-c68f-4b27-820d-3bcb057ef987 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:46.778358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b89c0-c68f-4b27-820d-3bcb057ef987 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:46.778629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b89c0-c68f-4b27-820d-3bcb057ef987 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:46.790475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b89c0-c68f-4b27-820d-3bcb057ef987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:46.791917 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b89c0-c68f-4b27-820d-3bcb057ef987 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:46.806877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1ebdf-fac5-4a52-8de9-9c910adb1d1b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-8d9b89c0-c68f-4b27-820d-3bcb057ef987 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:46.807795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:46.808707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:46.809617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:46.809617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:46.809617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:46.809617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 540/1080] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:46.814851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b89c0-c68f-4b27-820d-3bcb057ef987 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:46.844894 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18cb7e-090b-42a9-b913-fef1763e83e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:46.845551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18cb7e-090b-42a9-b913-fef1763e83e4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:46.845868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18cb7e-090b-42a9-b913-fef1763e83e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:46.846149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18cb7e-090b-42a9-b913-fef1763e83e4 None admin] PATH_INFO: `/v3/users/c723540828d54ac38b6e182947f7959b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:46.848044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18cb7e-090b-42a9-b913-fef1763e83e4 None admin] RBAC: Authorizing `identity:get_user(user_id=c723540828d54ac38b6e182947f7959b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:46.849736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18cb7e-090b-42a9-b913-fef1763e83e4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:46.856865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 541/1081] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:11:46 2022] GET /identity/v3/users/c723540828d54ac38b6e182947f7959b => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:46.857902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18cb7e-090b-42a9-b913-fef1763e83e4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:46.925182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b89c0-c68f-4b27-820d-3bcb057ef987 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:46.960550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e4821-0062-4769-ad1a-b90bb5f89096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:46.961190 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e4821-0062-4769-ad1a-b90bb5f89096 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:46.961465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e4821-0062-4769-ad1a-b90bb5f89096 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:46.961761 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e4821-0062-4769-ad1a-b90bb5f89096 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:46.962391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e4821-0062-4769-ad1a-b90bb5f89096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:46.962698 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e4821-0062-4769-ad1a-b90bb5f89096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:46.964051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e4821-0062-4769-ad1a-b90bb5f89096 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:46.969492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18cb7e-090b-42a9-b913-fef1763e83e4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:46.985716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 541/1082] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:47.015425 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014709e-94b6-4887-ad07-38a60679ae0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:47.016077 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014709e-94b6-4887-ad07-38a60679ae0e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:47.016358 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014709e-94b6-4887-ad07-38a60679ae0e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:47.016630 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014709e-94b6-4887-ad07-38a60679ae0e None admin] PATH_INFO: `/v3/projects/6537023845c441fb9caf975bf69977af` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:47.017821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014709e-94b6-4887-ad07-38a60679ae0e None admin] RBAC: Authorizing `identity:get_project(project_id=6537023845c441fb9caf975bf69977af)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:47.019279 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014709e-94b6-4887-ad07-38a60679ae0e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:47.020960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 542/1083] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:11:46 2022] GET /identity/v3/projects/6537023845c441fb9caf975bf69977af => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:47.027395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e4821-0062-4769-ad1a-b90bb5f89096 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:47.045014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:47.140095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e4821-0062-4769-ad1a-b90bb5f89096 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:47.177879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed414ec-57b4-43ad-a439-e28d8899aadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:47.178477 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed414ec-57b4-43ad-a439-e28d8899aadc None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:47.178764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed414ec-57b4-43ad-a439-e28d8899aadc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:47.179038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed414ec-57b4-43ad-a439-e28d8899aadc None admin] PATH_INFO: `/v3/projects/6537023845c441fb9caf975bf69977af/users/c723540828d54ac38b6e182947f7959b/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:47.181928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed414ec-57b4-43ad-a439-e28d8899aadc None admin] RBAC: Authorizing `identity:create_grant(project_id=6537023845c441fb9caf975bf69977af, user_id=c723540828d54ac38b6e182947f7959b, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:47.183362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed414ec-57b4-43ad-a439-e28d8899aadc None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:47.196916 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 542/1084] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:11:47 2022] PUT /identity/v3/projects/6537023845c441fb9caf975bf69977af/users/c723540828d54ac38b6e182947f7959b/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:11:48.137567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edfe55-53a6-4b4f-8c6c-6a7813ada468 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:48.138134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edfe55-53a6-4b4f-8c6c-6a7813ada468 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:48.138134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edfe55-53a6-4b4f-8c6c-6a7813ada468 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:48.139458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 543/1085] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:48.144641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa26199-6957-4221-8722-cf7216fa2650 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:48.145058 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa26199-6957-4221-8722-cf7216fa2650 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:48.145267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa26199-6957-4221-8722-cf7216fa2650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:48.163443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-bfa26199-6957-4221-8722-cf7216fa2650 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:48.165171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bfa26199-6957-4221-8722-cf7216fa2650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:48.229613 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 543/1086] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:48.499071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edfe55-53a6-4b4f-8c6c-6a7813ada468 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:48.501970 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:48.599957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edfe55-53a6-4b4f-8c6c-6a7813ada468 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:48.632298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f770f45-3435-40f4-8188-c372aebc6f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:48.633475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f770f45-3435-40f4-8188-c372aebc6f9b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:48.633776 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f770f45-3435-40f4-8188-c372aebc6f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:48.634045 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f770f45-3435-40f4-8188-c372aebc6f9b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:48.644115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f770f45-3435-40f4-8188-c372aebc6f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-0f770f45-3435-40f4-8188-c372aebc6f9b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:11:48.649364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:48.650477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:48.651566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:48.651566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:48.651566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:48.651566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:48.651566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:11:48.651566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:11:48.651566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:11:48.651566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:11:48.651566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:11:48.651566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:11:48.651566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 17:11:48.651566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:48.651566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 544/1087] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Sep 27 17:11:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:48.656332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa26199-6957-4221-8722-cf7216fa2650 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:48.659495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:48.753971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa26199-6957-4221-8722-cf7216fa2650 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:48.786870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f76057-c810-4abf-af36-97ea2dc5fb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:48.787476 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f76057-c810-4abf-af36-97ea2dc5fb4e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:48.787753 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f76057-c810-4abf-af36-97ea2dc5fb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:48.788022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f76057-c810-4abf-af36-97ea2dc5fb4e None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:48.788674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f76057-c810-4abf-af36-97ea2dc5fb4e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:48.789551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f76057-c810-4abf-af36-97ea2dc5fb4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:48.791031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f76057-c810-4abf-af36-97ea2dc5fb4e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:48.798776 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 544/1088] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Sep 27 17:11:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:48.805147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f770f45-3435-40f4-8188-c372aebc6f9b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:48.864276 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:48.902616 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f770f45-3435-40f4-8188-c372aebc6f9b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:48.935905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00462ccb-f02d-4c95-9ae0-118d01e12392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:48.936527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00462ccb-f02d-4c95-9ae0-118d01e12392 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:48.936808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00462ccb-f02d-4c95-9ae0-118d01e12392 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:48.937085 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00462ccb-f02d-4c95-9ae0-118d01e12392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:48.947852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00462ccb-f02d-4c95-9ae0-118d01e12392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:48.949287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00462ccb-f02d-4c95-9ae0-118d01e12392 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-00462ccb-f02d-4c95-9ae0-118d01e12392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:48.963348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:48.964507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:48.970129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:48.970129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:48.970129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:48.970129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 545/1089] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:48.970372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f76057-c810-4abf-af36-97ea2dc5fb4e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:49.033455 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:49.067851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f76057-c810-4abf-af36-97ea2dc5fb4e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:49.100392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2043f-4062-4aaa-9762-dea87a8595a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:49.100984 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2043f-4062-4aaa-9762-dea87a8595a9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:49.101278 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2043f-4062-4aaa-9762-dea87a8595a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:49.101606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2043f-4062-4aaa-9762-dea87a8595a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:49.102336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2043f-4062-4aaa-9762-dea87a8595a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:49.102635 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2043f-4062-4aaa-9762-dea87a8595a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:49.103975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2043f-4062-4aaa-9762-dea87a8595a9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:49.115213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 545/1090] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:49.121498 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00462ccb-f02d-4c95-9ae0-118d01e12392 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:49.221029 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00462ccb-f02d-4c95-9ae0-118d01e12392 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:49.236611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:49.259565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57310506-3143-4ee1-8352-6b3b63eddd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:49.260199 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57310506-3143-4ee1-8352-6b3b63eddd85 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:49.260477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57310506-3143-4ee1-8352-6b3b63eddd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:49.260749 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57310506-3143-4ee1-8352-6b3b63eddd85 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:49.268365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57310506-3143-4ee1-8352-6b3b63eddd85 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:49.269946 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57310506-3143-4ee1-8352-6b3b63eddd85 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-57310506-3143-4ee1-8352-6b3b63eddd85 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:11:49.281140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:49.282234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:49.283183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:49.283183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:49.283183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:11:49.283183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:11:49.283183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:11:49.283183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:11:49.283183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:11:49.283183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:11:49.283183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 27 17:11:49.283183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:49.283183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 546/1091] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Sep 27 17:11:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:49.288099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2043f-4062-4aaa-9762-dea87a8595a9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:49.343463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04baa268-5124-4e02-8dfd-afd95761fd9a None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:49.343744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04baa268-5124-4e02-8dfd-afd95761fd9a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:49.344021 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04baa268-5124-4e02-8dfd-afd95761fd9a None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:49.345352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 547/1092] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:11:49.350396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fd594-385a-4422-b06e-a7592f640827 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:49.350678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fd594-385a-4422-b06e-a7592f640827 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:49.350955 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fd594-385a-4422-b06e-a7592f640827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:49.370297 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-267fd594-385a-4422-b06e-a7592f640827 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:49.371487 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-267fd594-385a-4422-b06e-a7592f640827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:49.386080 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2043f-4062-4aaa-9762-dea87a8595a9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:49.413211 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:49.423022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540ce7c-f7b6-4ee9-b2f6-fdf900734cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:49.423618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540ce7c-f7b6-4ee9-b2f6-fdf900734cbf None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:49.423891 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540ce7c-f7b6-4ee9-b2f6-fdf900734cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:49.424159 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540ce7c-f7b6-4ee9-b2f6-fdf900734cbf None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:49.424871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540ce7c-f7b6-4ee9-b2f6-fdf900734cbf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:49.425173 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540ce7c-f7b6-4ee9-b2f6-fdf900734cbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:49.426622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540ce7c-f7b6-4ee9-b2f6-fdf900734cbf None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:49.440386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 548/1093] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:49.449108 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 546/1094] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Sep 27 17:11:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:49.450508 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fd594-385a-4422-b06e-a7592f640827 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:49.545935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fd594-385a-4422-b06e-a7592f640827 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:49.548126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:49.579875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19271cf-9242-484b-bb0c-7f071cdacb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:49.580476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19271cf-9242-484b-bb0c-7f071cdacb22 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:49.580757 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19271cf-9242-484b-bb0c-7f071cdacb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:49.581028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19271cf-9242-484b-bb0c-7f071cdacb22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:49.645937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19271cf-9242-484b-bb0c-7f071cdacb22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:49.647378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19271cf-9242-484b-bb0c-7f071cdacb22 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:49.711923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540ce7c-f7b6-4ee9-b2f6-fdf900734cbf None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:49.744133 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 549/1095] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:11:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:11:49.749771 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19271cf-9242-484b-bb0c-7f071cdacb22 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:49.752429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:49.809644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540ce7c-f7b6-4ee9-b2f6-fdf900734cbf None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:49.843440 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2107d0-f9d1-4733-b1c1-ff3ea557cbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:49.844061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2107d0-f9d1-4733-b1c1-ff3ea557cbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:49.844334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2107d0-f9d1-4733-b1c1-ff3ea557cbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:49.844601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2107d0-f9d1-4733-b1c1-ff3ea557cbf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:49.846440 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19271cf-9242-484b-bb0c-7f071cdacb22 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:49.854525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2107d0-f9d1-4733-b1c1-ff3ea557cbf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-ad2107d0-f9d1-4733-b1c1-ff3ea557cbf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:11:49.859203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:49.860146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:49.861026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:49.861026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:49.861026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:49.861026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:49.861026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:11:49.861026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:11:49.861026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:11:49.861026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:11:49.861026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:11:49.861026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:11:49.861026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:11:49.861026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:11:49.861026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 547/1096] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:11:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:49.866139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2107d0-f9d1-4733-b1c1-ff3ea557cbf9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:49.881670 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0de5d2-1a0e-4bbb-adf6-94f99cc73ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:49.882349 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0de5d2-1a0e-4bbb-adf6-94f99cc73ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:49.882700 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0de5d2-1a0e-4bbb-adf6-94f99cc73ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:49.883196 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0de5d2-1a0e-4bbb-adf6-94f99cc73ae9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:49.893195 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0de5d2-1a0e-4bbb-adf6-94f99cc73ae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:49.894671 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0de5d2-1a0e-4bbb-adf6-94f99cc73ae9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9e0de5d2-1a0e-4bbb-adf6-94f99cc73ae9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:11:49.910020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:49.911100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:11:49.912010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:11:49.912010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:11:49.912010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:49.912010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 550/1097] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:11:49.913619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:49.917170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0de5d2-1a0e-4bbb-adf6-94f99cc73ae9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:49.966270 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2107d0-f9d1-4733-b1c1-ff3ea557cbf9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:49.973049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:50.000011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043cb4e-3cc9-474b-83ef-cfc1bf620008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:50.000611 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043cb4e-3cc9-474b-83ef-cfc1bf620008 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:50.000889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043cb4e-3cc9-474b-83ef-cfc1bf620008 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:50.001163 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043cb4e-3cc9-474b-83ef-cfc1bf620008 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:50.001847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043cb4e-3cc9-474b-83ef-cfc1bf620008 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:50.002152 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043cb4e-3cc9-474b-83ef-cfc1bf620008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:50.003513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043cb4e-3cc9-474b-83ef-cfc1bf620008 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:50.012676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 548/1098] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:11:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:50.018357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043cb4e-3cc9-474b-83ef-cfc1bf620008 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:50.022141 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0de5d2-1a0e-4bbb-adf6-94f99cc73ae9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:50.055271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1196093-cd78-40ce-8569-f2eceed39645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:50.055865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1196093-cd78-40ce-8569-f2eceed39645 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:50.056142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1196093-cd78-40ce-8569-f2eceed39645 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:50.056413 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1196093-cd78-40ce-8569-f2eceed39645 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:50.057040 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1196093-cd78-40ce-8569-f2eceed39645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:50.057338 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1196093-cd78-40ce-8569-f2eceed39645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:50.058736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1196093-cd78-40ce-8569-f2eceed39645 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:50.072013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 551/1099] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:50.077458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1196093-cd78-40ce-8569-f2eceed39645 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:50.116280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043cb4e-3cc9-474b-83ef-cfc1bf620008 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:50.123404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:50.150977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b4ce3-6bda-40d2-b120-1cb98f66b8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:50.151596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b4ce3-6bda-40d2-b120-1cb98f66b8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:50.151871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b4ce3-6bda-40d2-b120-1cb98f66b8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:50.152139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b4ce3-6bda-40d2-b120-1cb98f66b8d3 None admin] PATH_INFO: `/v3/users/c723540828d54ac38b6e182947f7959b` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:50.153241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b4ce3-6bda-40d2-b120-1cb98f66b8d3 None admin] RBAC: Authorizing `identity:get_user(user_id=c723540828d54ac38b6e182947f7959b)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:50.154674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b4ce3-6bda-40d2-b120-1cb98f66b8d3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:50.156231 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 549/1100] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:11:50 2022] GET /identity/v3/users/c723540828d54ac38b6e182947f7959b => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:50.161955 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b4ce3-6bda-40d2-b120-1cb98f66b8d3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:50.177455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1196093-cd78-40ce-8569-f2eceed39645 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:50.193330 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:50.211992 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe94a4-7124-4356-aa85-9bc8cc186e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:50.212663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe94a4-7124-4356-aa85-9bc8cc186e44 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:50.212946 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe94a4-7124-4356-aa85-9bc8cc186e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:50.213218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe94a4-7124-4356-aa85-9bc8cc186e44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:50.219763 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe94a4-7124-4356-aa85-9bc8cc186e44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:50.221197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe94a4-7124-4356-aa85-9bc8cc186e44 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:50.233311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-37fe94a4-7124-4356-aa85-9bc8cc186e44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:50.233311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:11:50.233311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:11:50.233311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:11:50.233311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:11:50.233311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:11:50.233311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:11:50.233311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:11:50.233311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:11:50.233311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:11:50.233311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:11:50.233311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:11:50.233311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:11:50.233311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:11:50.233311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:11:50.234403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:11:50.235456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:11:50.235456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:11:50.235456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:11:50.235456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:11:50.235456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:11:50.235456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:11:50.235456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:11:50.235456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:11:50.236269 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 552/1101] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:11:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:11:50.240199 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe94a4-7124-4356-aa85-9bc8cc186e44 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:50.261077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b4ce3-6bda-40d2-b120-1cb98f66b8d3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:50.298478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5f407-9c18-47dc-abca-6320045fa69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:50.299247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5f407-9c18-47dc-abca-6320045fa69a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:50.299342 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5f407-9c18-47dc-abca-6320045fa69a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:50.299605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5f407-9c18-47dc-abca-6320045fa69a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:50.339635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe94a4-7124-4356-aa85-9bc8cc186e44 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:50.342339 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:50.367680 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5f407-9c18-47dc-abca-6320045fa69a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:50.369123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5f407-9c18-47dc-abca-6320045fa69a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:50.372888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5705a-fd74-4aa2-84f1-3ca82f6ba32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:50.373485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5705a-fd74-4aa2-84f1-3ca82f6ba32e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:50.373798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5705a-fd74-4aa2-84f1-3ca82f6ba32e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:50.374072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5705a-fd74-4aa2-84f1-3ca82f6ba32e None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:50.374773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5705a-fd74-4aa2-84f1-3ca82f6ba32e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:50.375074 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5705a-fd74-4aa2-84f1-3ca82f6ba32e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:50.376469 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5705a-fd74-4aa2-84f1-3ca82f6ba32e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:50.389060 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 553/1102] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:11:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:50.394800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5705a-fd74-4aa2-84f1-3ca82f6ba32e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:50.428827 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:50.468873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 550/1103] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:11:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 17:11:50.474566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5f407-9c18-47dc-abca-6320045fa69a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:50.493823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5705a-fd74-4aa2-84f1-3ca82f6ba32e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:50.527208 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90922a91-c610-45a7-b05a-f624576f2245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:50.527804 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90922a91-c610-45a7-b05a-f624576f2245 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:50.528084 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90922a91-c610-45a7-b05a-f624576f2245 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:50.528358 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90922a91-c610-45a7-b05a-f624576f2245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:50.529078 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90922a91-c610-45a7-b05a-f624576f2245 None admin] RBAC: Adding query filter params (role.id=f93bdd156ab34beea98ecf5280cca56b, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=e75b03fde75e411bace8d406237a7e50) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:50.529388 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90922a91-c610-45a7-b05a-f624576f2245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:50.530851 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90922a91-c610-45a7-b05a-f624576f2245 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:50.536450 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 554/1104] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:11:50 2022] GET /identity/v3/role_assignments?user.id=e75b03fde75e411bace8d406237a7e50&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f93bdd156ab34beea98ecf5280cca56b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:50.550720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:50.578630 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5f407-9c18-47dc-abca-6320045fa69a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:50.615729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbf329-dd9a-4b83-832f-230219fbb50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:50.616314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbf329-dd9a-4b83-832f-230219fbb50c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:50.616585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbf329-dd9a-4b83-832f-230219fbb50c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:50.616963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbf329-dd9a-4b83-832f-230219fbb50c None admin] PATH_INFO: `/v3/projects/6537023845c441fb9caf975bf69977af` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:50.618436 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbf329-dd9a-4b83-832f-230219fbb50c None admin] RBAC: Authorizing `identity:get_project(project_id=6537023845c441fb9caf975bf69977af)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:50.619879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbf329-dd9a-4b83-832f-230219fbb50c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:50.621568 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 551/1105] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:11:50 2022] GET /identity/v3/projects/6537023845c441fb9caf975bf69977af => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:11:50.627938 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90922a91-c610-45a7-b05a-f624576f2245 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:50.730839 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:50.734151 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90922a91-c610-45a7-b05a-f624576f2245 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:50.768372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0724be9-d581-43a7-bb8f-6bd502bede10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:50.768977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0724be9-d581-43a7-bb8f-6bd502bede10 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:50.769258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0724be9-d581-43a7-bb8f-6bd502bede10 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:50.769528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0724be9-d581-43a7-bb8f-6bd502bede10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:50.770282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0724be9-d581-43a7-bb8f-6bd502bede10 None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=6537023845c441fb9caf975bf69977af, user.id=c723540828d54ac38b6e182947f7959b) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:50.770587 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0724be9-d581-43a7-bb8f-6bd502bede10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:50.772012 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0724be9-d581-43a7-bb8f-6bd502bede10 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:50.777924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 555/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:11:50 2022] GET /identity/v3/role_assignments?user.id=c723540828d54ac38b6e182947f7959b&scope.project.id=6537023845c441fb9caf975bf69977af&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:52.968812 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd621540-03a8-4c1d-b6b8-77b579b5c86e None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:52.969362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd621540-03a8-4c1d-b6b8-77b579b5c86e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:52.969362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd621540-03a8-4c1d-b6b8-77b579b5c86e None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:52.970740 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 552/1107] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:52.976017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff4ff6-751a-4bb8-8893-21dccc878448 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:52.977146 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff4ff6-751a-4bb8-8893-21dccc878448 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:52.977146 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff4ff6-751a-4bb8-8893-21dccc878448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:52.994828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-35ff4ff6-751a-4bb8-8893-21dccc878448 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:52.995999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-35ff4ff6-751a-4bb8-8893-21dccc878448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:53.060815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 556/1108] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:11:53.333613 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd621540-03a8-4c1d-b6b8-77b579b5c86e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:53.431667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd621540-03a8-4c1d-b6b8-77b579b5c86e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:53.464467 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb82a2-74d9-4658-9e61-9ff72acc79f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:53.465087 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb82a2-74d9-4658-9e61-9ff72acc79f3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:53.465366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb82a2-74d9-4658-9e61-9ff72acc79f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:53.465632 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb82a2-74d9-4658-9e61-9ff72acc79f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:53.466853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb82a2-74d9-4658-9e61-9ff72acc79f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:53.468311 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb82a2-74d9-4658-9e61-9ff72acc79f3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:53.470091 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 553/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:11:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:53.475779 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff4ff6-751a-4bb8-8893-21dccc878448 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:53.565999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:53.573351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff4ff6-751a-4bb8-8893-21dccc878448 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:53.608350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc3522-0a1a-4459-af8c-d544fbc5ff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:53.608889 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3522-0a1a-4459-af8c-d544fbc5ff4a None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:53.609169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3522-0a1a-4459-af8c-d544fbc5ff4a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:53.609439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3522-0a1a-4459-af8c-d544fbc5ff4a None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:53.610131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc3522-0a1a-4459-af8c-d544fbc5ff4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:53.611551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc3522-0a1a-4459-af8c-d544fbc5ff4a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:53.632005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 557/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:11:53 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:11:55.809106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64353-1c25-4a5d-b695-f9519827bcd1 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:55.809631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64353-1c25-4a5d-b695-f9519827bcd1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:55.809784 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64353-1c25-4a5d-b695-f9519827bcd1 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:55.811053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 554/1111] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:55.816357 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23684775-50d5-40f9-a3da-59e31c393254 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:55.816781 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23684775-50d5-40f9-a3da-59e31c393254 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:55.816902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23684775-50d5-40f9-a3da-59e31c393254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:55.835818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-23684775-50d5-40f9-a3da-59e31c393254 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:55.837089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-23684775-50d5-40f9-a3da-59e31c393254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:55.902155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 558/1112] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:56.173324 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64353-1c25-4a5d-b695-f9519827bcd1 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:56.185616 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:56.273364 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64353-1c25-4a5d-b695-f9519827bcd1 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:56.305238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc23b5-6429-4dce-af12-30f3349c778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:56.305875 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc23b5-6429-4dce-af12-30f3349c778a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:56.306155 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc23b5-6429-4dce-af12-30f3349c778a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:56.306425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc23b5-6429-4dce-af12-30f3349c778a None admin] PATH_INFO: `/v3/roles/a1b50a29e5e4419db517dfaf3d70c19f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:56.307783 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc23b5-6429-4dce-af12-30f3349c778a None admin] RBAC: Authorizing `identity:get_role(role_id=a1b50a29e5e4419db517dfaf3d70c19f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:56.309125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc23b5-6429-4dce-af12-30f3349c778a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:56.310452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 555/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:11:56 2022] GET /identity/v3/roles/a1b50a29e5e4419db517dfaf3d70c19f => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:56.316210 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23684775-50d5-40f9-a3da-59e31c393254 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:56.393909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:56.412765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23684775-50d5-40f9-a3da-59e31c393254 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:56.447037 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620c36b-9c35-4bbf-bb3e-cb9031980346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:56.447654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620c36b-9c35-4bbf-bb3e-cb9031980346 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:56.447935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620c36b-9c35-4bbf-bb3e-cb9031980346 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:56.448204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620c36b-9c35-4bbf-bb3e-cb9031980346 None admin] PATH_INFO: `/v3/users/e0f8859c867e4ccf8f4785da64c3b9e7` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:56.461070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620c36b-9c35-4bbf-bb3e-cb9031980346 None admin] RBAC: Authorizing `identity:get_user(user_id=e0f8859c867e4ccf8f4785da64c3b9e7)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:56.462536 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620c36b-9c35-4bbf-bb3e-cb9031980346 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:56.464112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 559/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:11:56 2022] GET /identity/v3/users/e0f8859c867e4ccf8f4785da64c3b9e7 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:56.470023 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc23b5-6429-4dce-af12-30f3349c778a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:56.544995 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:56.565920 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc23b5-6429-4dce-af12-30f3349c778a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:56.599187 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e95954-514d-4d1f-af26-103e24c03c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:56.599782 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e95954-514d-4d1f-af26-103e24c03c99 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:56.600062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e95954-514d-4d1f-af26-103e24c03c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:56.600335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e95954-514d-4d1f-af26-103e24c03c99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:56.665060 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e95954-514d-4d1f-af26-103e24c03c99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:56.666518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e95954-514d-4d1f-af26-103e24c03c99 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:56.738498 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:56.761000 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 556/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:11:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:11:56.767115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620c36b-9c35-4bbf-bb3e-cb9031980346 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:56.863255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620c36b-9c35-4bbf-bb3e-cb9031980346 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:56.896696 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd800a-b443-4eb0-bc1d-4e9ecedb78d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:56.897317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd800a-b443-4eb0-bc1d-4e9ecedb78d2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:56.897598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd800a-b443-4eb0-bc1d-4e9ecedb78d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:56.897925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd800a-b443-4eb0-bc1d-4e9ecedb78d2 None admin] PATH_INFO: `/v3/projects/6537023845c441fb9caf975bf69977af` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:56.899036 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd800a-b443-4eb0-bc1d-4e9ecedb78d2 None admin] RBAC: Authorizing `identity:get_project(project_id=6537023845c441fb9caf975bf69977af)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:56.900454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd800a-b443-4eb0-bc1d-4e9ecedb78d2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:56.902088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 560/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:11:56 2022] GET /identity/v3/projects/6537023845c441fb9caf975bf69977af => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:56.908091 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e95954-514d-4d1f-af26-103e24c03c99 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:57.003397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e95954-514d-4d1f-af26-103e24c03c99 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:57.035147 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ff461-6a1d-40dd-a2ec-17194ca6c8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:57.035731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ff461-6a1d-40dd-a2ec-17194ca6c8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:57.036010 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ff461-6a1d-40dd-a2ec-17194ca6c8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:57.036283 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ff461-6a1d-40dd-a2ec-17194ca6c8a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:57.036993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ff461-6a1d-40dd-a2ec-17194ca6c8a8 None admin] RBAC: Adding query filter params (role.id=a1b50a29e5e4419db517dfaf3d70c19f, scope.project.id=6537023845c441fb9caf975bf69977af, user.id=e0f8859c867e4ccf8f4785da64c3b9e7) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:11:57.037300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ff461-6a1d-40dd-a2ec-17194ca6c8a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:57.039271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ff461-6a1d-40dd-a2ec-17194ca6c8a8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:57.044383 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 557/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:11:56 2022] GET /identity/v3/role_assignments?user.id=e0f8859c867e4ccf8f4785da64c3b9e7&scope.project.id=6537023845c441fb9caf975bf69977af&role.id=a1b50a29e5e4419db517dfaf3d70c19f => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:59.177033 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37351d0-12e9-4736-b280-767787c54c37 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:59.177584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37351d0-12e9-4736-b280-767787c54c37 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:59.177584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37351d0-12e9-4736-b280-767787c54c37 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:59.179482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 561/1118] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:11:59.184672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ee551-8fed-427b-90ff-f806b4361d94 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:59.185070 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ee551-8fed-427b-90ff-f806b4361d94 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:59.185220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ee551-8fed-427b-90ff-f806b4361d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:59.202836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-cb0ee551-8fed-427b-90ff-f806b4361d94 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:11:59.204016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cb0ee551-8fed-427b-90ff-f806b4361d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:11:59.237835 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:59.268068 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 558/1119] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:11:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:11:59.535800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37351d0-12e9-4736-b280-767787c54c37 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:59.544554 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:59.635992 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37351d0-12e9-4736-b280-767787c54c37 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:59.668211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce70b88-a903-4b1e-b2fb-936ff26e72d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:59.668819 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce70b88-a903-4b1e-b2fb-936ff26e72d8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:59.669097 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce70b88-a903-4b1e-b2fb-936ff26e72d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:59.669369 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce70b88-a903-4b1e-b2fb-936ff26e72d8 None admin] PATH_INFO: `/v3/roles/a1b50a29e5e4419db517dfaf3d70c19f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:59.670760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce70b88-a903-4b1e-b2fb-936ff26e72d8 None admin] RBAC: Authorizing `identity:get_role(role_id=a1b50a29e5e4419db517dfaf3d70c19f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:59.672121 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce70b88-a903-4b1e-b2fb-936ff26e72d8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:59.673420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 562/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:11:59 2022] GET /identity/v3/roles/a1b50a29e5e4419db517dfaf3d70c19f => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:59.679640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ee551-8fed-427b-90ff-f806b4361d94 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:59.774097 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ee551-8fed-427b-90ff-f806b4361d94 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:59.806567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9757af-cd54-498a-ac82-bfee8d22e0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:59.807172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9757af-cd54-498a-ac82-bfee8d22e0bb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:59.807448 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9757af-cd54-498a-ac82-bfee8d22e0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:59.807717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9757af-cd54-498a-ac82-bfee8d22e0bb None admin] PATH_INFO: `/v3/users/e0f8859c867e4ccf8f4785da64c3b9e7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:59.808801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9757af-cd54-498a-ac82-bfee8d22e0bb None admin] RBAC: Authorizing `identity:get_user(user_id=e0f8859c867e4ccf8f4785da64c3b9e7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:59.810241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9757af-cd54-498a-ac82-bfee8d22e0bb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:59.811765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 559/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:11:59 2022] GET /identity/v3/users/e0f8859c867e4ccf8f4785da64c3b9e7 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:59.817436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce70b88-a903-4b1e-b2fb-936ff26e72d8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:11:59.890393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:11:59.915404 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce70b88-a903-4b1e-b2fb-936ff26e72d8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:11:59.948161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a68c8-6f0c-455c-8195-b0b73e5a266c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:11:59.948774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a68c8-6f0c-455c-8195-b0b73e5a266c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:11:59.949054 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a68c8-6f0c-455c-8195-b0b73e5a266c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:11:59.949324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a68c8-6f0c-455c-8195-b0b73e5a266c None admin] PATH_INFO: `/v3/projects/6537023845c441fb9caf975bf69977af` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:11:59.950455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a68c8-6f0c-455c-8195-b0b73e5a266c None admin] RBAC: Authorizing `identity:get_project(project_id=6537023845c441fb9caf975bf69977af)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:11:59.951871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a68c8-6f0c-455c-8195-b0b73e5a266c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:11:59.953459 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 563/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:11:59 2022] GET /identity/v3/projects/6537023845c441fb9caf975bf69977af => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:11:59.959506 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9757af-cd54-498a-ac82-bfee8d22e0bb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:00.000489 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:00.057476 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9757af-cd54-498a-ac82-bfee8d22e0bb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:00.089549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53124562-dec5-47a3-aed3-feea1f0253d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:00.090225 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53124562-dec5-47a3-aed3-feea1f0253d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:00.090503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53124562-dec5-47a3-aed3-feea1f0253d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:00.090773 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53124562-dec5-47a3-aed3-feea1f0253d7 None admin] PATH_INFO: `/v3/projects/6537023845c441fb9caf975bf69977af/users/e0f8859c867e4ccf8f4785da64c3b9e7/roles/a1b50a29e5e4419db517dfaf3d70c19f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:00.092858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53124562-dec5-47a3-aed3-feea1f0253d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6537023845c441fb9caf975bf69977af, user_id=e0f8859c867e4ccf8f4785da64c3b9e7, role_id=a1b50a29e5e4419db517dfaf3d70c19f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:00.094370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53124562-dec5-47a3-aed3-feea1f0253d7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:00.107400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 560/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:11:59 2022] PUT /identity/v3/projects/6537023845c441fb9caf975bf69977af/users/e0f8859c867e4ccf8f4785da64c3b9e7/roles/a1b50a29e5e4419db517dfaf3d70c19f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:12:02.245202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fa58-c5af-4317-98f0-5ba90646e8fe None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:02.245784 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fa58-c5af-4317-98f0-5ba90646e8fe None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:02.245784 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fa58-c5af-4317-98f0-5ba90646e8fe None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:02.247095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 564/1124] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:12:02.252308 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cd6b8-5a70-40fb-b80a-f40a1d137801 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:02.252713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cd6b8-5a70-40fb-b80a-f40a1d137801 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:02.252857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cd6b8-5a70-40fb-b80a-f40a1d137801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:02.271044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-638cd6b8-5a70-40fb-b80a-f40a1d137801 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:12:02.272867 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-638cd6b8-5a70-40fb-b80a-f40a1d137801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:12:02.337675 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 561/1125] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:12:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:12:02.604333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41fa58-c5af-4317-98f0-5ba90646e8fe None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:02.712580 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41fa58-c5af-4317-98f0-5ba90646e8fe None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:02.745127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7292c03-9566-465e-84e7-c71b922bbbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:02.745763 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292c03-9566-465e-84e7-c71b922bbbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:02.746042 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292c03-9566-465e-84e7-c71b922bbbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:02.746311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292c03-9566-465e-84e7-c71b922bbbb0 None admin] PATH_INFO: `/v3/roles/a1b50a29e5e4419db517dfaf3d70c19f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:02.747673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7292c03-9566-465e-84e7-c71b922bbbb0 None admin] RBAC: Authorizing `identity:get_role(role_id=a1b50a29e5e4419db517dfaf3d70c19f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:02.749036 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7292c03-9566-465e-84e7-c71b922bbbb0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:02.750377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 565/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:12:02 2022] GET /identity/v3/roles/a1b50a29e5e4419db517dfaf3d70c19f => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:02.756153 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cd6b8-5a70-40fb-b80a-f40a1d137801 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:02.785072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:02.854534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cd6b8-5a70-40fb-b80a-f40a1d137801 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:02.886789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd189ca-076d-471c-a3cc-1299bf9e9415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:02.887399 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd189ca-076d-471c-a3cc-1299bf9e9415 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:02.887675 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd189ca-076d-471c-a3cc-1299bf9e9415 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:02.887945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd189ca-076d-471c-a3cc-1299bf9e9415 None admin] PATH_INFO: `/v3/users/e0f8859c867e4ccf8f4785da64c3b9e7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:02.889028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd189ca-076d-471c-a3cc-1299bf9e9415 None admin] RBAC: Authorizing `identity:get_user(user_id=e0f8859c867e4ccf8f4785da64c3b9e7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:02.890458 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd189ca-076d-471c-a3cc-1299bf9e9415 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:02.891993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 562/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:12:02 2022] GET /identity/v3/users/e0f8859c867e4ccf8f4785da64c3b9e7 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:02.897771 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7292c03-9566-465e-84e7-c71b922bbbb0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:02.909525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:02.994381 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7292c03-9566-465e-84e7-c71b922bbbb0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:03.026817 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd831961-2066-455f-a0a9-6d5ccdfa43a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:03.027401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd831961-2066-455f-a0a9-6d5ccdfa43a3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:03.027685 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd831961-2066-455f-a0a9-6d5ccdfa43a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:03.027951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd831961-2066-455f-a0a9-6d5ccdfa43a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:03.091556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd831961-2066-455f-a0a9-6d5ccdfa43a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:03.092977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd831961-2066-455f-a0a9-6d5ccdfa43a3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:03.103896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:03.187451 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 566/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:12:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:12:03.193337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd189ca-076d-471c-a3cc-1299bf9e9415 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:03.286062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:03.290938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd189ca-076d-471c-a3cc-1299bf9e9415 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:03.323045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ac6d9-e104-4d5d-b8fb-3a5949cbd6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:03.323665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ac6d9-e104-4d5d-b8fb-3a5949cbd6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:03.323946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ac6d9-e104-4d5d-b8fb-3a5949cbd6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:03.324219 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ac6d9-e104-4d5d-b8fb-3a5949cbd6e4 None admin] PATH_INFO: `/v3/projects/6537023845c441fb9caf975bf69977af` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:03.325322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ac6d9-e104-4d5d-b8fb-3a5949cbd6e4 None admin] RBAC: Authorizing `identity:get_project(project_id=6537023845c441fb9caf975bf69977af)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:03.326765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ac6d9-e104-4d5d-b8fb-3a5949cbd6e4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:03.328366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 563/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:12:03 2022] GET /identity/v3/projects/6537023845c441fb9caf975bf69977af => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:03.335254 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd831961-2066-455f-a0a9-6d5ccdfa43a3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:03.430505 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd831961-2066-455f-a0a9-6d5ccdfa43a3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:03.440944 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:03.464494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a9098-40cd-4ac3-a2dc-ee869b1dd57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:03.465081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9098-40cd-4ac3-a2dc-ee869b1dd57d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:03.465355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9098-40cd-4ac3-a2dc-ee869b1dd57d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:03.465622 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9098-40cd-4ac3-a2dc-ee869b1dd57d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:03.466364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a9098-40cd-4ac3-a2dc-ee869b1dd57d None admin] RBAC: Adding query filter params (role.id=a1b50a29e5e4419db517dfaf3d70c19f, scope.project.id=6537023845c441fb9caf975bf69977af, user.id=e0f8859c867e4ccf8f4785da64c3b9e7) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:12:03.466667 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a9098-40cd-4ac3-a2dc-ee869b1dd57d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:03.468081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a9098-40cd-4ac3-a2dc-ee869b1dd57d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:03.473621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 567/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:12:03 2022] GET /identity/v3/role_assignments?user.id=e0f8859c867e4ccf8f4785da64c3b9e7&scope.project.id=6537023845c441fb9caf975bf69977af&role.id=a1b50a29e5e4419db517dfaf3d70c19f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:05.637057 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c907d7-8fc9-487d-8817-a7a30be9dbb4 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:05.637624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c907d7-8fc9-487d-8817-a7a30be9dbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:05.637624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c907d7-8fc9-487d-8817-a7a30be9dbb4 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:05.638966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 564/1131] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:12:05.644252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dab2c-b4a4-44c3-9320-4479d6b19511 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:05.644665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dab2c-b4a4-44c3-9320-4479d6b19511 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:05.644794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dab2c-b4a4-44c3-9320-4479d6b19511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:05.664074 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-084dab2c-b4a4-44c3-9320-4479d6b19511 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:12:05.665244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-084dab2c-b4a4-44c3-9320-4479d6b19511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:12:05.730069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 568/1132] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:12:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:12:05.997517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c907d7-8fc9-487d-8817-a7a30be9dbb4 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:06.095580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c907d7-8fc9-487d-8817-a7a30be9dbb4 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:06.127657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b7689-2b64-4c73-b45a-f9f9eb26089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:06.128268 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b7689-2b64-4c73-b45a-f9f9eb26089d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:06.128545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b7689-2b64-4c73-b45a-f9f9eb26089d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:06.128822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b7689-2b64-4c73-b45a-f9f9eb26089d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:06.129940 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b7689-2b64-4c73-b45a-f9f9eb26089d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:06.131907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b7689-2b64-4c73-b45a-f9f9eb26089d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:06.133432 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 565/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:12:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:06.139346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dab2c-b4a4-44c3-9320-4479d6b19511 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:06.234900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dab2c-b4a4-44c3-9320-4479d6b19511 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:06.237150 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:06.268612 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33547c9-eb71-4cdb-87fd-b9ba51d6b5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:06.269149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33547c9-eb71-4cdb-87fd-b9ba51d6b5f0 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:06.269430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33547c9-eb71-4cdb-87fd-b9ba51d6b5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:06.269729 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33547c9-eb71-4cdb-87fd-b9ba51d6b5f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:06.270375 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33547c9-eb71-4cdb-87fd-b9ba51d6b5f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:06.272357 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33547c9-eb71-4cdb-87fd-b9ba51d6b5f0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:06.298429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 569/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Sep 27 17:12:06 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:12:08.476051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cb869-186d-492d-81b0-9472788404b9 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:08.476521 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cb869-186d-492d-81b0-9472788404b9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:08.476629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cb869-186d-492d-81b0-9472788404b9 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:08.479364 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 566/1135] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:12:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:12:08.484608 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1c112-5d0a-4bbc-b90f-ff152f40c8a3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:08.485032 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1c112-5d0a-4bbc-b90f-ff152f40c8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:08.485158 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1c112-5d0a-4bbc-b90f-ff152f40c8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:08.503356 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3eb1c112-5d0a-4bbc-b90f-ff152f40c8a3 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:12:08.504529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3eb1c112-5d0a-4bbc-b90f-ff152f40c8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:12:08.570094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 570/1136] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:12:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:12:08.834962 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cb869-186d-492d-81b0-9472788404b9 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:08.869855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:08.935840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cb869-186d-492d-81b0-9472788404b9 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:08.967779 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a092c80-a3a3-4914-b040-d58c952bdfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:08.968396 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a092c80-a3a3-4914-b040-d58c952bdfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:08.968676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a092c80-a3a3-4914-b040-d58c952bdfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:08.968949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a092c80-a3a3-4914-b040-d58c952bdfe0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:08.970061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a092c80-a3a3-4914-b040-d58c952bdfe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:08.971477 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a092c80-a3a3-4914-b040-d58c952bdfe0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:08.973022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 567/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:12:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:08.979203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1c112-5d0a-4bbc-b90f-ff152f40c8a3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:09.059933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:09.076166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1c112-5d0a-4bbc-b90f-ff152f40c8a3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:09.109614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b5a3e-a01f-4bbe-984c-47f0838a2394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:09.110172 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5a3e-a01f-4bbe-984c-47f0838a2394 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:09.110447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5a3e-a01f-4bbe-984c-47f0838a2394 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:09.110715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5a3e-a01f-4bbe-984c-47f0838a2394 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:09.111351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b5a3e-a01f-4bbe-984c-47f0838a2394 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:09.112771 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b5a3e-a01f-4bbe-984c-47f0838a2394 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:09.134597 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 571/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:12:08 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:12:11.300417 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a37c7c-335a-49e6-8825-71fe17086980 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:11.300945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a37c7c-335a-49e6-8825-71fe17086980 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:11.300945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a37c7c-335a-49e6-8825-71fe17086980 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:11.302293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 568/1139] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:12:11.307697 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451d556-e4e0-4c98-9732-88493097fcf8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:11.308071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451d556-e4e0-4c98-9732-88493097fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:11.308244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451d556-e4e0-4c98-9732-88493097fcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:11.326469 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3451d556-e4e0-4c98-9732-88493097fcf8 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:12:11.327644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3451d556-e4e0-4c98-9732-88493097fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:12:11.392243 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 572/1140] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:12:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:12:11.663331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a37c7c-335a-49e6-8825-71fe17086980 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:11.761665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a37c7c-335a-49e6-8825-71fe17086980 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:11.763133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:11.795763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b2445-51a2-40f9-94af-6cc6bd74a636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:11.796375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2445-51a2-40f9-94af-6cc6bd74a636 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:11.796649 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2445-51a2-40f9-94af-6cc6bd74a636 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:11.796921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2445-51a2-40f9-94af-6cc6bd74a636 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:11.806766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b2445-51a2-40f9-94af-6cc6bd74a636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-aa1b2445-51a2-40f9-94af-6cc6bd74a636 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:12:11.811451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:12:11.812545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:12:11.813654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:12:11.813654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:12:11.813654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:12:11.813654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:12:11.813654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:12:11.813654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:12:11.813654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:12:11.813654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:12:11.813654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:12:11.813654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:12:11.813654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:12:11.813654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:12:11.813654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 569/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:12:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:12:11.818909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451d556-e4e0-4c98-9732-88493097fcf8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:11.886706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:11.916706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451d556-e4e0-4c98-9732-88493097fcf8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:11.949563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca549d3-5ce7-47c5-b100-9030f5ad7a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:11.950183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca549d3-5ce7-47c5-b100-9030f5ad7a0b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:11.950461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca549d3-5ce7-47c5-b100-9030f5ad7a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:11.950732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca549d3-5ce7-47c5-b100-9030f5ad7a0b None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:11.951382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca549d3-5ce7-47c5-b100-9030f5ad7a0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:12:11.951684 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca549d3-5ce7-47c5-b100-9030f5ad7a0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:11.953038 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca549d3-5ce7-47c5-b100-9030f5ad7a0b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:11.961933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 573/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:12:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:11.968007 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b2445-51a2-40f9-94af-6cc6bd74a636 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:12.063140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b2445-51a2-40f9-94af-6cc6bd74a636 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:12.096614 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbd300-4795-4ee3-b5ed-b004d03d9009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:12.097221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbd300-4795-4ee3-b5ed-b004d03d9009 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:12.097520 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbd300-4795-4ee3-b5ed-b004d03d9009 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:12.097819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbd300-4795-4ee3-b5ed-b004d03d9009 None admin] PATH_INFO: `/v3/users/80c806f8856b48d1ae2526cc99319cec` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:12.110332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbd300-4795-4ee3-b5ed-b004d03d9009 None admin] RBAC: Authorizing `identity:get_user(user_id=80c806f8856b48d1ae2526cc99319cec)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:12.111744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbd300-4795-4ee3-b5ed-b004d03d9009 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:12.113301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 570/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:12:11 2022] GET /identity/v3/users/80c806f8856b48d1ae2526cc99319cec => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:12.119648 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca549d3-5ce7-47c5-b100-9030f5ad7a0b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:12.217692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca549d3-5ce7-47c5-b100-9030f5ad7a0b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:12.250093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb836e-9919-4890-a357-726f9d08a2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:12.250679 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb836e-9919-4890-a357-726f9d08a2ea None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:12.250956 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb836e-9919-4890-a357-726f9d08a2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:12.251226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb836e-9919-4890-a357-726f9d08a2ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:12.253715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:12.319198 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb836e-9919-4890-a357-726f9d08a2ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:12.320612 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb836e-9919-4890-a357-726f9d08a2ea None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:12.413649 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 574/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:12:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:12:12.419388 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbd300-4795-4ee3-b5ed-b004d03d9009 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:12.440955 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:12.517745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbd300-4795-4ee3-b5ed-b004d03d9009 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:12.550198 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78de2e2-7b86-4850-b7b3-4271226c69c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:12.550814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78de2e2-7b86-4850-b7b3-4271226c69c4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:12.551092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78de2e2-7b86-4850-b7b3-4271226c69c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:12.551361 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78de2e2-7b86-4850-b7b3-4271226c69c4 None admin] PATH_INFO: `/v3/projects/9de92cf787844751a8af75c000b10cdf` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:12.552445 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78de2e2-7b86-4850-b7b3-4271226c69c4 None admin] RBAC: Authorizing `identity:get_project(project_id=9de92cf787844751a8af75c000b10cdf)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:12.554047 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78de2e2-7b86-4850-b7b3-4271226c69c4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:12.555650 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 571/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:12:12 2022] GET /identity/v3/projects/9de92cf787844751a8af75c000b10cdf => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:12:12.561790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb836e-9919-4890-a357-726f9d08a2ea None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:12.595577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:12.659963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb836e-9919-4890-a357-726f9d08a2ea None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:12.692624 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995c277-722e-4608-87be-89450a79ce51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:12.693773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995c277-722e-4608-87be-89450a79ce51 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:12.694261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995c277-722e-4608-87be-89450a79ce51 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:12.694536 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995c277-722e-4608-87be-89450a79ce51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:12.695248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995c277-722e-4608-87be-89450a79ce51 None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=9de92cf787844751a8af75c000b10cdf, user.id=80c806f8856b48d1ae2526cc99319cec) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:12:12.695556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995c277-722e-4608-87be-89450a79ce51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:12.696969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995c277-722e-4608-87be-89450a79ce51 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:12.702317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 575/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:12:12 2022] GET /identity/v3/role_assignments?user.id=80c806f8856b48d1ae2526cc99319cec&scope.project.id=9de92cf787844751a8af75c000b10cdf&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:14.826420 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674dcb7-ed9d-4a0a-85fc-ceb97c8f86bf None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:14.827017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674dcb7-ed9d-4a0a-85fc-ceb97c8f86bf None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:14.827017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674dcb7-ed9d-4a0a-85fc-ceb97c8f86bf None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:14.828289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 572/1147] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:12:14.833784 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d17fe0-fb42-4d8d-b707-77b74ade79cd None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:14.834172 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d17fe0-fb42-4d8d-b707-77b74ade79cd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:14.834329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d17fe0-fb42-4d8d-b707-77b74ade79cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:14.852424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-71d17fe0-fb42-4d8d-b707-77b74ade79cd None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:12:14.853598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-71d17fe0-fb42-4d8d-b707-77b74ade79cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:12:14.916770 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 576/1148] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:12:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:12:15.192248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674dcb7-ed9d-4a0a-85fc-ceb97c8f86bf None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:15.278068 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:15.291032 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674dcb7-ed9d-4a0a-85fc-ceb97c8f86bf None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:15.323830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c274d-65b5-4b1f-84da-a5bd4b3416f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:15.324440 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c274d-65b5-4b1f-84da-a5bd4b3416f3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:15.324724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c274d-65b5-4b1f-84da-a5bd4b3416f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:15.324995 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c274d-65b5-4b1f-84da-a5bd4b3416f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:15.335149 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c274d-65b5-4b1f-84da-a5bd4b3416f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-df8c274d-65b5-4b1f-84da-a5bd4b3416f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:12:15.339817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:12:15.340954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:12:15.341906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:12:15.341906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:12:15.341906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:12:15.341906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:12:15.341906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:12:15.341906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:12:15.341906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:12:15.341906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:12:15.341906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:12:15.341906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:12:15.341906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:12:15.341906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:12:15.341906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 573/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:12:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:12:15.346886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d17fe0-fb42-4d8d-b707-77b74ade79cd None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:15.374029 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:15.444717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d17fe0-fb42-4d8d-b707-77b74ade79cd None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:15.477041 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0deea80-c786-4442-bea4-84df228189a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:15.477635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0deea80-c786-4442-bea4-84df228189a7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:15.477940 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0deea80-c786-4442-bea4-84df228189a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:15.478208 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0deea80-c786-4442-bea4-84df228189a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:15.478859 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0deea80-c786-4442-bea4-84df228189a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:12:15.479161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0deea80-c786-4442-bea4-84df228189a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:15.480514 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0deea80-c786-4442-bea4-84df228189a7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:15.488155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 577/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:12:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:15.495380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c274d-65b5-4b1f-84da-a5bd4b3416f3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:15.593793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c274d-65b5-4b1f-84da-a5bd4b3416f3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:15.626627 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92807594-259f-469c-b7b4-fb6b8dc1f068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:15.627246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92807594-259f-469c-b7b4-fb6b8dc1f068 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:15.627526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92807594-259f-469c-b7b4-fb6b8dc1f068 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:15.627799 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92807594-259f-469c-b7b4-fb6b8dc1f068 None admin] PATH_INFO: `/v3/users/80c806f8856b48d1ae2526cc99319cec` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:15.628901 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92807594-259f-469c-b7b4-fb6b8dc1f068 None admin] RBAC: Authorizing `identity:get_user(user_id=80c806f8856b48d1ae2526cc99319cec)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:15.630346 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92807594-259f-469c-b7b4-fb6b8dc1f068 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:15.632051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 574/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:12:15 2022] GET /identity/v3/users/80c806f8856b48d1ae2526cc99319cec => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:15.637826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0deea80-c786-4442-bea4-84df228189a7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:15.726725 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:15.736571 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0deea80-c786-4442-bea4-84df228189a7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:15.769256 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ba87a-b761-4104-9c17-81fc8c1fd0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:15.769898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ba87a-b761-4104-9c17-81fc8c1fd0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:15.770181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ba87a-b761-4104-9c17-81fc8c1fd0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:15.770454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ba87a-b761-4104-9c17-81fc8c1fd0d6 None admin] PATH_INFO: `/v3/projects/9de92cf787844751a8af75c000b10cdf` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:15.771696 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ba87a-b761-4104-9c17-81fc8c1fd0d6 None admin] RBAC: Authorizing `identity:get_project(project_id=9de92cf787844751a8af75c000b10cdf)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:15.773109 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ba87a-b761-4104-9c17-81fc8c1fd0d6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:15.775095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 578/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:12:15 2022] GET /identity/v3/projects/9de92cf787844751a8af75c000b10cdf => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:15.780606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92807594-259f-469c-b7b4-fb6b8dc1f068 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:15.799284 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:15.878738 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92807594-259f-469c-b7b4-fb6b8dc1f068 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:15.910768 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891db6d-4e4c-48e4-a178-de13540bc5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:15.911418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891db6d-4e4c-48e4-a178-de13540bc5ac None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:15.911701 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891db6d-4e4c-48e4-a178-de13540bc5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:15.912513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891db6d-4e4c-48e4-a178-de13540bc5ac None admin] PATH_INFO: `/v3/projects/9de92cf787844751a8af75c000b10cdf/users/80c806f8856b48d1ae2526cc99319cec/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:15.914406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891db6d-4e4c-48e4-a178-de13540bc5ac None admin] RBAC: Authorizing `identity:create_grant(project_id=9de92cf787844751a8af75c000b10cdf, user_id=80c806f8856b48d1ae2526cc99319cec, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:15.915808 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891db6d-4e4c-48e4-a178-de13540bc5ac None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:15.928588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 575/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:12:15 2022] PUT /identity/v3/projects/9de92cf787844751a8af75c000b10cdf/users/80c806f8856b48d1ae2526cc99319cec/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:12:18.063393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce013f9c-72b5-45c6-85b8-e07e35597e94 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:18.063984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce013f9c-72b5-45c6-85b8-e07e35597e94 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:18.064074 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce013f9c-72b5-45c6-85b8-e07e35597e94 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:18.065581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 579/1154] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:12:18.072340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93699b-b5b8-452d-b34c-60887ec62525 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:18.072761 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93699b-b5b8-452d-b34c-60887ec62525 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:18.072893 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93699b-b5b8-452d-b34c-60887ec62525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:18.091539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-bb93699b-b5b8-452d-b34c-60887ec62525 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:12:18.092719 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bb93699b-b5b8-452d-b34c-60887ec62525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:12:18.156901 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 576/1155] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:12:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:12:18.425504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce013f9c-72b5-45c6-85b8-e07e35597e94 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:18.526389 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce013f9c-72b5-45c6-85b8-e07e35597e94 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:18.559550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081595a-3f4b-49bb-8a3a-50a1147748c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:18.559550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081595a-3f4b-49bb-8a3a-50a1147748c3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:18.559804 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081595a-3f4b-49bb-8a3a-50a1147748c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:18.559900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081595a-3f4b-49bb-8a3a-50a1147748c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:18.570999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081595a-3f4b-49bb-8a3a-50a1147748c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e081595a-3f4b-49bb-8a3a-50a1147748c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:12:18.575669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:12:18.576773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:12:18.578027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:12:18.578027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:12:18.578027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:12:18.578027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:12:18.578027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:12:18.578027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:12:18.578027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:12:18.578027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:12:18.578027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:12:18.578027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:12:18.578027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:12:18.578027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:12:18.578027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 580/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:12:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:12:18.583121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93699b-b5b8-452d-b34c-60887ec62525 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:18.591774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:18.679364 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93699b-b5b8-452d-b34c-60887ec62525 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:18.711831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cc295-97b4-40d7-8e5d-a90b082d2d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:18.712416 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cc295-97b4-40d7-8e5d-a90b082d2d60 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:18.712697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cc295-97b4-40d7-8e5d-a90b082d2d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:18.712970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cc295-97b4-40d7-8e5d-a90b082d2d60 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:18.713624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cc295-97b4-40d7-8e5d-a90b082d2d60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:12:18.713957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cc295-97b4-40d7-8e5d-a90b082d2d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:18.715314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163cc295-97b4-40d7-8e5d-a90b082d2d60 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:18.723201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 577/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:18.729600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081595a-3f4b-49bb-8a3a-50a1147748c3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:18.748948 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:18.832934 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081595a-3f4b-49bb-8a3a-50a1147748c3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:18.866585 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ff3ba-d771-4af5-8b20-5dbefa52b37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:18.867197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ff3ba-d771-4af5-8b20-5dbefa52b37f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:18.867477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ff3ba-d771-4af5-8b20-5dbefa52b37f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:18.867749 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ff3ba-d771-4af5-8b20-5dbefa52b37f None admin] PATH_INFO: `/v3/users/80c806f8856b48d1ae2526cc99319cec` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:18.868848 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ff3ba-d771-4af5-8b20-5dbefa52b37f None admin] RBAC: Authorizing `identity:get_user(user_id=80c806f8856b48d1ae2526cc99319cec)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:18.870304 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ff3ba-d771-4af5-8b20-5dbefa52b37f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:18.871858 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 581/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:12:18 2022] GET /identity/v3/users/80c806f8856b48d1ae2526cc99319cec => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:18.877770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cc295-97b4-40d7-8e5d-a90b082d2d60 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:18.941073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:18.973568 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cc295-97b4-40d7-8e5d-a90b082d2d60 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:19.005677 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8a832-78e1-4ad4-a1ec-be05bf2c5907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:19.006297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8a832-78e1-4ad4-a1ec-be05bf2c5907 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:19.006573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8a832-78e1-4ad4-a1ec-be05bf2c5907 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:19.006843 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8a832-78e1-4ad4-a1ec-be05bf2c5907 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:19.069924 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8a832-78e1-4ad4-a1ec-be05bf2c5907 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:19.071337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8a832-78e1-4ad4-a1ec-be05bf2c5907 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:19.132061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:19.164301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 578/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:12:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:12:19.170376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ff3ba-d771-4af5-8b20-5dbefa52b37f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:19.253189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:19.268214 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ff3ba-d771-4af5-8b20-5dbefa52b37f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:19.300549 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006f48f-8341-4644-9cc9-8dbcbc6a2798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:19.301160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006f48f-8341-4644-9cc9-8dbcbc6a2798 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:19.301440 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006f48f-8341-4644-9cc9-8dbcbc6a2798 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:19.301736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006f48f-8341-4644-9cc9-8dbcbc6a2798 None admin] PATH_INFO: `/v3/projects/9de92cf787844751a8af75c000b10cdf` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:19.302836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006f48f-8341-4644-9cc9-8dbcbc6a2798 None admin] RBAC: Authorizing `identity:get_project(project_id=9de92cf787844751a8af75c000b10cdf)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:19.304248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006f48f-8341-4644-9cc9-8dbcbc6a2798 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:19.305857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 582/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:12:19 2022] GET /identity/v3/projects/9de92cf787844751a8af75c000b10cdf => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:19.312037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8a832-78e1-4ad4-a1ec-be05bf2c5907 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:19.407780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8a832-78e1-4ad4-a1ec-be05bf2c5907 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:19.442499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c63df-c480-4185-b612-a41c63e709ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:19.443624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c63df-c480-4185-b612-a41c63e709ec None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:19.443898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c63df-c480-4185-b612-a41c63e709ec None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:19.444165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c63df-c480-4185-b612-a41c63e709ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:19.444873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c63df-c480-4185-b612-a41c63e709ec None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=9de92cf787844751a8af75c000b10cdf, user.id=80c806f8856b48d1ae2526cc99319cec) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:12:19.445181 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c63df-c480-4185-b612-a41c63e709ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:19.446628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c63df-c480-4185-b612-a41c63e709ec None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:19.452215 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 579/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:12:19 2022] GET /identity/v3/role_assignments?user.id=80c806f8856b48d1ae2526cc99319cec&scope.project.id=9de92cf787844751a8af75c000b10cdf&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:21.589473 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af0a8a-2afd-425d-8013-fbb4d957c26d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:21.590048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af0a8a-2afd-425d-8013-fbb4d957c26d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:21.590048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af0a8a-2afd-425d-8013-fbb4d957c26d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:21.591375 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 583/1162] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:12:21.596428 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac754884-7457-46bb-8d9c-de58ea6e9145 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:21.596807 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac754884-7457-46bb-8d9c-de58ea6e9145 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:21.596970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac754884-7457-46bb-8d9c-de58ea6e9145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:21.615897 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ac754884-7457-46bb-8d9c-de58ea6e9145 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:12:21.617054 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ac754884-7457-46bb-8d9c-de58ea6e9145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:12:21.641039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:21.681732 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 580/1163] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:12:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:12:21.945291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af0a8a-2afd-425d-8013-fbb4d957c26d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:22.045214 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af0a8a-2afd-425d-8013-fbb4d957c26d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:22.076856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031b4bc-5ed8-446c-a2a7-26b5bb842101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:22.077449 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031b4bc-5ed8-446c-a2a7-26b5bb842101 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:22.077751 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031b4bc-5ed8-446c-a2a7-26b5bb842101 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:22.078028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031b4bc-5ed8-446c-a2a7-26b5bb842101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:22.101904 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:22.143564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031b4bc-5ed8-446c-a2a7-26b5bb842101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:22.144994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031b4bc-5ed8-446c-a2a7-26b5bb842101 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:22.240310 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 584/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:12:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:12:22.246357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac754884-7457-46bb-8d9c-de58ea6e9145 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:22.340328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac754884-7457-46bb-8d9c-de58ea6e9145 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:22.373044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e9aed-8aed-400d-8e45-2a98786d42ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:22.373652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e9aed-8aed-400d-8e45-2a98786d42ad None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:22.373961 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e9aed-8aed-400d-8e45-2a98786d42ad None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:22.374229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e9aed-8aed-400d-8e45-2a98786d42ad None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:22.380773 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e9aed-8aed-400d-8e45-2a98786d42ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:22.382238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e9aed-8aed-400d-8e45-2a98786d42ad None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-780e9aed-8aed-400d-8e45-2a98786d42ad None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:12:22.393203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:12:22.394485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:12:22.395570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:12:22.395570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:12:22.395570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:12:22.395570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:12:22.395570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:12:22.395570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:12:22.395570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:12:22.395570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:12:22.395570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:12:22.395570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:12:22.395570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 27 17:12:22.395570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:12:22.395570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 27 17:12:22.395570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:12:22.395570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 581/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Sep 27 17:12:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:12:22.400445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031b4bc-5ed8-446c-a2a7-26b5bb842101 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:22.457506 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:22.502034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031b4bc-5ed8-446c-a2a7-26b5bb842101 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:22.534394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568f14f-c6d4-4758-a826-1f604130e6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:22.534982 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568f14f-c6d4-4758-a826-1f604130e6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:22.535260 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568f14f-c6d4-4758-a826-1f604130e6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:22.535533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568f14f-c6d4-4758-a826-1f604130e6b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:22.536671 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568f14f-c6d4-4758-a826-1f604130e6b1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:12:22.536978 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568f14f-c6d4-4758-a826-1f604130e6b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:22.538360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568f14f-c6d4-4758-a826-1f604130e6b1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:22.545247 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 585/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Sep 27 17:12:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:24.656864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42306ce-7bf1-40a7-aa80-9421cecae9d3 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:24.657411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42306ce-7bf1-40a7-aa80-9421cecae9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:24.657411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42306ce-7bf1-40a7-aa80-9421cecae9d3 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:24.658788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 582/1167] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:12:24.664394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265da1b6-e5c1-47a2-bd0e-c7fa6e5e715d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:24.664825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265da1b6-e5c1-47a2-bd0e-c7fa6e5e715d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:24.664929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265da1b6-e5c1-47a2-bd0e-c7fa6e5e715d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:24.683129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-265da1b6-e5c1-47a2-bd0e-c7fa6e5e715d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:12:24.684299 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-265da1b6-e5c1-47a2-bd0e-c7fa6e5e715d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:12:24.748906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 586/1168] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:12:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:12:25.015479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42306ce-7bf1-40a7-aa80-9421cecae9d3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:25.040451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:25.116103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42306ce-7bf1-40a7-aa80-9421cecae9d3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:25.148543 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad74154-c3cc-46f4-b899-fa8edf87cf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:25.149133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad74154-c3cc-46f4-b899-fa8edf87cf0f None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:25.149408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad74154-c3cc-46f4-b899-fa8edf87cf0f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:25.149674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad74154-c3cc-46f4-b899-fa8edf87cf0f None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:25.150426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad74154-c3cc-46f4-b899-fa8edf87cf0f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:25.151760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad74154-c3cc-46f4-b899-fa8edf87cf0f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:25.168374 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 583/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Tue Sep 27 17:12:25 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:12:27.326126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0a047-68e7-47b1-b398-5bd77717c59f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:27.326650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0a047-68e7-47b1-b398-5bd77717c59f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:27.326650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0a047-68e7-47b1-b398-5bd77717c59f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:27.327982 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 587/1170] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:12:27.334394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6405d-7cfd-4d73-907d-b2e4377dc0f8 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:27.334800 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6405d-7cfd-4d73-907d-b2e4377dc0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:27.334945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6405d-7cfd-4d73-907d-b2e4377dc0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:27.353175 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4be6405d-7cfd-4d73-907d-b2e4377dc0f8 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:12:27.354392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4be6405d-7cfd-4d73-907d-b2e4377dc0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:12:27.419753 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 584/1171] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:12:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:12:27.688341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0a047-68e7-47b1-b398-5bd77717c59f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:27.738148 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:27.789320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0a047-68e7-47b1-b398-5bd77717c59f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:27.822548 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a1056-4588-4874-826d-7c6f076cbbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:27.823159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a1056-4588-4874-826d-7c6f076cbbfe None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:27.823434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a1056-4588-4874-826d-7c6f076cbbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:27.823701 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a1056-4588-4874-826d-7c6f076cbbfe None admin] PATH_INFO: `/v3/domains/ef8ad974b435438abdacf5c4c017f6ff` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:27.834247 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a1056-4588-4874-826d-7c6f076cbbfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=ef8ad974b435438abdacf5c4c017f6ff)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:27.835675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a1056-4588-4874-826d-7c6f076cbbfe None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:27.837214 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 588/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Tue Sep 27 17:12:27 2022] GET /identity/v3/domains/ef8ad974b435438abdacf5c4c017f6ff => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:27.843118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6405d-7cfd-4d73-907d-b2e4377dc0f8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:27.857239 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:27.939475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6405d-7cfd-4d73-907d-b2e4377dc0f8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:27.972538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b44ab-e14d-491f-8a25-c67109891edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:27.973132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b44ab-e14d-491f-8a25-c67109891edd None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:27.974267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b44ab-e14d-491f-8a25-c67109891edd None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:27.974506 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b44ab-e14d-491f-8a25-c67109891edd None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:27.975151 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b44ab-e14d-491f-8a25-c67109891edd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:27.976554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b44ab-e14d-491f-8a25-c67109891edd None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:28.001647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 585/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Sep 27 17:12:27 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:12:30.320108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6eeb8c-c4b1-4587-99cf-b272d4800324 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:30.320641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6eeb8c-c4b1-4587-99cf-b272d4800324 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:30.320641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6eeb8c-c4b1-4587-99cf-b272d4800324 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:30.322007 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 589/1174] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:12:30.327428 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8fc43-2eb5-4971-8353-188148a4248d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:30.327837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8fc43-2eb5-4971-8353-188148a4248d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:30.327976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8fc43-2eb5-4971-8353-188148a4248d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:30.346534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4af8fc43-2eb5-4971-8353-188148a4248d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:12:30.347721 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4af8fc43-2eb5-4971-8353-188148a4248d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:12:30.403710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:30.413995 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 586/1175] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:12:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:12:30.682748 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6eeb8c-c4b1-4587-99cf-b272d4800324 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:30.781079 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6eeb8c-c4b1-4587-99cf-b272d4800324 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:30.789541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:30.813518 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73533d41-388d-4591-939d-d6987bf7e98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:30.814170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73533d41-388d-4591-939d-d6987bf7e98b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:30.814450 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73533d41-388d-4591-939d-d6987bf7e98b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:30.814724 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73533d41-388d-4591-939d-d6987bf7e98b None admin] PATH_INFO: `/v3/domains/ef8ad974b435438abdacf5c4c017f6ff` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:30.815858 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73533d41-388d-4591-939d-d6987bf7e98b None admin] RBAC: Authorizing `identity:get_domain(domain_id=ef8ad974b435438abdacf5c4c017f6ff)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:30.817831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73533d41-388d-4591-939d-d6987bf7e98b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:30.819364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 590/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Tue Sep 27 17:12:30 2022] GET /identity/v3/domains/ef8ad974b435438abdacf5c4c017f6ff => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:30.825059 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8fc43-2eb5-4971-8353-188148a4248d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:30.931676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8fc43-2eb5-4971-8353-188148a4248d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:30.964389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f61d9-b782-46ff-bdd6-f0c137c7acd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:30.964986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f61d9-b782-46ff-bdd6-f0c137c7acd2 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:30.965264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f61d9-b782-46ff-bdd6-f0c137c7acd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:30.965536 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f61d9-b782-46ff-bdd6-f0c137c7acd2 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:30.966212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f61d9-b782-46ff-bdd6-f0c137c7acd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:30.967620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f61d9-b782-46ff-bdd6-f0c137c7acd2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:30.987980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 587/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:12:30 2022] POST /identity/v3/users => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:12:33.147637 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0070bd-1c3e-4260-9e3f-d0659afb8a63 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:33.148203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0070bd-1c3e-4260-9e3f-d0659afb8a63 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:33.148203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0070bd-1c3e-4260-9e3f-d0659afb8a63 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:33.149503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 591/1178] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:12:33.154684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee639869-fdfb-4bce-9cc8-b48e1b9f0410 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:33.155051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee639869-fdfb-4bce-9cc8-b48e1b9f0410 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:33.155233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee639869-fdfb-4bce-9cc8-b48e1b9f0410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:33.173078 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ee639869-fdfb-4bce-9cc8-b48e1b9f0410 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:12:33.174291 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ee639869-fdfb-4bce-9cc8-b48e1b9f0410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:12:33.219226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:33.240045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 588/1179] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:12:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:12:33.510192 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0070bd-1c3e-4260-9e3f-d0659afb8a63 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:33.610300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0070bd-1c3e-4260-9e3f-d0659afb8a63 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:33.643018 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97754e1f-b5ba-47f8-86fb-1f0ab9d69cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:33.643626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97754e1f-b5ba-47f8-86fb-1f0ab9d69cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:33.643908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97754e1f-b5ba-47f8-86fb-1f0ab9d69cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:33.644182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97754e1f-b5ba-47f8-86fb-1f0ab9d69cd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:33.654526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97754e1f-b5ba-47f8-86fb-1f0ab9d69cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-97754e1f-b5ba-47f8-86fb-1f0ab9d69cd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:12:33.659271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:12:33.661138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:12:33.662426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:12:33.662426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:12:33.662426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:12:33.662426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:12:33.662426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:12:33.662426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:12:33.662426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:12:33.662426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:12:33.662426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:12:33.662426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:12:33.662426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:12:33.662426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:12:33.662426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 592/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:12:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:12:33.667882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee639869-fdfb-4bce-9cc8-b48e1b9f0410 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:33.760392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee639869-fdfb-4bce-9cc8-b48e1b9f0410 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:33.792781 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b4ddf-17b1-4d81-a43a-b78ff4a4e005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:33.793372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b4ddf-17b1-4d81-a43a-b78ff4a4e005 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:33.793647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b4ddf-17b1-4d81-a43a-b78ff4a4e005 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:33.793943 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b4ddf-17b1-4d81-a43a-b78ff4a4e005 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:33.794592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b4ddf-17b1-4d81-a43a-b78ff4a4e005 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:12:33.794892 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b4ddf-17b1-4d81-a43a-b78ff4a4e005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:33.796229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b4ddf-17b1-4d81-a43a-b78ff4a4e005 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:33.804637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 589/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:12:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:33.810449 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97754e1f-b5ba-47f8-86fb-1f0ab9d69cd8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:33.844316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:33.907772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97754e1f-b5ba-47f8-86fb-1f0ab9d69cd8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:33.940068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3b99f-1391-443b-9062-205621c9aae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:33.940677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3b99f-1391-443b-9062-205621c9aae9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:33.940955 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3b99f-1391-443b-9062-205621c9aae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:33.941222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3b99f-1391-443b-9062-205621c9aae9 None admin] PATH_INFO: `/v3/users/cb5b3148a5dc4be6ac55a57a5e727719` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:33.953878 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3b99f-1391-443b-9062-205621c9aae9 None admin] RBAC: Authorizing `identity:get_user(user_id=cb5b3148a5dc4be6ac55a57a5e727719)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:33.955555 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3b99f-1391-443b-9062-205621c9aae9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:33.957107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 593/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:12:33 2022] GET /identity/v3/users/cb5b3148a5dc4be6ac55a57a5e727719 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:33.963663 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b4ddf-17b1-4d81-a43a-b78ff4a4e005 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:34.005399 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:34.060301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b4ddf-17b1-4d81-a43a-b78ff4a4e005 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:34.092224 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e2ea3-572f-4fed-b470-0e07c7c4fe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:34.092816 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e2ea3-572f-4fed-b470-0e07c7c4fe8d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:34.093092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e2ea3-572f-4fed-b470-0e07c7c4fe8d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:34.093360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e2ea3-572f-4fed-b470-0e07c7c4fe8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:34.156887 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e2ea3-572f-4fed-b470-0e07c7c4fe8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:34.158341 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e2ea3-572f-4fed-b470-0e07c7c4fe8d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:34.198737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:34.253744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 590/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:12:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:12:34.259994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3b99f-1391-443b-9062-205621c9aae9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:34.351723 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:34.358393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3b99f-1391-443b-9062-205621c9aae9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:34.391642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31296eb6-159d-463b-a1e8-2c82f037b4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:34.392249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31296eb6-159d-463b-a1e8-2c82f037b4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:34.392523 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31296eb6-159d-463b-a1e8-2c82f037b4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:34.392788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31296eb6-159d-463b-a1e8-2c82f037b4d3 None admin] PATH_INFO: `/v3/projects/0c6570b9119c4acab26300193049d32d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:34.393899 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31296eb6-159d-463b-a1e8-2c82f037b4d3 None admin] RBAC: Authorizing `identity:get_project(project_id=0c6570b9119c4acab26300193049d32d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:34.395613 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31296eb6-159d-463b-a1e8-2c82f037b4d3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:34.397194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 594/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:12:34 2022] GET /identity/v3/projects/0c6570b9119c4acab26300193049d32d => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:34.403288 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e2ea3-572f-4fed-b470-0e07c7c4fe8d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:34.499113 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e2ea3-572f-4fed-b470-0e07c7c4fe8d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:34.530776 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730e164-8108-4712-8f32-6024fcc95b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:34.531355 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730e164-8108-4712-8f32-6024fcc95b34 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:34.531630 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730e164-8108-4712-8f32-6024fcc95b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:34.531897 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730e164-8108-4712-8f32-6024fcc95b34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:34.532597 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730e164-8108-4712-8f32-6024fcc95b34 None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=0c6570b9119c4acab26300193049d32d, user.id=cb5b3148a5dc4be6ac55a57a5e727719) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:12:34.532899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730e164-8108-4712-8f32-6024fcc95b34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:34.534337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730e164-8108-4712-8f32-6024fcc95b34 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:34.540320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 591/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:12:34 2022] GET /identity/v3/role_assignments?user.id=cb5b3148a5dc4be6ac55a57a5e727719&scope.project.id=0c6570b9119c4acab26300193049d32d&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:36.645973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e04951-e9ae-446b-bc74-470c644ea07c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:36.646497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e04951-e9ae-446b-bc74-470c644ea07c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:36.646497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e04951-e9ae-446b-bc74-470c644ea07c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:36.647843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 595/1186] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:12:36.652976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00d782-d770-45e7-b40d-1bfe52cbc7f9 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:36.653387 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00d782-d770-45e7-b40d-1bfe52cbc7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:36.653521 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00d782-d770-45e7-b40d-1bfe52cbc7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:36.666779 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:36.672100 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-1b00d782-d770-45e7-b40d-1bfe52cbc7f9 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:12:36.673279 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1b00d782-d770-45e7-b40d-1bfe52cbc7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:12:36.737553 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 592/1187] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:12:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:12:37.006407 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e04951-e9ae-446b-bc74-470c644ea07c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:37.105802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e04951-e9ae-446b-bc74-470c644ea07c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:37.138171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea4a95-bc68-4e45-8e2b-03a03fc44508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:37.138774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea4a95-bc68-4e45-8e2b-03a03fc44508 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:37.139049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea4a95-bc68-4e45-8e2b-03a03fc44508 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:37.139317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea4a95-bc68-4e45-8e2b-03a03fc44508 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:37.149743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea4a95-bc68-4e45-8e2b-03a03fc44508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-15ea4a95-bc68-4e45-8e2b-03a03fc44508 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:12:37.154378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:12:37.155424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:12:37.156280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:12:37.156280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:12:37.156280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:12:37.156280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:12:37.156280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:12:37.156280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:12:37.156280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:12:37.156280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:12:37.156280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:12:37.156280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:12:37.156280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:12:37.156280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:12:37.156280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 596/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:12:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:12:37.161931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00d782-d770-45e7-b40d-1bfe52cbc7f9 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:37.256226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00d782-d770-45e7-b40d-1bfe52cbc7f9 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:37.288781 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119baf2-7f46-4aeb-aede-147d5f3837e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:37.289314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119baf2-7f46-4aeb-aede-147d5f3837e1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:37.289586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119baf2-7f46-4aeb-aede-147d5f3837e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:37.289883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119baf2-7f46-4aeb-aede-147d5f3837e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:37.290527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119baf2-7f46-4aeb-aede-147d5f3837e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:12:37.290825 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119baf2-7f46-4aeb-aede-147d5f3837e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:37.292148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119baf2-7f46-4aeb-aede-147d5f3837e1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:37.294227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:37.300367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 593/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:12:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:37.306294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea4a95-bc68-4e45-8e2b-03a03fc44508 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:37.331069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:37.404283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea4a95-bc68-4e45-8e2b-03a03fc44508 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:37.436482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b5640-1a4c-4506-81ef-d79a0e0e7a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:37.437102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b5640-1a4c-4506-81ef-d79a0e0e7a2d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:37.437380 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b5640-1a4c-4506-81ef-d79a0e0e7a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:37.437651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b5640-1a4c-4506-81ef-d79a0e0e7a2d None admin] PATH_INFO: `/v3/users/cb5b3148a5dc4be6ac55a57a5e727719` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:37.438777 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b5640-1a4c-4506-81ef-d79a0e0e7a2d None admin] RBAC: Authorizing `identity:get_user(user_id=cb5b3148a5dc4be6ac55a57a5e727719)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:37.440202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b5640-1a4c-4506-81ef-d79a0e0e7a2d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:37.442435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 597/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:12:37 2022] GET /identity/v3/users/cb5b3148a5dc4be6ac55a57a5e727719 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:37.448343 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119baf2-7f46-4aeb-aede-147d5f3837e1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:37.544319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119baf2-7f46-4aeb-aede-147d5f3837e1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:37.576059 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01554f-eee7-4717-9ddf-b9b77f549fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:37.576672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01554f-eee7-4717-9ddf-b9b77f549fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:37.576949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01554f-eee7-4717-9ddf-b9b77f549fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:37.577218 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01554f-eee7-4717-9ddf-b9b77f549fa6 None admin] PATH_INFO: `/v3/projects/0c6570b9119c4acab26300193049d32d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:37.578315 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01554f-eee7-4717-9ddf-b9b77f549fa6 None admin] RBAC: Authorizing `identity:get_project(project_id=0c6570b9119c4acab26300193049d32d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:37.579980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01554f-eee7-4717-9ddf-b9b77f549fa6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:37.581554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 594/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:12:37 2022] GET /identity/v3/projects/0c6570b9119c4acab26300193049d32d => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:37.588241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b5640-1a4c-4506-81ef-d79a0e0e7a2d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:37.676416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:37.686254 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b5640-1a4c-4506-81ef-d79a0e0e7a2d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:37.719759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9d90a-9a46-4635-b3ac-dfd1747ec42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:37.720403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9d90a-9a46-4635-b3ac-dfd1747ec42f None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:37.720683 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9d90a-9a46-4635-b3ac-dfd1747ec42f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:37.720954 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9d90a-9a46-4635-b3ac-dfd1747ec42f None admin] PATH_INFO: `/v3/projects/0c6570b9119c4acab26300193049d32d/users/cb5b3148a5dc4be6ac55a57a5e727719/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:37.722856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9d90a-9a46-4635-b3ac-dfd1747ec42f None admin] RBAC: Authorizing `identity:create_grant(project_id=0c6570b9119c4acab26300193049d32d, user_id=cb5b3148a5dc4be6ac55a57a5e727719, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:37.724396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9d90a-9a46-4635-b3ac-dfd1747ec42f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:37.736780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 598/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:12:37 2022] PUT /identity/v3/projects/0c6570b9119c4acab26300193049d32d/users/cb5b3148a5dc4be6ac55a57a5e727719/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:12:39.850357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831e49-3fa8-43e9-b604-e4be16875d4f None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:39.850892 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831e49-3fa8-43e9-b604-e4be16875d4f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:39.850892 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831e49-3fa8-43e9-b604-e4be16875d4f None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:39.852226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 595/1193] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:12:39.857385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57860e35-3933-4e05-8ecd-8d04d49c84ef None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:39.857785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57860e35-3933-4e05-8ecd-8d04d49c84ef None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:39.857966 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57860e35-3933-4e05-8ecd-8d04d49c84ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:39.876159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-57860e35-3933-4e05-8ecd-8d04d49c84ef None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:12:39.877349 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-57860e35-3933-4e05-8ecd-8d04d49c84ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:12:39.942877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 599/1194] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:12:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:12:40.210639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05831e49-3fa8-43e9-b604-e4be16875d4f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:40.274704 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:40.309278 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05831e49-3fa8-43e9-b604-e4be16875d4f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:40.342055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1edeb-48af-48e6-bb39-5df48ed4ea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:40.342667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1edeb-48af-48e6-bb39-5df48ed4ea29 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:40.342944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1edeb-48af-48e6-bb39-5df48ed4ea29 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:40.343213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1edeb-48af-48e6-bb39-5df48ed4ea29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:40.353534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1edeb-48af-48e6-bb39-5df48ed4ea29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-b6c1edeb-48af-48e6-bb39-5df48ed4ea29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:12:40.358260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:12:40.359350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:12:40.360433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:12:40.360433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:12:40.360433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:12:40.360433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:12:40.360433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:12:40.360433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:12:40.360433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:12:40.360433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:12:40.360433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:12:40.360433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:12:40.360433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:12:40.360433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:12:40.360433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 596/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:12:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:12:40.365927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57860e35-3933-4e05-8ecd-8d04d49c84ef None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:40.443923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:40.463640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57860e35-3933-4e05-8ecd-8d04d49c84ef None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:40.496470 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7bffb-0e58-4da2-9141-6570c131744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:40.497059 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7bffb-0e58-4da2-9141-6570c131744c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:40.497333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7bffb-0e58-4da2-9141-6570c131744c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:40.497601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7bffb-0e58-4da2-9141-6570c131744c None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:40.498275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7bffb-0e58-4da2-9141-6570c131744c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:12:40.498572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7bffb-0e58-4da2-9141-6570c131744c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:40.499914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7bffb-0e58-4da2-9141-6570c131744c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:40.507742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 600/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:12:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:40.513728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1edeb-48af-48e6-bb39-5df48ed4ea29 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:40.609411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1edeb-48af-48e6-bb39-5df48ed4ea29 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:40.634101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:40.642703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c66c8-c0b5-4788-9bbd-78aedd823a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:40.643318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c66c8-c0b5-4788-9bbd-78aedd823a6f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:40.643594 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c66c8-c0b5-4788-9bbd-78aedd823a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:40.643864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c66c8-c0b5-4788-9bbd-78aedd823a6f None admin] PATH_INFO: `/v3/users/cb5b3148a5dc4be6ac55a57a5e727719` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:40.645497 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c66c8-c0b5-4788-9bbd-78aedd823a6f None admin] RBAC: Authorizing `identity:get_user(user_id=cb5b3148a5dc4be6ac55a57a5e727719)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:40.646936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c66c8-c0b5-4788-9bbd-78aedd823a6f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:40.648487 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 597/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Sep 27 17:12:40 2022] GET /identity/v3/users/cb5b3148a5dc4be6ac55a57a5e727719 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:40.654233 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7bffb-0e58-4da2-9141-6570c131744c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:40.750404 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7bffb-0e58-4da2-9141-6570c131744c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:40.782198 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5885d-2c7b-4286-b1ab-4c1e9d1a98ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:40.782785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5885d-2c7b-4286-b1ab-4c1e9d1a98ce None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:40.783061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5885d-2c7b-4286-b1ab-4c1e9d1a98ce None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:40.783327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5885d-2c7b-4286-b1ab-4c1e9d1a98ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:40.795559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:40.849502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5885d-2c7b-4286-b1ab-4c1e9d1a98ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:40.850953 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5885d-2c7b-4286-b1ab-4c1e9d1a98ce None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:40.943741 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 601/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:12:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:12:40.949974 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c66c8-c0b5-4788-9bbd-78aedd823a6f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:41.045443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c66c8-c0b5-4788-9bbd-78aedd823a6f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:41.077117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08594b-06fa-4c81-8ece-f354772d92cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:41.077751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08594b-06fa-4c81-8ece-f354772d92cb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:41.078031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08594b-06fa-4c81-8ece-f354772d92cb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:41.078302 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08594b-06fa-4c81-8ece-f354772d92cb None admin] PATH_INFO: `/v3/projects/0c6570b9119c4acab26300193049d32d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:41.079653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08594b-06fa-4c81-8ece-f354772d92cb None admin] RBAC: Authorizing `identity:get_project(project_id=0c6570b9119c4acab26300193049d32d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:41.081064 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08594b-06fa-4c81-8ece-f354772d92cb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:41.083217 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 598/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Sep 27 17:12:40 2022] GET /identity/v3/projects/0c6570b9119c4acab26300193049d32d => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:41.089449 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5885d-2c7b-4286-b1ab-4c1e9d1a98ce None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:12:41.130957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:41.185854 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5885d-2c7b-4286-b1ab-4c1e9d1a98ce None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:12:41.218805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463baf2-fc9b-4e98-a8ac-64aeb70a353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:12:41.219420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463baf2-fc9b-4e98-a8ac-64aeb70a353e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:12:41.219702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463baf2-fc9b-4e98-a8ac-64aeb70a353e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:12:41.219971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463baf2-fc9b-4e98-a8ac-64aeb70a353e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:12:41.220678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463baf2-fc9b-4e98-a8ac-64aeb70a353e None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=0c6570b9119c4acab26300193049d32d, user.id=cb5b3148a5dc4be6ac55a57a5e727719) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:12:41.220981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463baf2-fc9b-4e98-a8ac-64aeb70a353e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:12:41.223071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463baf2-fc9b-4e98-a8ac-64aeb70a353e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:12:41.228921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 602/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:12:41 2022] GET /identity/v3/role_assignments?user.id=cb5b3148a5dc4be6ac55a57a5e727719&scope.project.id=0c6570b9119c4acab26300193049d32d&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:12:51.073072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=69 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:12:51.226379 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=47 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:36.795213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf1dd8-5ff1-435c-99ee-a76b37f7bb46 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:36.795874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf1dd8-5ff1-435c-99ee-a76b37f7bb46 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:36.795874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf1dd8-5ff1-435c-99ee-a76b37f7bb46 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:36.798662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 599/1201] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:13:36.804793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cab845-5f29-4f1a-9e15-9b24b2910b6f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:36.805382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cab845-5f29-4f1a-9e15-9b24b2910b6f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:36.805382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cab845-5f29-4f1a-9e15-9b24b2910b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:36.825654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d6cab845-5f29-4f1a-9e15-9b24b2910b6f None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:13:36.827351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d6cab845-5f29-4f1a-9e15-9b24b2910b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:13:36.914430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 603/1202] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:13:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:13:37.195938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf1dd8-5ff1-435c-99ee-a76b37f7bb46 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:37.334362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf1dd8-5ff1-435c-99ee-a76b37f7bb46 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:37.388662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0934f-d522-4c9f-958d-e06aa1045ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:37.389338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0934f-d522-4c9f-958d-e06aa1045ebd None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:37.389609 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0934f-d522-4c9f-958d-e06aa1045ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:37.390004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0934f-d522-4c9f-958d-e06aa1045ebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:37.404436 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0934f-d522-4c9f-958d-e06aa1045ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:37.406755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0934f-d522-4c9f-958d-e06aa1045ebd None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-18f0934f-d522-4c9f-958d-e06aa1045ebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:13:37.428711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:37.429822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:13:37.430806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:13:37.430806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:37.430806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:13:37.430806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 600/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:37.435179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cab845-5f29-4f1a-9e15-9b24b2910b6f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:37.578080 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cab845-5f29-4f1a-9e15-9b24b2910b6f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:37.612528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:37.620360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca5e5f-339b-47ee-86a1-5af35c1e34bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:37.621009 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca5e5f-339b-47ee-86a1-5af35c1e34bf None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:37.621241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca5e5f-339b-47ee-86a1-5af35c1e34bf None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:37.621513 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca5e5f-339b-47ee-86a1-5af35c1e34bf None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:37.622180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca5e5f-339b-47ee-86a1-5af35c1e34bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:37.622492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca5e5f-339b-47ee-86a1-5af35c1e34bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:37.623855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca5e5f-339b-47ee-86a1-5af35c1e34bf None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:37.637127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 604/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:37.643587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0934f-d522-4c9f-958d-e06aa1045ebd None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:37.722841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:37.779417 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0934f-d522-4c9f-958d-e06aa1045ebd None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:37.824056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53695b7-9100-440c-b492-d45b91ecda78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:37.824893 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53695b7-9100-440c-b492-d45b91ecda78 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:37.824893 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53695b7-9100-440c-b492-d45b91ecda78 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:37.825224 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53695b7-9100-440c-b492-d45b91ecda78 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:37.825872 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53695b7-9100-440c-b492-d45b91ecda78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:37.827695 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53695b7-9100-440c-b492-d45b91ecda78 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:37.862019 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 601/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Sep 27 17:13:37 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:13:40.201263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4478726-631d-4238-8ab7-7e5339dcab0b None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:40.202674 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4478726-631d-4238-8ab7-7e5339dcab0b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:40.202674 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4478726-631d-4238-8ab7-7e5339dcab0b None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:40.204296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 605/1206] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:13:40.209909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c166fc8-8c70-4e3c-a83b-240a628c0014 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:40.210372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c166fc8-8c70-4e3c-a83b-240a628c0014 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:40.210478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c166fc8-8c70-4e3c-a83b-240a628c0014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:40.234342 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4c166fc8-8c70-4e3c-a83b-240a628c0014 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:13:40.235662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4c166fc8-8c70-4e3c-a83b-240a628c0014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:13:40.308667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 602/1207] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:13:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:13:40.610529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4478726-631d-4238-8ab7-7e5339dcab0b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:40.723159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4478726-631d-4238-8ab7-7e5339dcab0b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:40.762321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9701a9-93b9-443b-b646-826866146512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:40.763013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9701a9-93b9-443b-b646-826866146512 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:40.763323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9701a9-93b9-443b-b646-826866146512 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:40.763599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9701a9-93b9-443b-b646-826866146512 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:40.776774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9701a9-93b9-443b-b646-826866146512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-4b9701a9-93b9-443b-b646-826866146512 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:13:40.782205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:40.783443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:40.784512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:40.784512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:40.784512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:40.784512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:40.784512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:13:40.784512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:13:40.784512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:13:40.784512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:13:40.784512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:13:40.784512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:13:40.784512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:13:40.784512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:13:40.784512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 606/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:13:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:40.789505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c166fc8-8c70-4e3c-a83b-240a628c0014 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:40.834395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:40.907153 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c166fc8-8c70-4e3c-a83b-240a628c0014 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:40.947064 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ada6e-2c8a-488a-a87f-2379f9803169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:40.947831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ada6e-2c8a-488a-a87f-2379f9803169 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:40.948128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ada6e-2c8a-488a-a87f-2379f9803169 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:40.948357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ada6e-2c8a-488a-a87f-2379f9803169 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:40.949249 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ada6e-2c8a-488a-a87f-2379f9803169 None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:40.949555 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ada6e-2c8a-488a-a87f-2379f9803169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:40.950958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ada6e-2c8a-488a-a87f-2379f9803169 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:40.961169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 603/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:13:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:40.967208 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9701a9-93b9-443b-b646-826866146512 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:41.035981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:41.099262 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9701a9-93b9-443b-b646-826866146512 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:41.138386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f6faf-4da6-4ab6-94c2-699b7bedbbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:41.139130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f6faf-4da6-4ab6-94c2-699b7bedbbd1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:41.139405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f6faf-4da6-4ab6-94c2-699b7bedbbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:41.139722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f6faf-4da6-4ab6-94c2-699b7bedbbd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:41.152376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f6faf-4da6-4ab6-94c2-699b7bedbbd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:41.158057 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f6faf-4da6-4ab6-94c2-699b7bedbbd1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-d33f6faf-4da6-4ab6-94c2-699b7bedbbd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:13:41.177415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:41.179591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:13:41.180805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:13:41.180805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:41.180805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:13:41.180805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 607/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:41.185614 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ada6e-2c8a-488a-a87f-2379f9803169 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:41.314598 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:41.318025 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ada6e-2c8a-488a-a87f-2379f9803169 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:41.358244 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3451966-68ca-46c8-93c1-635bef80985a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:41.359504 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3451966-68ca-46c8-93c1-635bef80985a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:41.359790 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3451966-68ca-46c8-93c1-635bef80985a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:41.360065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3451966-68ca-46c8-93c1-635bef80985a None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:41.360707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3451966-68ca-46c8-93c1-635bef80985a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:41.361182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3451966-68ca-46c8-93c1-635bef80985a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:41.362377 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3451966-68ca-46c8-93c1-635bef80985a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:41.377823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 604/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:41.383895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f6faf-4da6-4ab6-94c2-699b7bedbbd1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:41.509336 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f6faf-4da6-4ab6-94c2-699b7bedbbd1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:41.511174 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:41.551094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9ae73-e2c5-4b67-bed9-aa70f73c1b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:41.552251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9ae73-e2c5-4b67-bed9-aa70f73c1b00 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:41.552484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9ae73-e2c5-4b67-bed9-aa70f73c1b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:41.552859 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9ae73-e2c5-4b67-bed9-aa70f73c1b00 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:41.561565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9ae73-e2c5-4b67-bed9-aa70f73c1b00 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:41.563382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9ae73-e2c5-4b67-bed9-aa70f73c1b00 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9fd9ae73-e2c5-4b67-bed9-aa70f73c1b00 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:13:41.578341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:41.579559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:41.580745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:41.580745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:41.580745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:13:41.580745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:13:41.580745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:13:41.580745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:13:41.580745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:13:41.580745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:13:41.580745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 17:13:41.580745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:13:41.581968 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 608/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:13:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:41.587985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3451966-68ca-46c8-93c1-635bef80985a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:41.691537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3451966-68ca-46c8-93c1-635bef80985a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:41.727866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e80d2-c8dd-4d76-9d84-6d5918883797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:41.728477 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e80d2-c8dd-4d76-9d84-6d5918883797 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:41.728797 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e80d2-c8dd-4d76-9d84-6d5918883797 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:41.729032 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e80d2-c8dd-4d76-9d84-6d5918883797 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:41.729776 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e80d2-c8dd-4d76-9d84-6d5918883797 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:41.730114 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e80d2-c8dd-4d76-9d84-6d5918883797 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:41.731532 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e80d2-c8dd-4d76-9d84-6d5918883797 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:41.759449 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9ae73-e2c5-4b67-bed9-aa70f73c1b00 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:41.760076 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 605/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Sep 27 17:13:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:41.887045 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9ae73-e2c5-4b67-bed9-aa70f73c1b00 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:41.924990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d29a38-9aab-4df5-afbb-c653b073367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:41.925679 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d29a38-9aab-4df5-afbb-c653b073367f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:41.926006 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d29a38-9aab-4df5-afbb-c653b073367f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:41.926278 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d29a38-9aab-4df5-afbb-c653b073367f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:41.958959 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:42.007885 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d29a38-9aab-4df5-afbb-c653b073367f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:42.009329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d29a38-9aab-4df5-afbb-c653b073367f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:42.135760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 609/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:13:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:13:42.142305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e80d2-c8dd-4d76-9d84-6d5918883797 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:42.162881 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:42.255711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e80d2-c8dd-4d76-9d84-6d5918883797 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:42.293230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1c4de-310b-45e0-b858-90462e80a6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:42.293890 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1c4de-310b-45e0-b858-90462e80a6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:42.294177 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1c4de-310b-45e0-b858-90462e80a6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:42.294448 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1c4de-310b-45e0-b858-90462e80a6c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:42.304962 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1c4de-310b-45e0-b858-90462e80a6c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:42.306438 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1c4de-310b-45e0-b858-90462e80a6c4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-f7d1c4de-310b-45e0-b858-90462e80a6c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:13:42.322480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:42.324056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:13:42.325139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:13:42.325139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:42.325139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:13:42.326563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 606/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:42.333084 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d29a38-9aab-4df5-afbb-c653b073367f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:42.401461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:42.450946 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d29a38-9aab-4df5-afbb-c653b073367f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:42.489399 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292e519-28f4-47c6-98d5-aeb1dd65ea7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:42.490324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292e519-28f4-47c6-98d5-aeb1dd65ea7f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:42.490827 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292e519-28f4-47c6-98d5-aeb1dd65ea7f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:42.491257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292e519-28f4-47c6-98d5-aeb1dd65ea7f None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:42.492111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292e519-28f4-47c6-98d5-aeb1dd65ea7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:42.492579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292e519-28f4-47c6-98d5-aeb1dd65ea7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:42.494212 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292e519-28f4-47c6-98d5-aeb1dd65ea7f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:42.512287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 610/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:13:42.513504 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1c4de-310b-45e0-b858-90462e80a6c4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:42.590461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:42.625018 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1c4de-310b-45e0-b858-90462e80a6c4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:42.662787 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1cf85-3e14-4307-9964-a82b95b1afde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:42.663473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1cf85-3e14-4307-9964-a82b95b1afde None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:42.663757 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1cf85-3e14-4307-9964-a82b95b1afde None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:42.664031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1cf85-3e14-4307-9964-a82b95b1afde None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:42.671438 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1cf85-3e14-4307-9964-a82b95b1afde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:42.672900 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1cf85-3e14-4307-9964-a82b95b1afde None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:42.684277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-24e1cf85-3e14-4307-9964-a82b95b1afde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:13:42.684277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:42.684277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:42.684277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:42.684277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:42.684277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:42.684277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:42.684277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:42.684277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:42.684277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:42.684277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:42.684277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:42.684277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:13:42.684277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:13:42.684277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:42.685391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:42.687062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:13:42.687062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:13:42.687062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:13:42.687062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:13:42.687062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:13:42.687062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:13:42.687062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:13:42.687062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:13:42.691311 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 607/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:13:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:42.692372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292e519-28f4-47c6-98d5-aeb1dd65ea7f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:42.812504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292e519-28f4-47c6-98d5-aeb1dd65ea7f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:42.836956 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:42.850322 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547bd7d-d9e3-43a9-93ed-ed851a418374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:42.850934 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547bd7d-d9e3-43a9-93ed-ed851a418374 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:42.851219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547bd7d-d9e3-43a9-93ed-ed851a418374 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:42.851497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547bd7d-d9e3-43a9-93ed-ed851a418374 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:42.852280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547bd7d-d9e3-43a9-93ed-ed851a418374 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:42.852628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547bd7d-d9e3-43a9-93ed-ed851a418374 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:42.854216 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547bd7d-d9e3-43a9-93ed-ed851a418374 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:42.868876 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 611/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:13:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:42.875014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1cf85-3e14-4307-9964-a82b95b1afde None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:42.989316 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1cf85-3e14-4307-9964-a82b95b1afde None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:43.021135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:43.027645 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e2fd3-df5c-4c4a-8281-d64b9094cce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:43.028261 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e2fd3-df5c-4c4a-8281-d64b9094cce8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:43.028540 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e2fd3-df5c-4c4a-8281-d64b9094cce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:43.028855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e2fd3-df5c-4c4a-8281-d64b9094cce8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:43.029770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e2fd3-df5c-4c4a-8281-d64b9094cce8 None admin] RBAC: Adding query filter params (role.id=f384ed869fc647d9b0187a4d586cd119, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=08cedb97f3c84faeaeef2b3209356842) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:43.030376 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e2fd3-df5c-4c4a-8281-d64b9094cce8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:43.031686 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e2fd3-df5c-4c4a-8281-d64b9094cce8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:43.037782 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 608/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:13:42 2022] GET /identity/v3/role_assignments?user.id=08cedb97f3c84faeaeef2b3209356842&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f384ed869fc647d9b0187a4d586cd119 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:45.402042 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925bbc5-45c6-4795-b198-9d8beccb5d99 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:45.402581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925bbc5-45c6-4795-b198-9d8beccb5d99 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:45.402804 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925bbc5-45c6-4795-b198-9d8beccb5d99 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:45.404330 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 612/1220] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:13:45.410057 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3174b1-d7ab-40e4-b76e-a88132272b2e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:45.410529 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3174b1-d7ab-40e4-b76e-a88132272b2e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:45.410673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3174b1-d7ab-40e4-b76e-a88132272b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:45.430067 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-eb3174b1-d7ab-40e4-b76e-a88132272b2e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:13:45.431338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-eb3174b1-d7ab-40e4-b76e-a88132272b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:13:45.500400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 609/1221] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:13:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:13:45.771957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925bbc5-45c6-4795-b198-9d8beccb5d99 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:45.884841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925bbc5-45c6-4795-b198-9d8beccb5d99 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:45.922252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76e95c-c6b5-48e9-b035-0c8b7785a87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:45.922951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76e95c-c6b5-48e9-b035-0c8b7785a87d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:45.923301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76e95c-c6b5-48e9-b035-0c8b7785a87d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:45.923599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76e95c-c6b5-48e9-b035-0c8b7785a87d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:45.936638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76e95c-c6b5-48e9-b035-0c8b7785a87d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ef76e95c-c6b5-48e9-b035-0c8b7785a87d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:13:45.941447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:45.942535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:45.943801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:45.943801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:45.943801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:45.943801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:45.943801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:13:45.943801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:13:45.943801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:13:45.943801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:13:45.943801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:13:45.943801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:13:45.943801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:13:45.943801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:13:45.943801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 613/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:13:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:45.949254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3174b1-d7ab-40e4-b76e-a88132272b2e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:46.057192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3174b1-d7ab-40e4-b76e-a88132272b2e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:46.087569 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:46.101370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7924-de38-4d20-b408-adb100e0ae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:46.102081 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7924-de38-4d20-b408-adb100e0ae56 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:46.102523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7924-de38-4d20-b408-adb100e0ae56 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:46.102726 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7924-de38-4d20-b408-adb100e0ae56 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:46.103478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a7924-de38-4d20-b408-adb100e0ae56 None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:46.103924 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a7924-de38-4d20-b408-adb100e0ae56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:46.105330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a7924-de38-4d20-b408-adb100e0ae56 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:46.115417 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 610/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:13:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:46.122220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76e95c-c6b5-48e9-b035-0c8b7785a87d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:46.171956 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:46.243595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76e95c-c6b5-48e9-b035-0c8b7785a87d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:46.283995 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d1547-baf6-44d1-8002-eb514dc56be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:46.284685 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d1547-baf6-44d1-8002-eb514dc56be2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:46.285011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d1547-baf6-44d1-8002-eb514dc56be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:46.285296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d1547-baf6-44d1-8002-eb514dc56be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:46.296835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d1547-baf6-44d1-8002-eb514dc56be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:46.298471 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d1547-baf6-44d1-8002-eb514dc56be2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-d38d1547-baf6-44d1-8002-eb514dc56be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:13:46.314544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:46.315736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:13:46.317015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:13:46.317015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:46.317015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:13:46.317229 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 614/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:46.321415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7924-de38-4d20-b408-adb100e0ae56 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:46.441599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7924-de38-4d20-b408-adb100e0ae56 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:46.479780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccd624-b3a1-4d81-aac1-487a7f891908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:46.480423 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccd624-b3a1-4d81-aac1-487a7f891908 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:46.480730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccd624-b3a1-4d81-aac1-487a7f891908 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:46.481079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccd624-b3a1-4d81-aac1-487a7f891908 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:46.481859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccd624-b3a1-4d81-aac1-487a7f891908 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:46.482292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccd624-b3a1-4d81-aac1-487a7f891908 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:46.484822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccd624-b3a1-4d81-aac1-487a7f891908 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:46.499279 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 611/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:46.505574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d1547-baf6-44d1-8002-eb514dc56be2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:46.610029 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:46.617293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d1547-baf6-44d1-8002-eb514dc56be2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:46.654427 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63d7d0-7266-40b7-9fa6-152cf7e4e71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:46.655884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63d7d0-7266-40b7-9fa6-152cf7e4e71d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:46.656219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63d7d0-7266-40b7-9fa6-152cf7e4e71d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:46.656544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63d7d0-7266-40b7-9fa6-152cf7e4e71d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:46.665423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63d7d0-7266-40b7-9fa6-152cf7e4e71d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:46.666890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63d7d0-7266-40b7-9fa6-152cf7e4e71d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-3f63d7d0-7266-40b7-9fa6-152cf7e4e71d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:13:46.680069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:46.681366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:46.682636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:46.682636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:46.682636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:13:46.682636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:13:46.682636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:13:46.682636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:13:46.682636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:13:46.682636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:13:46.682636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 17:13:46.682636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:13:46.682636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 615/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:13:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:46.688949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccd624-b3a1-4d81-aac1-487a7f891908 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:46.743174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:46.804852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccd624-b3a1-4d81-aac1-487a7f891908 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:46.847902 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b338909-c6d6-4fc5-b6f6-1ad0852b9112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:46.848679 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b338909-c6d6-4fc5-b6f6-1ad0852b9112 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:46.848987 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b338909-c6d6-4fc5-b6f6-1ad0852b9112 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:46.849256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b338909-c6d6-4fc5-b6f6-1ad0852b9112 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:46.850045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b338909-c6d6-4fc5-b6f6-1ad0852b9112 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:46.850349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b338909-c6d6-4fc5-b6f6-1ad0852b9112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:46.851795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b338909-c6d6-4fc5-b6f6-1ad0852b9112 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:46.871044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 612/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Sep 27 17:13:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:13:46.877795 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63d7d0-7266-40b7-9fa6-152cf7e4e71d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:46.997464 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63d7d0-7266-40b7-9fa6-152cf7e4e71d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:47.036866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5a907-f72e-48be-b91a-74a0fc55c5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:47.037496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5a907-f72e-48be-b91a-74a0fc55c5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:47.037801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5a907-f72e-48be-b91a-74a0fc55c5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:47.038071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5a907-f72e-48be-b91a-74a0fc55c5e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:47.049471 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5a907-f72e-48be-b91a-74a0fc55c5e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:47.051037 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5a907-f72e-48be-b91a-74a0fc55c5e6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-0bd5a907-f72e-48be-b91a-74a0fc55c5e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:13:47.066327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:47.067521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:13:47.068704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:13:47.068704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:47.068704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:13:47.068704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 616/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:47.073471 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b338909-c6d6-4fc5-b6f6-1ad0852b9112 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:47.188392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b338909-c6d6-4fc5-b6f6-1ad0852b9112 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:47.192028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:47.227293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814b964-caa4-465f-b2fe-f317b98e9ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:47.227909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814b964-caa4-465f-b2fe-f317b98e9ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:47.228193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814b964-caa4-465f-b2fe-f317b98e9ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:47.228465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814b964-caa4-465f-b2fe-f317b98e9ae5 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:47.229145 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814b964-caa4-465f-b2fe-f317b98e9ae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:47.229452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814b964-caa4-465f-b2fe-f317b98e9ae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:47.230927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814b964-caa4-465f-b2fe-f317b98e9ae5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:47.243574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 613/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:47.249890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5a907-f72e-48be-b91a-74a0fc55c5e6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:47.260252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:47.364182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5a907-f72e-48be-b91a-74a0fc55c5e6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:47.401136 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fb7f0-931c-4f13-8a8c-26a0f264e4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:47.401808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fb7f0-931c-4f13-8a8c-26a0f264e4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:47.402090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fb7f0-931c-4f13-8a8c-26a0f264e4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:47.402439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fb7f0-931c-4f13-8a8c-26a0f264e4b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:47.410719 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075fb7f0-931c-4f13-8a8c-26a0f264e4b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:47.412211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075fb7f0-931c-4f13-8a8c-26a0f264e4b0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:47.425002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-075fb7f0-931c-4f13-8a8c-26a0f264e4b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:13:47.425002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:47.425002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:47.425002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:47.425002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:47.425002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:47.425002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:47.425002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:47.425002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:47.425002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:47.425002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:47.425002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:47.425002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:13:47.425002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:13:47.425002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:47.426189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:47.427261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:13:47.427261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:13:47.427261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:13:47.427261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:13:47.427261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:13:47.427261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:13:47.427261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:13:47.427261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:13:47.427261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 617/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:13:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:47.433047 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814b964-caa4-465f-b2fe-f317b98e9ae5 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:47.549346 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814b964-caa4-465f-b2fe-f317b98e9ae5 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:47.583500 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652564f-06cf-4f64-aa3b-62bb2d05533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:47.584358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652564f-06cf-4f64-aa3b-62bb2d05533e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:47.584636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652564f-06cf-4f64-aa3b-62bb2d05533e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:47.584911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652564f-06cf-4f64-aa3b-62bb2d05533e None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:47.585600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652564f-06cf-4f64-aa3b-62bb2d05533e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:47.585935 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652564f-06cf-4f64-aa3b-62bb2d05533e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:47.587829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652564f-06cf-4f64-aa3b-62bb2d05533e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:47.601438 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 614/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:13:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:47.608735 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fb7f0-931c-4f13-8a8c-26a0f264e4b0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:47.680554 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:47.716502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fb7f0-931c-4f13-8a8c-26a0f264e4b0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:47.750320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320945f-c6ed-4622-842a-ae4af325d576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:47.751173 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320945f-c6ed-4622-842a-ae4af325d576 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:47.751459 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320945f-c6ed-4622-842a-ae4af325d576 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:47.751736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320945f-c6ed-4622-842a-ae4af325d576 None admin] PATH_INFO: `/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/08cedb97f3c84faeaeef2b3209356842/roles/f384ed869fc647d9b0187a4d586cd119` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:47.769537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320945f-c6ed-4622-842a-ae4af325d576 None admin] RBAC: Authorizing `identity:create_grant(project_id=20fffa15f44b4f519ac7e29a48a7a596, user_id=08cedb97f3c84faeaeef2b3209356842, role_id=f384ed869fc647d9b0187a4d586cd119)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:47.771479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320945f-c6ed-4622-842a-ae4af325d576 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:47.786881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 618/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:13:47 2022] PUT /identity/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/08cedb97f3c84faeaeef2b3209356842/roles/f384ed869fc647d9b0187a4d586cd119 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:13:50.102398 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee336ff5-bd4b-4360-83de-f5fe7ddcc6bd None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:50.103029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee336ff5-bd4b-4360-83de-f5fe7ddcc6bd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:50.103029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee336ff5-bd4b-4360-83de-f5fe7ddcc6bd None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:50.104942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 615/1233] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:13:50.112696 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71712c27-4e5b-4959-9bd4-c80d79e2038f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:50.113162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71712c27-4e5b-4959-9bd4-c80d79e2038f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:50.113272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71712c27-4e5b-4959-9bd4-c80d79e2038f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:50.134135 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-71712c27-4e5b-4959-9bd4-c80d79e2038f None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:13:50.135409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-71712c27-4e5b-4959-9bd4-c80d79e2038f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:13:50.214678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 619/1234] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:13:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:13:50.493562 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee336ff5-bd4b-4360-83de-f5fe7ddcc6bd None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:50.520861 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:50.608159 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee336ff5-bd4b-4360-83de-f5fe7ddcc6bd None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:50.645633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72199b4d-b035-4ba9-93da-550b187f89e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:50.646382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72199b4d-b035-4ba9-93da-550b187f89e3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:50.646707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72199b4d-b035-4ba9-93da-550b187f89e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:50.646990 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72199b4d-b035-4ba9-93da-550b187f89e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:50.658695 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72199b4d-b035-4ba9-93da-550b187f89e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-72199b4d-b035-4ba9-93da-550b187f89e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:13:50.663723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:50.664772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:50.665710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:50.665710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:50.665710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:50.665710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:50.665710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:13:50.665710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:13:50.665710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:13:50.665710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:13:50.665710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:13:50.665710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:13:50.665710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 27 17:13:50.665710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:13:50.665710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 616/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Sep 27 17:13:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:13:50.673441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71712c27-4e5b-4959-9bd4-c80d79e2038f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:50.725049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:50.787143 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71712c27-4e5b-4959-9bd4-c80d79e2038f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:50.830256 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f7a64-ae93-4beb-b281-524a6e78f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:50.830908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f7a64-ae93-4beb-b281-524a6e78f54e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:50.831226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f7a64-ae93-4beb-b281-524a6e78f54e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:50.831505 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f7a64-ae93-4beb-b281-524a6e78f54e None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:50.832245 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f7a64-ae93-4beb-b281-524a6e78f54e None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:50.832594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f7a64-ae93-4beb-b281-524a6e78f54e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:50.834104 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f7a64-ae93-4beb-b281-524a6e78f54e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:50.843468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 620/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Sep 27 17:13:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:50.850074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72199b4d-b035-4ba9-93da-550b187f89e3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:50.942032 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:50.962129 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72199b4d-b035-4ba9-93da-550b187f89e3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:51.000610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e58de3-bb97-4de7-b1f4-f2d98bf2c86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:51.001328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e58de3-bb97-4de7-b1f4-f2d98bf2c86d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:51.001613 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e58de3-bb97-4de7-b1f4-f2d98bf2c86d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:51.001916 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e58de3-bb97-4de7-b1f4-f2d98bf2c86d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:51.013065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e58de3-bb97-4de7-b1f4-f2d98bf2c86d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:51.015070 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e58de3-bb97-4de7-b1f4-f2d98bf2c86d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-d6e58de3-bb97-4de7-b1f4-f2d98bf2c86d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:13:51.029931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:51.030952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:13:51.031859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:13:51.031859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:51.031859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:13:51.031859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 617/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:51.037337 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f7a64-ae93-4beb-b281-524a6e78f54e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:51.155796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f7a64-ae93-4beb-b281-524a6e78f54e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:51.166166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:51.204795 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130bfcd-a195-4e95-955c-9e65077c70f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:51.205435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130bfcd-a195-4e95-955c-9e65077c70f9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:51.205740 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130bfcd-a195-4e95-955c-9e65077c70f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:51.206034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130bfcd-a195-4e95-955c-9e65077c70f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:51.206717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130bfcd-a195-4e95-955c-9e65077c70f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:51.207027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130bfcd-a195-4e95-955c-9e65077c70f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:51.208586 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130bfcd-a195-4e95-955c-9e65077c70f9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:51.222163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 621/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:51.228595 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e58de3-bb97-4de7-b1f4-f2d98bf2c86d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:51.334627 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e58de3-bb97-4de7-b1f4-f2d98bf2c86d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:51.375054 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc781a-0179-4933-b8e5-fa80972347d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:51.375702 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc781a-0179-4933-b8e5-fa80972347d3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:51.375973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc781a-0179-4933-b8e5-fa80972347d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:51.376246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc781a-0179-4933-b8e5-fa80972347d3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:51.379292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:51.384866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc781a-0179-4933-b8e5-fa80972347d3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:51.386351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc781a-0179-4933-b8e5-fa80972347d3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-0cdc781a-0179-4933-b8e5-fa80972347d3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:13:51.400045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:51.402357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:51.404922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:51.404922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:51.404922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:13:51.404922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:13:51.404922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:13:51.404922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:13:51.404922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:13:51.404922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:13:51.404922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 17:13:51.404922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:13:51.404922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 618/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:13:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:51.408869 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130bfcd-a195-4e95-955c-9e65077c70f9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:51.531123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130bfcd-a195-4e95-955c-9e65077c70f9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:51.569268 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46642682-1533-4251-bfd9-9c80e6aa06e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:51.569904 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46642682-1533-4251-bfd9-9c80e6aa06e7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:51.570179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46642682-1533-4251-bfd9-9c80e6aa06e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:51.570445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46642682-1533-4251-bfd9-9c80e6aa06e7 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:51.571163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46642682-1533-4251-bfd9-9c80e6aa06e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:51.571465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46642682-1533-4251-bfd9-9c80e6aa06e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:51.572921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46642682-1533-4251-bfd9-9c80e6aa06e7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:51.594627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 622/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Sep 27 17:13:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:51.600564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc781a-0179-4933-b8e5-fa80972347d3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:51.709171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc781a-0179-4933-b8e5-fa80972347d3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:51.754753 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9a6aa-399c-4af5-83bc-0931446589b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:51.755470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9a6aa-399c-4af5-83bc-0931446589b6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:51.755831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9a6aa-399c-4af5-83bc-0931446589b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:51.756163 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9a6aa-399c-4af5-83bc-0931446589b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:51.821450 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:51.829739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9a6aa-399c-4af5-83bc-0931446589b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:51.831185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9a6aa-399c-4af5-83bc-0931446589b6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:51.936256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 619/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:13:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:13:51.942256 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46642682-1533-4251-bfd9-9c80e6aa06e7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:51.971798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:52.053230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46642682-1533-4251-bfd9-9c80e6aa06e7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:52.091525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d5cf8-669e-4391-9d04-2a409bb1b457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:52.092235 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d5cf8-669e-4391-9d04-2a409bb1b457 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:52.092545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d5cf8-669e-4391-9d04-2a409bb1b457 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:52.092875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d5cf8-669e-4391-9d04-2a409bb1b457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:52.105552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d5cf8-669e-4391-9d04-2a409bb1b457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:52.107078 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d5cf8-669e-4391-9d04-2a409bb1b457 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-370d5cf8-669e-4391-9d04-2a409bb1b457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:13:52.122927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:52.124838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:13:52.126063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:13:52.126063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:52.126063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:13:52.126063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 623/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:52.130833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9a6aa-399c-4af5-83bc-0931446589b6 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:52.231991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:52.239453 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9a6aa-399c-4af5-83bc-0931446589b6 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:52.275707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73167a28-822d-475f-ad89-3fc1204871af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:52.276313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73167a28-822d-475f-ad89-3fc1204871af None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:52.276586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73167a28-822d-475f-ad89-3fc1204871af None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:52.276934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73167a28-822d-475f-ad89-3fc1204871af None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:52.277500 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73167a28-822d-475f-ad89-3fc1204871af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:52.277861 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73167a28-822d-475f-ad89-3fc1204871af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:52.279135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73167a28-822d-475f-ad89-3fc1204871af None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:52.291354 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 620/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:52.298820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d5cf8-669e-4391-9d04-2a409bb1b457 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:52.386577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:52.410675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d5cf8-669e-4391-9d04-2a409bb1b457 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:52.446937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ad436-87b3-4b05-99a7-6ca0794d503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:52.447570 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ad436-87b3-4b05-99a7-6ca0794d503e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:52.447900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ad436-87b3-4b05-99a7-6ca0794d503e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:52.448171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ad436-87b3-4b05-99a7-6ca0794d503e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:52.455208 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ad436-87b3-4b05-99a7-6ca0794d503e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:52.456663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ad436-87b3-4b05-99a7-6ca0794d503e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:52.468628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c25ad436-87b3-4b05-99a7-6ca0794d503e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:13:52.468628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:52.468628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:52.468628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:52.468628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:52.468628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:52.468628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:52.468628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:52.468628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:52.468628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:52.468628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:52.468628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:52.468628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:13:52.468628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:13:52.468628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:52.469660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:52.471215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:13:52.471215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:13:52.471215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:13:52.471215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:13:52.471215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:13:52.471215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:13:52.471215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:13:52.471215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:13:52.471215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 624/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:52.475858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73167a28-822d-475f-ad89-3fc1204871af None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:52.580356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73167a28-822d-475f-ad89-3fc1204871af None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:52.616309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405650f-4d54-4f6c-bd69-461f6f0c0ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:52.617040 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405650f-4d54-4f6c-bd69-461f6f0c0ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:52.617318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405650f-4d54-4f6c-bd69-461f6f0c0ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:52.617592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405650f-4d54-4f6c-bd69-461f6f0c0ed9 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:52.618337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405650f-4d54-4f6c-bd69-461f6f0c0ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:52.618643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405650f-4d54-4f6c-bd69-461f6f0c0ed9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:52.620057 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405650f-4d54-4f6c-bd69-461f6f0c0ed9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:52.632805 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 621/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:13:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:52.640295 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ad436-87b3-4b05-99a7-6ca0794d503e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:52.752351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ad436-87b3-4b05-99a7-6ca0794d503e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:52.786429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09c440-11c6-4fda-b0eb-43eed499825b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:52.787045 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09c440-11c6-4fda-b0eb-43eed499825b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:52.787327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09c440-11c6-4fda-b0eb-43eed499825b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:52.787600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09c440-11c6-4fda-b0eb-43eed499825b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:52.788323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09c440-11c6-4fda-b0eb-43eed499825b None admin] RBAC: Adding query filter params (role.id=f384ed869fc647d9b0187a4d586cd119, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=08cedb97f3c84faeaeef2b3209356842) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:52.788636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09c440-11c6-4fda-b0eb-43eed499825b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:52.790100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09c440-11c6-4fda-b0eb-43eed499825b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:52.809720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 625/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:13:52 2022] GET /identity/v3/role_assignments?user.id=08cedb97f3c84faeaeef2b3209356842&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=f384ed869fc647d9b0187a4d586cd119 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:55.344879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471883e-6546-4d0c-903b-472fdcc53e90 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:55.345455 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471883e-6546-4d0c-903b-472fdcc53e90 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:55.345455 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471883e-6546-4d0c-903b-472fdcc53e90 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:55.346791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 622/1247] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:13:55.352156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e330fe7-402d-481e-b652-9b4d8d43011f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:55.352601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e330fe7-402d-481e-b652-9b4d8d43011f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:55.352690 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e330fe7-402d-481e-b652-9b4d8d43011f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:55.360025 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:55.373381 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2e330fe7-402d-481e-b652-9b4d8d43011f None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:13:55.374671 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2e330fe7-402d-481e-b652-9b4d8d43011f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:13:55.457458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 626/1248] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:13:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:13:55.732406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471883e-6546-4d0c-903b-472fdcc53e90 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:55.750619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:55.835337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471883e-6546-4d0c-903b-472fdcc53e90 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:55.869301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90b50e-8ae9-42d0-8a2e-34ce486f13d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:55.869964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90b50e-8ae9-42d0-8a2e-34ce486f13d7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:55.870245 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90b50e-8ae9-42d0-8a2e-34ce486f13d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:55.870518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90b50e-8ae9-42d0-8a2e-34ce486f13d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:55.881306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90b50e-8ae9-42d0-8a2e-34ce486f13d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-ec90b50e-8ae9-42d0-8a2e-34ce486f13d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:13:55.886178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:55.887189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:55.888332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:55.888332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:55.888332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:55.888332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:55.888332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:13:55.888332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:13:55.888332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:13:55.888332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:13:55.888332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:13:55.888332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:13:55.888332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:13:55.888332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:13:55.888332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 623/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:13:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:55.894312 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e330fe7-402d-481e-b652-9b4d8d43011f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:56.005651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e330fe7-402d-481e-b652-9b4d8d43011f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:56.043291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:56.050341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac4e0f-2f9c-4db3-860b-e78a6845cd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:56.051099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac4e0f-2f9c-4db3-860b-e78a6845cd03 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:56.051364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac4e0f-2f9c-4db3-860b-e78a6845cd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:56.051678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac4e0f-2f9c-4db3-860b-e78a6845cd03 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:56.052446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac4e0f-2f9c-4db3-860b-e78a6845cd03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:56.052757 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac4e0f-2f9c-4db3-860b-e78a6845cd03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:56.054158 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac4e0f-2f9c-4db3-860b-e78a6845cd03 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:56.063273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 627/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:13:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:56.069461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90b50e-8ae9-42d0-8a2e-34ce486f13d7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:56.165500 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:56.191719 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90b50e-8ae9-42d0-8a2e-34ce486f13d7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:56.229375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701bcaf-c03d-406c-8e00-ad2d261c09a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:56.230072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701bcaf-c03d-406c-8e00-ad2d261c09a1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:56.230353 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701bcaf-c03d-406c-8e00-ad2d261c09a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:56.230626 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701bcaf-c03d-406c-8e00-ad2d261c09a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:56.241260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701bcaf-c03d-406c-8e00-ad2d261c09a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:56.242851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701bcaf-c03d-406c-8e00-ad2d261c09a1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-3701bcaf-c03d-406c-8e00-ad2d261c09a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:13:56.258936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:56.260107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:13:56.261200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:13:56.261200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:56.261200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:13:56.261200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 624/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 17:13:56.267015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac4e0f-2f9c-4db3-860b-e78a6845cd03 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:56.374633 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac4e0f-2f9c-4db3-860b-e78a6845cd03 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:56.409445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550f00f-03ca-4fbb-a96d-03ab5ce6fe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:56.410082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550f00f-03ca-4fbb-a96d-03ab5ce6fe4b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:56.410363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550f00f-03ca-4fbb-a96d-03ab5ce6fe4b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:56.410635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550f00f-03ca-4fbb-a96d-03ab5ce6fe4b None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:56.411275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550f00f-03ca-4fbb-a96d-03ab5ce6fe4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:56.411581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550f00f-03ca-4fbb-a96d-03ab5ce6fe4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:56.412971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550f00f-03ca-4fbb-a96d-03ab5ce6fe4b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:56.425490 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 628/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:56.431828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701bcaf-c03d-406c-8e00-ad2d261c09a1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:56.541231 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701bcaf-c03d-406c-8e00-ad2d261c09a1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:56.569131 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:56.579278 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998106d1-4234-4184-bca4-75c979a3e187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:56.579948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998106d1-4234-4184-bca4-75c979a3e187 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:56.580239 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998106d1-4234-4184-bca4-75c979a3e187 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:56.580552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998106d1-4234-4184-bca4-75c979a3e187 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:56.590571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998106d1-4234-4184-bca4-75c979a3e187 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:56.592750 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998106d1-4234-4184-bca4-75c979a3e187 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-998106d1-4234-4184-bca4-75c979a3e187 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:13:56.609336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:56.610552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:56.611694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:56.611694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:56.611694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:13:56.611694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:13:56.611694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:13:56.611694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:13:56.611694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:13:56.611694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:13:56.611694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 17:13:56.611694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:13:56.617835 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 625/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:13:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:56.618002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550f00f-03ca-4fbb-a96d-03ab5ce6fe4b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:56.680368 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:56.734147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550f00f-03ca-4fbb-a96d-03ab5ce6fe4b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:56.776455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105f7be-391c-448c-bc4c-f4da508ae8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:56.777154 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105f7be-391c-448c-bc4c-f4da508ae8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:56.777456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105f7be-391c-448c-bc4c-f4da508ae8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:56.777786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105f7be-391c-448c-bc4c-f4da508ae8d4 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:56.778547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105f7be-391c-448c-bc4c-f4da508ae8d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:56.778868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105f7be-391c-448c-bc4c-f4da508ae8d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:56.780924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105f7be-391c-448c-bc4c-f4da508ae8d4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:56.806032 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 629/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Sep 27 17:13:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:56.806986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998106d1-4234-4184-bca4-75c979a3e187 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:56.911987 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998106d1-4234-4184-bca4-75c979a3e187 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:56.947556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d772ac-62d8-409b-b042-a9bdd2824237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:56.948178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d772ac-62d8-409b-b042-a9bdd2824237 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:56.948455 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d772ac-62d8-409b-b042-a9bdd2824237 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:56.948724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d772ac-62d8-409b-b042-a9bdd2824237 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:57.006925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:57.020483 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d772ac-62d8-409b-b042-a9bdd2824237 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:57.022004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d772ac-62d8-409b-b042-a9bdd2824237 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:57.131035 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 626/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:13:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:13:57.137124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105f7be-391c-448c-bc4c-f4da508ae8d4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:57.240561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105f7be-391c-448c-bc4c-f4da508ae8d4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:57.254529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:57.278215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321aec8-ca15-42a1-b499-71db5e069228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:57.278873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321aec8-ca15-42a1-b499-71db5e069228 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:57.279152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321aec8-ca15-42a1-b499-71db5e069228 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:57.279425 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321aec8-ca15-42a1-b499-71db5e069228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:57.289374 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321aec8-ca15-42a1-b499-71db5e069228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:57.290856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321aec8-ca15-42a1-b499-71db5e069228 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1321aec8-ca15-42a1-b499-71db5e069228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:13:57.306028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:57.307197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:13:57.308299 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:13:57.308299 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:13:57.308299 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:13:57.308299 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 630/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:57.316301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d772ac-62d8-409b-b042-a9bdd2824237 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:57.407599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:57.423539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d772ac-62d8-409b-b042-a9bdd2824237 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:57.459544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae7c4a-226c-4232-817c-f01e29d358c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:57.460154 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae7c4a-226c-4232-817c-f01e29d358c9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:57.460422 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae7c4a-226c-4232-817c-f01e29d358c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:57.460691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae7c4a-226c-4232-817c-f01e29d358c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:57.461327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae7c4a-226c-4232-817c-f01e29d358c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:57.461629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae7c4a-226c-4232-817c-f01e29d358c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:57.463002 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae7c4a-226c-4232-817c-f01e29d358c9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:57.474727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 627/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:57.480570 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321aec8-ca15-42a1-b499-71db5e069228 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:57.579501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321aec8-ca15-42a1-b499-71db5e069228 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:57.611895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c597c-24ba-405e-a457-c63e41f93fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:57.612511 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c597c-24ba-405e-a457-c63e41f93fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:57.612792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c597c-24ba-405e-a457-c63e41f93fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:57.613068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c597c-24ba-405e-a457-c63e41f93fc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:57.619484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c597c-24ba-405e-a457-c63e41f93fc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:57.620944 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c597c-24ba-405e-a457-c63e41f93fc9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:57.633441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-046c597c-24ba-405e-a457-c63e41f93fc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:13:57.633441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:13:57.633441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:13:57.633441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:13:57.633441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:13:57.633441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:13:57.633441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:13:57.633441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:13:57.633441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:13:57.633441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:13:57.633441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:13:57.633441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:13:57.633441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:13:57.633441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:13:57.633441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:13:57.634501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:13:57.635662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:13:57.635662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:13:57.635662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:13:57.635662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:13:57.635662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:13:57.635662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:13:57.635662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:13:57.635662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:13:57.635662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 631/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:13:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:13:57.641237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae7c4a-226c-4232-817c-f01e29d358c9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:57.736745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae7c4a-226c-4232-817c-f01e29d358c9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:57.769549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430095df-d553-47a8-9fb5-3cd1fe87a66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:57.770188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430095df-d553-47a8-9fb5-3cd1fe87a66a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:57.770463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430095df-d553-47a8-9fb5-3cd1fe87a66a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:57.770730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430095df-d553-47a8-9fb5-3cd1fe87a66a None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:57.771412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430095df-d553-47a8-9fb5-3cd1fe87a66a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:57.771713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430095df-d553-47a8-9fb5-3cd1fe87a66a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:57.773116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430095df-d553-47a8-9fb5-3cd1fe87a66a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:57.784864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 628/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:13:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:13:57.790802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c597c-24ba-405e-a457-c63e41f93fc9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:13:57.816438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:13:57.890489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c597c-24ba-405e-a457-c63e41f93fc9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:13:57.923316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c714f-cd3b-4429-8125-156acb6c2977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:13:57.923904 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c714f-cd3b-4429-8125-156acb6c2977 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:13:57.924185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c714f-cd3b-4429-8125-156acb6c2977 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:13:57.924459 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c714f-cd3b-4429-8125-156acb6c2977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:13:57.925173 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c714f-cd3b-4429-8125-156acb6c2977 None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=08cedb97f3c84faeaeef2b3209356842) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:13:57.925480 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c714f-cd3b-4429-8125-156acb6c2977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:13:57.926932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c714f-cd3b-4429-8125-156acb6c2977 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:13:57.932163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 632/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:13:57 2022] GET /identity/v3/role_assignments?user.id=08cedb97f3c84faeaeef2b3209356842&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:00.037473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e44fd0-ca88-408f-8406-405236e32034 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:00.038039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e44fd0-ca88-408f-8406-405236e32034 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:00.038039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e44fd0-ca88-408f-8406-405236e32034 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:00.039373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 629/1261] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:14:00.045048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc8c14-9729-404c-b5d1-a011294786d4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:00.045503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc8c14-9729-404c-b5d1-a011294786d4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:00.045596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc8c14-9729-404c-b5d1-a011294786d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:00.063465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-24bc8c14-9729-404c-b5d1-a011294786d4 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:14:00.064645 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-24bc8c14-9729-404c-b5d1-a011294786d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:14:00.135090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 633/1262] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:14:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:14:00.402436 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e44fd0-ca88-408f-8406-405236e32034 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:00.413240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:00.504494 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e44fd0-ca88-408f-8406-405236e32034 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:00.537774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc38a7-55f9-4dbd-98ec-579f7452df93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:00.538389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc38a7-55f9-4dbd-98ec-579f7452df93 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:00.538668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc38a7-55f9-4dbd-98ec-579f7452df93 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:00.538940 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc38a7-55f9-4dbd-98ec-579f7452df93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:00.548783 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc38a7-55f9-4dbd-98ec-579f7452df93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-2bcc38a7-55f9-4dbd-98ec-579f7452df93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:14:00.553470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:14:00.554572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:14:00.555427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:14:00.555427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:14:00.555427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:14:00.555427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:14:00.555427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:14:00.555427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:14:00.555427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:14:00.555427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:14:00.555427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:14:00.555427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:14:00.555427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:14:00.555427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:14:00.555427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 630/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:14:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:14:00.561186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc8c14-9729-404c-b5d1-a011294786d4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:00.579695 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:00.657327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc8c14-9729-404c-b5d1-a011294786d4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:00.690241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c963d-2ab7-426f-800e-91715b474ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:00.690830 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c963d-2ab7-426f-800e-91715b474ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:00.691105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c963d-2ab7-426f-800e-91715b474ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:00.691374 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c963d-2ab7-426f-800e-91715b474ac3 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:00.692019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c963d-2ab7-426f-800e-91715b474ac3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:00.692317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c963d-2ab7-426f-800e-91715b474ac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:00.693666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c963d-2ab7-426f-800e-91715b474ac3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:00.702347 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 634/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:14:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:00.708187 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc38a7-55f9-4dbd-98ec-579f7452df93 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:00.771630 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:00.802644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc38a7-55f9-4dbd-98ec-579f7452df93 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:00.835776 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e90e7-7466-4b44-96b2-c0585c0cb526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:00.836387 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e90e7-7466-4b44-96b2-c0585c0cb526 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:00.836660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e90e7-7466-4b44-96b2-c0585c0cb526 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:00.836925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e90e7-7466-4b44-96b2-c0585c0cb526 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:00.846431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e90e7-7466-4b44-96b2-c0585c0cb526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:00.847891 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e90e7-7466-4b44-96b2-c0585c0cb526 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-f62e90e7-7466-4b44-96b2-c0585c0cb526 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:14:00.862262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:14:00.863366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:14:00.864305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:14:00.864305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:14:00.864305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:14:00.864305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 631/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:14:00.869065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c963d-2ab7-426f-800e-91715b474ac3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:00.947776 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:00.966529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c963d-2ab7-426f-800e-91715b474ac3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:00.999242 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cf149-0010-410a-980b-27d3c37c7167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:00.999833 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cf149-0010-410a-980b-27d3c37c7167 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:01.000112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cf149-0010-410a-980b-27d3c37c7167 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:01.000385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cf149-0010-410a-980b-27d3c37c7167 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:01.001063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cf149-0010-410a-980b-27d3c37c7167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:01.001368 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cf149-0010-410a-980b-27d3c37c7167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:01.002803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cf149-0010-410a-980b-27d3c37c7167 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:01.014801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 635/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:01.020560 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e90e7-7466-4b44-96b2-c0585c0cb526 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:01.128657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e90e7-7466-4b44-96b2-c0585c0cb526 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:01.147689 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:01.161983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d9f8b-ff36-4549-a6a7-8719cd43ec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:01.162606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d9f8b-ff36-4549-a6a7-8719cd43ec86 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:01.162885 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d9f8b-ff36-4549-a6a7-8719cd43ec86 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:01.163157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d9f8b-ff36-4549-a6a7-8719cd43ec86 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:01.170958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d9f8b-ff36-4549-a6a7-8719cd43ec86 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:01.172375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d9f8b-ff36-4549-a6a7-8719cd43ec86 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-517d9f8b-ff36-4549-a6a7-8719cd43ec86 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:14:01.183069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:14:01.184194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:14:01.186052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:14:01.186052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:14:01.186052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:14:01.186052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:14:01.186052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:14:01.186052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:14:01.186052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:14:01.186052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:14:01.186052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 17:14:01.186052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:14:01.186052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 632/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:14:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:14:01.190666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cf149-0010-410a-980b-27d3c37c7167 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:01.287490 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cf149-0010-410a-980b-27d3c37c7167 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:01.320569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff91c0-9e03-49ac-909a-bb0b49a1f546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:01.321159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff91c0-9e03-49ac-909a-bb0b49a1f546 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:01.321438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff91c0-9e03-49ac-909a-bb0b49a1f546 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:01.321732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff91c0-9e03-49ac-909a-bb0b49a1f546 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:01.322448 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff91c0-9e03-49ac-909a-bb0b49a1f546 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:01.322754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff91c0-9e03-49ac-909a-bb0b49a1f546 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:01.324165 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff91c0-9e03-49ac-909a-bb0b49a1f546 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:01.332817 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:01.342955 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 636/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Sep 27 17:14:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:01.348820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d9f8b-ff36-4549-a6a7-8719cd43ec86 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:01.449289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d9f8b-ff36-4549-a6a7-8719cd43ec86 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:01.482979 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b889bf-b663-41e8-a0cc-f503c1321428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:01.483598 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b889bf-b663-41e8-a0cc-f503c1321428 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:01.483873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b889bf-b663-41e8-a0cc-f503c1321428 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:01.484139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b889bf-b663-41e8-a0cc-f503c1321428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:01.494296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b889bf-b663-41e8-a0cc-f503c1321428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:01.495717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b889bf-b663-41e8-a0cc-f503c1321428 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-34b889bf-b663-41e8-a0cc-f503c1321428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:14:01.509099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:14:01.510238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:14:01.511352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:14:01.511352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:14:01.511352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:14:01.511352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 633/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:14:01.516337 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff91c0-9e03-49ac-909a-bb0b49a1f546 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:01.613309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff91c0-9e03-49ac-909a-bb0b49a1f546 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:01.645992 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5196d4-c055-4b28-976d-893b898a01b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:01.646586 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5196d4-c055-4b28-976d-893b898a01b5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:01.646864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5196d4-c055-4b28-976d-893b898a01b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:01.647134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5196d4-c055-4b28-976d-893b898a01b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:01.647760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5196d4-c055-4b28-976d-893b898a01b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:01.648060 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5196d4-c055-4b28-976d-893b898a01b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:01.649415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5196d4-c055-4b28-976d-893b898a01b5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:01.660669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 637/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:01.666327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b889bf-b663-41e8-a0cc-f503c1321428 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:01.696742 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:01.762724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b889bf-b663-41e8-a0cc-f503c1321428 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:01.795535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114aee4-6205-49ec-b59a-3e8af25d2744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:01.796144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114aee4-6205-49ec-b59a-3e8af25d2744 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:01.796419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114aee4-6205-49ec-b59a-3e8af25d2744 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:01.796685 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114aee4-6205-49ec-b59a-3e8af25d2744 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:01.802957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114aee4-6205-49ec-b59a-3e8af25d2744 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:01.804365 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114aee4-6205-49ec-b59a-3e8af25d2744 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:01.815141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-2114aee4-6205-49ec-b59a-3e8af25d2744 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:14:01.815141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:01.815141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:14:01.815141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:14:01.815141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:14:01.815141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:14:01.815141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:14:01.815141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:14:01.815141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:14:01.815141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:14:01.815141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:14:01.815141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:14:01.815141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:14:01.815141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:14:01.815141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:14:01.816197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:14:01.817911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:14:01.817911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:14:01.817911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:14:01.817911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:14:01.817911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:14:01.817911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:14:01.817911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:14:01.817911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:14:01.817911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 634/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:14:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:14:01.822100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5196d4-c055-4b28-976d-893b898a01b5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:01.879089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:01.933144 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5196d4-c055-4b28-976d-893b898a01b5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:01.966968 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33800716-782d-4db5-8c52-37077a535ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:01.967559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33800716-782d-4db5-8c52-37077a535ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:01.967835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33800716-782d-4db5-8c52-37077a535ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:01.968107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33800716-782d-4db5-8c52-37077a535ff9 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:01.968787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33800716-782d-4db5-8c52-37077a535ff9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:01.969093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33800716-782d-4db5-8c52-37077a535ff9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:01.970539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33800716-782d-4db5-8c52-37077a535ff9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:01.982017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 638/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:14:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:01.988065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114aee4-6205-49ec-b59a-3e8af25d2744 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:02.074709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:02.085943 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114aee4-6205-49ec-b59a-3e8af25d2744 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:02.120017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dbd0f-5894-4eeb-91d6-e92840b07e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:02.120663 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dbd0f-5894-4eeb-91d6-e92840b07e1d None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:02.120937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dbd0f-5894-4eeb-91d6-e92840b07e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:02.121205 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dbd0f-5894-4eeb-91d6-e92840b07e1d None admin] PATH_INFO: `/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/08cedb97f3c84faeaeef2b3209356842/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:02.123864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dbd0f-5894-4eeb-91d6-e92840b07e1d None admin] RBAC: Authorizing `identity:create_grant(project_id=20fffa15f44b4f519ac7e29a48a7a596, user_id=08cedb97f3c84faeaeef2b3209356842, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:02.125260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dbd0f-5894-4eeb-91d6-e92840b07e1d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:02.136997 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 635/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Sep 27 17:14:01 2022] PUT /identity/v3/projects/20fffa15f44b4f519ac7e29a48a7a596/users/08cedb97f3c84faeaeef2b3209356842/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:14:04.278910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03160e-2c43-4543-8455-7d60fb6c2566 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:04.279466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03160e-2c43-4543-8455-7d60fb6c2566 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:04.279614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03160e-2c43-4543-8455-7d60fb6c2566 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:04.280956 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 639/1274] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:14:04.286257 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e3ed6-4fe8-430c-a545-5e1fe6626a93 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:04.286648 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e3ed6-4fe8-430c-a545-5e1fe6626a93 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:04.286806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e3ed6-4fe8-430c-a545-5e1fe6626a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:04.305402 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-360e3ed6-4fe8-430c-a545-5e1fe6626a93 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:14:04.306610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-360e3ed6-4fe8-430c-a545-5e1fe6626a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:14:04.369586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 636/1275] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:14:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:14:04.637463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03160e-2c43-4543-8455-7d60fb6c2566 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:04.736987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03160e-2c43-4543-8455-7d60fb6c2566 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:04.753619 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:04.770532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2bbff-fa85-4117-a7f6-347b19191bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:04.771142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2bbff-fa85-4117-a7f6-347b19191bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:04.771417 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2bbff-fa85-4117-a7f6-347b19191bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:04.771686 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2bbff-fa85-4117-a7f6-347b19191bd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:04.781751 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2bbff-fa85-4117-a7f6-347b19191bd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-fbb2bbff-fa85-4117-a7f6-347b19191bd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 27 17:14:04.786416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:14:04.787527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:14:04.788577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:14:04.788577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:14:04.788577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:14:04.788577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:14:04.788577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 27 17:14:04.788577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 27 17:14:04.788577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 27 17:14:04.788577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 27 17:14:04.788577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 27 17:14:04.788577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 27 17:14:04.788577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 17:14:04.788577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:14:04.788577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 640/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Sep 27 17:14:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:14:04.793351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e3ed6-4fe8-430c-a545-5e1fe6626a93 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:04.870916 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:04.889791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e3ed6-4fe8-430c-a545-5e1fe6626a93 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:04.922274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b65ff-c06b-42b5-b264-229aadc3a596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:04.922867 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b65ff-c06b-42b5-b264-229aadc3a596 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:04.923146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b65ff-c06b-42b5-b264-229aadc3a596 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:04.923417 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b65ff-c06b-42b5-b264-229aadc3a596 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:04.924078 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b65ff-c06b-42b5-b264-229aadc3a596 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:04.924381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b65ff-c06b-42b5-b264-229aadc3a596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:04.925745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b65ff-c06b-42b5-b264-229aadc3a596 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:04.933410 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 637/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Sep 27 17:14:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:04.939830 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2bbff-fa85-4117-a7f6-347b19191bd8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:05.036147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2bbff-fa85-4117-a7f6-347b19191bd8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:05.068714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab757e-040a-4725-abe4-8deabb098c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:05.069319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab757e-040a-4725-abe4-8deabb098c20 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:05.069598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab757e-040a-4725-abe4-8deabb098c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:05.069896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab757e-040a-4725-abe4-8deabb098c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:05.080495 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab757e-040a-4725-abe4-8deabb098c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:05.081966 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab757e-040a-4725-abe4-8deabb098c20 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-a7ab757e-040a-4725-abe4-8deabb098c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:14:05.098544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:14:05.099973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:14:05.100864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:14:05.100864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:14:05.100864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:14:05.100864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 641/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:14:05.106977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b65ff-c06b-42b5-b264-229aadc3a596 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:05.204997 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b65ff-c06b-42b5-b264-229aadc3a596 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:05.237556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e6bc6-c7ff-45d6-9aaa-08243fb94f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:05.238176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e6bc6-c7ff-45d6-9aaa-08243fb94f38 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:05.238456 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e6bc6-c7ff-45d6-9aaa-08243fb94f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:05.238725 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e6bc6-c7ff-45d6-9aaa-08243fb94f38 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:05.239351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e6bc6-c7ff-45d6-9aaa-08243fb94f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:05.239653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e6bc6-c7ff-45d6-9aaa-08243fb94f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:05.240997 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e6bc6-c7ff-45d6-9aaa-08243fb94f38 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:05.252302 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 638/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:05.258033 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab757e-040a-4725-abe4-8deabb098c20 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:05.288881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:05.355541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab757e-040a-4725-abe4-8deabb098c20 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:05.388475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3403fd-090b-443d-9f48-becbbd476dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:05.389168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3403fd-090b-443d-9f48-becbbd476dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:05.389446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3403fd-090b-443d-9f48-becbbd476dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:05.389742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3403fd-090b-443d-9f48-becbbd476dd6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:05.396891 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3403fd-090b-443d-9f48-becbbd476dd6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:05.398343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3403fd-090b-443d-9f48-becbbd476dd6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-eb3403fd-090b-443d-9f48-becbbd476dd6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 27 17:14:05.409864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:14:05.410975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:14:05.412270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:14:05.412270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:14:05.412270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 27 17:14:05.412270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 27 17:14:05.412270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 27 17:14:05.412270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 27 17:14:05.412270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 27 17:14:05.412270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 27 17:14:05.412270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 27 17:14:05.412270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:14:05.412270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 642/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:14:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:14:05.416733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e6bc6-c7ff-45d6-9aaa-08243fb94f38 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:05.420766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:05.516560 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e6bc6-c7ff-45d6-9aaa-08243fb94f38 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:05.549225 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642deca-886f-4e31-ac50-972dab49a58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:05.549849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642deca-886f-4e31-ac50-972dab49a58b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:05.550125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642deca-886f-4e31-ac50-972dab49a58b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:05.550392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642deca-886f-4e31-ac50-972dab49a58b None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:05.551105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642deca-886f-4e31-ac50-972dab49a58b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:05.551406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642deca-886f-4e31-ac50-972dab49a58b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:05.552810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642deca-886f-4e31-ac50-972dab49a58b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:05.568714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 639/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Sep 27 17:14:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:05.574563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3403fd-090b-443d-9f48-becbbd476dd6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:05.662766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:05.672445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3403fd-090b-443d-9f48-becbbd476dd6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:05.705195 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc15345-e082-4324-883d-e3743d9ab687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:05.705805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc15345-e082-4324-883d-e3743d9ab687 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:05.706086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc15345-e082-4324-883d-e3743d9ab687 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:05.706356 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc15345-e082-4324-883d-e3743d9ab687 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:05.772083 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc15345-e082-4324-883d-e3743d9ab687 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:05.773446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc15345-e082-4324-883d-e3743d9ab687 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:05.858631 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:05.868254 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 643/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Sep 27 17:14:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 17:14:05.874548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642deca-886f-4e31-ac50-972dab49a58b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:05.932881 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:05.972869 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642deca-886f-4e31-ac50-972dab49a58b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:06.005697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9c3fb-b5ef-42db-b698-f384b386ef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:06.006328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9c3fb-b5ef-42db-b698-f384b386ef70 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:06.006604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9c3fb-b5ef-42db-b698-f384b386ef70 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:06.006873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9c3fb-b5ef-42db-b698-f384b386ef70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:06.017338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9c3fb-b5ef-42db-b698-f384b386ef70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:06.018787 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9c3fb-b5ef-42db-b698-f384b386ef70 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-b4a9c3fb-b5ef-42db-b698-f384b386ef70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 27 17:14:06.032985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:14:06.034222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 27 17:14:06.035433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 27 17:14:06.035433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 17:14:06.035433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:14:06.035433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 640/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:14:06.039664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc15345-e082-4324-883d-e3743d9ab687 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:06.139927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc15345-e082-4324-883d-e3743d9ab687 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:06.173081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427ed88-45de-4d15-ad94-1493af6cdba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:06.173670 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427ed88-45de-4d15-ad94-1493af6cdba3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:06.173977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427ed88-45de-4d15-ad94-1493af6cdba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:06.174255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427ed88-45de-4d15-ad94-1493af6cdba3 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:06.174881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427ed88-45de-4d15-ad94-1493af6cdba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:06.175181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427ed88-45de-4d15-ad94-1493af6cdba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:06.176532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427ed88-45de-4d15-ad94-1493af6cdba3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:06.187819 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 644/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Sep 27 17:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:06.193471 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9c3fb-b5ef-42db-b698-f384b386ef70 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:06.288541 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9c3fb-b5ef-42db-b698-f384b386ef70 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:06.301668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:06.321564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08289c-dd7e-4725-b89f-2422a0483746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:06.322211 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08289c-dd7e-4725-b89f-2422a0483746 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:06.322489 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08289c-dd7e-4725-b89f-2422a0483746 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:06.322761 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08289c-dd7e-4725-b89f-2422a0483746 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:06.329677 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08289c-dd7e-4725-b89f-2422a0483746 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:06.331171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08289c-dd7e-4725-b89f-2422a0483746 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:06.342141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-5d08289c-dd7e-4725-b89f-2422a0483746 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:14:06.342141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:06.342141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:14:06.342141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:14:06.342141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:14:06.342141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:14:06.342141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:14:06.342141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:14:06.342141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:14:06.342141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:14:06.342141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:14:06.342141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:14:06.342141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 27 17:14:06.342141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 27 17:14:06.342141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:14:06.343161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:14:06.344110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 27 17:14:06.344110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 27 17:14:06.344110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 27 17:14:06.344110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 27 17:14:06.344110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 27 17:14:06.344110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 27 17:14:06.344110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 17:14:06.344110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 27 17:14:06.344110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 641/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Sep 27 17:14:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:14:06.348957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427ed88-45de-4d15-ad94-1493af6cdba3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:06.397727 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:06.446906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427ed88-45de-4d15-ad94-1493af6cdba3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:06.480560 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbf176-5bd5-400d-86d1-e2d30830cbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:06.481150 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbf176-5bd5-400d-86d1-e2d30830cbed None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:06.481607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbf176-5bd5-400d-86d1-e2d30830cbed None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:06.482129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbf176-5bd5-400d-86d1-e2d30830cbed None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:06.482814 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbf176-5bd5-400d-86d1-e2d30830cbed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:06.483119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbf176-5bd5-400d-86d1-e2d30830cbed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:06.484525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbf176-5bd5-400d-86d1-e2d30830cbed None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:06.496520 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 645/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Sep 27 17:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:06.503104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08289c-dd7e-4725-b89f-2422a0483746 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:06.599362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08289c-dd7e-4725-b89f-2422a0483746 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:06.631430 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d320b2-cfaa-4036-b8a6-aaea33f14a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:06.632020 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d320b2-cfaa-4036-b8a6-aaea33f14a81 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:06.632301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d320b2-cfaa-4036-b8a6-aaea33f14a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:06.632573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d320b2-cfaa-4036-b8a6-aaea33f14a81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:06.633287 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d320b2-cfaa-4036-b8a6-aaea33f14a81 None admin] RBAC: Adding query filter params (role.id=61601bc0091b4afbb0dab99f8aef9d78, scope.project.id=20fffa15f44b4f519ac7e29a48a7a596, user.id=08cedb97f3c84faeaeef2b3209356842) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:06.633599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d320b2-cfaa-4036-b8a6-aaea33f14a81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:06.635042 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d320b2-cfaa-4036-b8a6-aaea33f14a81 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:06.640602 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 642/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Sep 27 17:14:06 2022] GET /identity/v3/role_assignments?user.id=08cedb97f3c84faeaeef2b3209356842&scope.project.id=20fffa15f44b4f519ac7e29a48a7a596&role.id=61601bc0091b4afbb0dab99f8aef9d78 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:08.786406 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f676b-a26e-4077-a600-01f2f1ad20b2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:08.786935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f676b-a26e-4077-a600-01f2f1ad20b2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:08.786935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f676b-a26e-4077-a600-01f2f1ad20b2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:08.788250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 646/1288] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:14:08.793334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d096e5-c2c7-4422-977f-5e8e912d2eb9 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:08.794028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d096e5-c2c7-4422-977f-5e8e912d2eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:08.794028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d096e5-c2c7-4422-977f-5e8e912d2eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:08.812224 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-c7d096e5-c2c7-4422-977f-5e8e912d2eb9 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:14:08.813397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c7d096e5-c2c7-4422-977f-5e8e912d2eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:14:08.842371 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:08.878894 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 643/1289] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:14:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:14:09.152785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f676b-a26e-4077-a600-01f2f1ad20b2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:09.264017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f676b-a26e-4077-a600-01f2f1ad20b2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:09.274279 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:09.297782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dfb9a-a38e-4b3d-961e-c13a16f39166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:09.298401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dfb9a-a38e-4b3d-961e-c13a16f39166 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:09.298685 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dfb9a-a38e-4b3d-961e-c13a16f39166 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:09.298950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dfb9a-a38e-4b3d-961e-c13a16f39166 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:09.299519 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2dfb9a-a38e-4b3d-961e-c13a16f39166 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:09.300884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2dfb9a-a38e-4b3d-961e-c13a16f39166 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1b2dfb9a-a38e-4b3d-961e-c13a16f39166 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:14:09.310087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:14:09.311362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:14:09.312265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:14:09.312265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:14:09.312265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:14:09.312265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:14:09.312265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:14:09.312265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:14:09.312265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:14:09.312265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:14:09.312265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:14:09.312265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:14:09.312265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:14:09.312265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:14:09.312265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 17:14:09.312265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:14:09.312265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 647/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Sep 27 17:14:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:14:09.317193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d096e5-c2c7-4422-977f-5e8e912d2eb9 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:09.411859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d096e5-c2c7-4422-977f-5e8e912d2eb9 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:09.446455 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b245b9-76c3-47f5-a42c-80c220d64af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:09.447055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b245b9-76c3-47f5-a42c-80c220d64af2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:09.447334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b245b9-76c3-47f5-a42c-80c220d64af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:09.447606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b245b9-76c3-47f5-a42c-80c220d64af2 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:09.448224 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b245b9-76c3-47f5-a42c-80c220d64af2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:09.448527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b245b9-76c3-47f5-a42c-80c220d64af2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:09.450205 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b245b9-76c3-47f5-a42c-80c220d64af2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:09.455126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 644/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Sep 27 17:14:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:09.460875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dfb9a-a38e-4b3d-961e-c13a16f39166 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:09.566148 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dfb9a-a38e-4b3d-961e-c13a16f39166 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:09.598917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949912e1-6654-4735-9230-3c1ca163368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:09.599538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949912e1-6654-4735-9230-3c1ca163368c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:09.599818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949912e1-6654-4735-9230-3c1ca163368c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:09.600092 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949912e1-6654-4735-9230-3c1ca163368c None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:09.600709 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949912e1-6654-4735-9230-3c1ca163368c None admin] RBAC: Adding query filter params (type=placement) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:09.601010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949912e1-6654-4735-9230-3c1ca163368c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:09.602395 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949912e1-6654-4735-9230-3c1ca163368c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:09.607236 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 648/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Sep 27 17:14:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:11.736452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3a097-23c3-4e8e-8d72-70b3e2f5d9b2 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:11.736970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3a097-23c3-4e8e-8d72-70b3e2f5d9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:11.736970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3a097-23c3-4e8e-8d72-70b3e2f5d9b2 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:11.738466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 645/1293] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:14:11.743572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd5e1b-7ff4-4054-9fcc-796a41017dbe None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:11.743937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd5e1b-7ff4-4054-9fcc-796a41017dbe None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:11.744126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd5e1b-7ff4-4054-9fcc-796a41017dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:11.761993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f6bd5e1b-7ff4-4054-9fcc-796a41017dbe None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:14:11.763393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f6bd5e1b-7ff4-4054-9fcc-796a41017dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:14:11.792300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:11.828937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 649/1294] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:14:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:14:12.095006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3a097-23c3-4e8e-8d72-70b3e2f5d9b2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:12.125321 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:12.191964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3a097-23c3-4e8e-8d72-70b3e2f5d9b2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:12.224998 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9a8b5-0f29-4de2-964e-fbd2c97ecace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:12.225587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9a8b5-0f29-4de2-964e-fbd2c97ecace None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:12.225888 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9a8b5-0f29-4de2-964e-fbd2c97ecace None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:12.226160 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9a8b5-0f29-4de2-964e-fbd2c97ecace None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:12.226795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9a8b5-0f29-4de2-964e-fbd2c97ecace None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:12.228128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9a8b5-0f29-4de2-964e-fbd2c97ecace None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:12.241406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 646/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Sep 27 17:14:12 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:14:14.393317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020113f-3ed4-4ae1-bd2e-dff60fa6a4f9 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:14.393910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020113f-3ed4-4ae1-bd2e-dff60fa6a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:14.393910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020113f-3ed4-4ae1-bd2e-dff60fa6a4f9 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:14.395209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 650/1296] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:14:14.400450 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7abb7-c18e-45ec-9982-0d6912fe34ea None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:14.400868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7abb7-c18e-45ec-9982-0d6912fe34ea None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:14.401002 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7abb7-c18e-45ec-9982-0d6912fe34ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:14.420115 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f8a7abb7-c18e-45ec-9982-0d6912fe34ea None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:14:14.421296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f8a7abb7-c18e-45ec-9982-0d6912fe34ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:14:14.492248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 647/1297] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:14:14 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 17:14:14.761339 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020113f-3ed4-4ae1-bd2e-dff60fa6a4f9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:14.859748 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020113f-3ed4-4ae1-bd2e-dff60fa6a4f9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:14.891603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbb9d3-4764-4e9a-8604-06b4fd6ea1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:14.892208 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbb9d3-4764-4e9a-8604-06b4fd6ea1fd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:14.892482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbb9d3-4764-4e9a-8604-06b4fd6ea1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:14.892746 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbb9d3-4764-4e9a-8604-06b4fd6ea1fd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:14.893311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbb9d3-4764-4e9a-8604-06b4fd6ea1fd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:14.894701 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbbb9d3-4764-4e9a-8604-06b4fd6ea1fd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ecbbb9d3-4764-4e9a-8604-06b4fd6ea1fd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:14:14.904161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:14:14.905334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:14:14.906434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:14:14.906434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:14:14.906434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:14:14.906434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:14:14.906434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:14:14.906434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:14:14.906434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:14:14.906434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:14:14.906434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:14:14.906434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:14:14.906434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:14:14.906434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:14:14.906434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 17:14:14.906434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:14:14.906434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 651/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Sep 27 17:14:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:14:14.911056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7abb7-c18e-45ec-9982-0d6912fe34ea None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:14.929332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:15.013045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7abb7-c18e-45ec-9982-0d6912fe34ea None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:15.046354 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a84af-2e73-472e-8147-abd93b0e57e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:15.046953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a84af-2e73-472e-8147-abd93b0e57e8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:15.047229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a84af-2e73-472e-8147-abd93b0e57e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:15.047501 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a84af-2e73-472e-8147-abd93b0e57e8 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:15.048118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a84af-2e73-472e-8147-abd93b0e57e8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:15.048416 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a84af-2e73-472e-8147-abd93b0e57e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:15.049792 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a84af-2e73-472e-8147-abd93b0e57e8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:15.054693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 648/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Sep 27 17:14:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:15.060907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbb9d3-4764-4e9a-8604-06b4fd6ea1fd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:15.096215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:15.168418 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbb9d3-4764-4e9a-8604-06b4fd6ea1fd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:15.201160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f5980-9935-4d36-b660-79b7541f46a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:15.201775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f5980-9935-4d36-b660-79b7541f46a5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:15.202056 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f5980-9935-4d36-b660-79b7541f46a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:15.202327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f5980-9935-4d36-b660-79b7541f46a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:15.203018 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f5980-9935-4d36-b660-79b7541f46a5 None admin] RBAC: Adding query filter params (interface=public, service_id=135bc2c75036449db417e1d057686f5b, region_id=RegionOne) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:15.203325 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f5980-9935-4d36-b660-79b7541f46a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:15.204681 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f5980-9935-4d36-b660-79b7541f46a5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:15.209492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 652/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Sep 27 17:14:15 2022] GET /identity/v3/endpoints?service_id=135bc2c75036449db417e1d057686f5b&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:14:15.215778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a84af-2e73-472e-8147-abd93b0e57e8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:15.294525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:15.312376 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a84af-2e73-472e-8147-abd93b0e57e8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:15.345027 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b2e9b-815e-454f-bd2b-beecc868e8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:15.345617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b2e9b-815e-454f-bd2b-beecc868e8df None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:15.345926 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b2e9b-815e-454f-bd2b-beecc868e8df None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:15.346200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b2e9b-815e-454f-bd2b-beecc868e8df None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:15.346791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b2e9b-815e-454f-bd2b-beecc868e8df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:15.348133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b2e9b-815e-454f-bd2b-beecc868e8df None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:15.354687 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 649/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Sep 27 17:14:15 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:14:17.469334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f53eb-b445-4363-877d-204791920925 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:17.469858 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f53eb-b445-4363-877d-204791920925 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:17.469956 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f53eb-b445-4363-877d-204791920925 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:17.471239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 653/1302] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:14:17.476557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a58b-3559-4a7f-8c93-c7f410d70605 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:17.476978 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a58b-3559-4a7f-8c93-c7f410d70605 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:17.477116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a58b-3559-4a7f-8c93-c7f410d70605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:17.495431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-fce9a58b-3559-4a7f-8c93-c7f410d70605 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:14:17.497345 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fce9a58b-3559-4a7f-8c93-c7f410d70605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:14:17.565123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 650/1303] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:14:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 17:14:17.835919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f53eb-b445-4363-877d-204791920925 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:17.930136 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:17.938036 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f53eb-b445-4363-877d-204791920925 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:17.971192 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402e378-54b6-44a7-a26f-d6e2d6beee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:17.971804 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402e378-54b6-44a7-a26f-d6e2d6beee1a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:17.972079 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402e378-54b6-44a7-a26f-d6e2d6beee1a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:17.972346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402e378-54b6-44a7-a26f-d6e2d6beee1a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:17.972912 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402e378-54b6-44a7-a26f-d6e2d6beee1a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:17.974291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402e378-54b6-44a7-a26f-d6e2d6beee1a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2402e378-54b6-44a7-a26f-d6e2d6beee1a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 27 17:14:17.983567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 27 17:14:17.984783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Sep 27 17:14:17.985736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 27 17:14:17.985736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Sep 27 17:14:17.985736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 27 17:14:17.985736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Sep 27 17:14:17.985736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 27 17:14:17.985736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 27 17:14:17.985736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 27 17:14:17.985736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Sep 27 17:14:17.985736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 27 17:14:17.985736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Sep 27 17:14:17.985736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 27 17:14:17.985736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 27 17:14:17.985736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 17:14:17.985736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Sep 27 17:14:17.985736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 654/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Sep 27 17:14:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 17:14:17.990775 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9a58b-3559-4a7f-8c93-c7f410d70605 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:18.065630 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:18.090797 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9a58b-3559-4a7f-8c93-c7f410d70605 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:18.128278 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece79aa-5032-4956-8dcc-1144a5733ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:18.128956 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece79aa-5032-4956-8dcc-1144a5733ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:18.129235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece79aa-5032-4956-8dcc-1144a5733ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:18.129548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece79aa-5032-4956-8dcc-1144a5733ae8 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:18.130247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece79aa-5032-4956-8dcc-1144a5733ae8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:14:18.130589 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece79aa-5032-4956-8dcc-1144a5733ae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:18.132104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece79aa-5032-4956-8dcc-1144a5733ae8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:18.138681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 651/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Sep 27 17:14:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:14:18.145026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402e378-54b6-44a7-a26f-d6e2d6beee1a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:14:18.242083 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402e378-54b6-44a7-a26f-d6e2d6beee1a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:14:18.274747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d2cde-fa28-490e-b9db-1e551699b3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:14:18.275340 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d2cde-fa28-490e-b9db-1e551699b3ca None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:14:18.275620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d2cde-fa28-490e-b9db-1e551699b3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:14:18.275893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d2cde-fa28-490e-b9db-1e551699b3ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:14:18.276547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d2cde-fa28-490e-b9db-1e551699b3ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:14:18.278626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d2cde-fa28-490e-b9db-1e551699b3ca None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:14:18.297263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 655/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:14:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:14:28.134833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=30 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:14:28.293170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:22.404780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa2d20-9200-4be9-920d-5e22de318b23 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:22.405240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa2d20-9200-4be9-920d-5e22de318b23 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:22.405397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa2d20-9200-4be9-920d-5e22de318b23 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:22.407206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 652/1307] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:15:22.412871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd25488-8944-4744-bffc-40b85a9f0a47 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:22.413382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd25488-8944-4744-bffc-40b85a9f0a47 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:22.413478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd25488-8944-4744-bffc-40b85a9f0a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:22.528715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8fd25488-8944-4744-bffc-40b85a9f0a47 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:15:22.530859 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8fd25488-8944-4744-bffc-40b85a9f0a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:22.672545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 656/1308] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:15:22.976002 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9d102-d242-44a7-81b7-9ea8c30bfed6 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:22.976384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9d102-d242-44a7-81b7-9ea8c30bfed6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:22.976566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9d102-d242-44a7-81b7-9ea8c30bfed6 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:22.978294 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 653/1309] 10.222.0.57 () {54 vars in 964 bytes} [Tue Sep 27 17:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:15:22.984883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669faa9-20fb-45c1-ae0f-ccca1383adba None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:22.985234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669faa9-20fb-45c1-ae0f-ccca1383adba None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:22.985444 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669faa9-20fb-45c1-ae0f-ccca1383adba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:23.075367 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6669faa9-20fb-45c1-ae0f-ccca1383adba None None] MFA Rules not processed for user `008cfc0b27d7448b9c84f8087c969e55`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:15:23.076578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6669faa9-20fb-45c1-ae0f-ccca1383adba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:23.107165 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:23.177574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 657/1310] 10.222.0.57 () {58 vars in 1061 bytes} [Tue Sep 27 17:15:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:15:23.187290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9d102-d242-44a7-81b7-9ea8c30bfed6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:15:23.189038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d9a9d102-d242-44a7-81b7-9ea8c30bfed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:23.322941 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9d102-d242-44a7-81b7-9ea8c30bfed6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:15:23.409633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824d6bd-1bbe-420c-b18a-adaa5e657dd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:15:23.411014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824d6bd-1bbe-420c-b18a-adaa5e657dd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:23.411466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824d6bd-1bbe-420c-b18a-adaa5e657dd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:23.411902 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824d6bd-1bbe-420c-b18a-adaa5e657dd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:23.414297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b824d6bd-1bbe-420c-b18a-adaa5e657dd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:23.475968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:23.550250 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824d6bd-1bbe-420c-b18a-adaa5e657dd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:15:23.551829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824d6bd-1bbe-420c-b18a-adaa5e657dd3 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:15:23.591488 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 654/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:15:26.067553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e9841-f3d0-4483-a1bf-eec42caaf982 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:26.068077 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e9841-f3d0-4483-a1bf-eec42caaf982 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:26.068189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e9841-f3d0-4483-a1bf-eec42caaf982 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:26.069796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 658/1312] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:15:26.075427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0715fe3-fd65-4e60-8372-1e5080834966 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:26.075824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0715fe3-fd65-4e60-8372-1e5080834966 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:26.075971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0715fe3-fd65-4e60-8372-1e5080834966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:26.156766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a0715fe3-fd65-4e60-8372-1e5080834966 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:15:26.157981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a0715fe3-fd65-4e60-8372-1e5080834966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:26.252057 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 655/1313] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:15:26.538682 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e9841-f3d0-4483-a1bf-eec42caaf982 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:15:26.540203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f55e9841-f3d0-4483-a1bf-eec42caaf982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:26.642194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e9841-f3d0-4483-a1bf-eec42caaf982 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:15:26.711729 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:26.713966 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f611b92-0f82-4007-804d-7f2700df9e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:15:26.714734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f611b92-0f82-4007-804d-7f2700df9e12 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:26.715198 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f611b92-0f82-4007-804d-7f2700df9e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:26.715641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f611b92-0f82-4007-804d-7f2700df9e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:26.717211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9f611b92-0f82-4007-804d-7f2700df9e12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:26.824229 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f611b92-0f82-4007-804d-7f2700df9e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:15:26.825655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f611b92-0f82-4007-804d-7f2700df9e12 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:15:26.843825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 659/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:15:29.362088 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681c2f1-a2b3-4784-8826-d6e984639348 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:29.362658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681c2f1-a2b3-4784-8826-d6e984639348 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:29.362658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681c2f1-a2b3-4784-8826-d6e984639348 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:29.364033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 656/1315] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:15:29.370387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709ad92-3d4c-4958-8796-db8f878fc0bf None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:29.370870 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709ad92-3d4c-4958-8796-db8f878fc0bf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:29.370967 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709ad92-3d4c-4958-8796-db8f878fc0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:29.450112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1709ad92-3d4c-4958-8796-db8f878fc0bf None None] MFA Rules not processed for user `ed4262f495154c89b56a75b3077cbe77`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:15:29.451455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1709ad92-3d4c-4958-8796-db8f878fc0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:29.510889 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:29.561149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 660/1316] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:15:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:15:29.877361 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681c2f1-a2b3-4784-8826-d6e984639348 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:15:29.878949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7681c2f1-a2b3-4784-8826-d6e984639348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:29.890013 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:29.986714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681c2f1-a2b3-4784-8826-d6e984639348 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:15:30.059641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9da4b7-0097-457e-80c9-15478d5d6a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:15:30.060255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9da4b7-0097-457e-80c9-15478d5d6a9e service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:30.060538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9da4b7-0097-457e-80c9-15478d5d6a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:30.060814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9da4b7-0097-457e-80c9-15478d5d6a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:30.062448 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bf9da4b7-0097-457e-80c9-15478d5d6a9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:30.126596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:30.177272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9da4b7-0097-457e-80c9-15478d5d6a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:15:30.178775 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9da4b7-0097-457e-80c9-15478d5d6a9e service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:15:30.197742 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 657/1317] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:15:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:15:32.900866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6804f-9b12-4842-b9e9-f80d8496f220 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:32.901387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6804f-9b12-4842-b9e9-f80d8496f220 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:32.901387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6804f-9b12-4842-b9e9-f80d8496f220 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:32.902680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 661/1318] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:15:32.908066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445b593-c86e-4737-b1a7-5147cea839c5 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:32.908493 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445b593-c86e-4737-b1a7-5147cea839c5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:32.908608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445b593-c86e-4737-b1a7-5147cea839c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:32.973313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7445b593-c86e-4737-b1a7-5147cea839c5 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:15:32.974632 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7445b593-c86e-4737-b1a7-5147cea839c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:33.069513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 658/1319] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:15:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:15:33.355971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6804f-9b12-4842-b9e9-f80d8496f220 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:15:33.357483 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-55c6804f-9b12-4842-b9e9-f80d8496f220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:33.461568 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6804f-9b12-4842-b9e9-f80d8496f220 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:15:33.533536 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496f823-9d02-45dc-a66c-32c44801c3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:15:33.534230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496f823-9d02-45dc-a66c-32c44801c3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:33.534503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496f823-9d02-45dc-a66c-32c44801c3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:33.534768 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496f823-9d02-45dc-a66c-32c44801c3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:33.536324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1496f823-9d02-45dc-a66c-32c44801c3b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:33.543997 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:33.643259 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496f823-9d02-45dc-a66c-32c44801c3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:15:33.644604 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496f823-9d02-45dc-a66c-32c44801c3b9 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:15:33.663909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 662/1320] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:15:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:15:36.506178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3acb8-d4f4-4c0e-83b8-1010cd4e8857 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:36.506776 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3acb8-d4f4-4c0e-83b8-1010cd4e8857 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:36.506776 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3acb8-d4f4-4c0e-83b8-1010cd4e8857 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:36.508380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 659/1321] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:15:36.514048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f827b7b-c29d-416e-b41a-8ccf19d29fa4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:36.514554 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f827b7b-c29d-416e-b41a-8ccf19d29fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:36.514644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f827b7b-c29d-416e-b41a-8ccf19d29fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:36.590909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9f827b7b-c29d-416e-b41a-8ccf19d29fa4 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:15:36.592138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9f827b7b-c29d-416e-b41a-8ccf19d29fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:36.654201 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:36.695467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 663/1322] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:15:36.993829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3acb8-d4f4-4c0e-83b8-1010cd4e8857 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:15:36.995344 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3cf3acb8-d4f4-4c0e-83b8-1010cd4e8857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:37.015385 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:37.102537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3acb8-d4f4-4c0e-83b8-1010cd4e8857 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:15:37.175836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9d6ec-e3ca-4fe6-9108-4d99e49e95c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:15:37.176444 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9d6ec-e3ca-4fe6-9108-4d99e49e95c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:37.176721 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9d6ec-e3ca-4fe6-9108-4d99e49e95c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:37.176994 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9d6ec-e3ca-4fe6-9108-4d99e49e95c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:37.178780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9fa9d6ec-e3ca-4fe6-9108-4d99e49e95c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:37.251975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:37.290381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9d6ec-e3ca-4fe6-9108-4d99e49e95c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:15:37.291793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9d6ec-e3ca-4fe6-9108-4d99e49e95c9 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:15:37.310040 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 660/1323] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:15:39.546485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d3ecf-abc3-4852-ac03-724e71a213b9 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:39.547014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d3ecf-abc3-4852-ac03-724e71a213b9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:39.547014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d3ecf-abc3-4852-ac03-724e71a213b9 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:39.548359 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 664/1324] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:15:39.554596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3de81-be9b-4b9e-b515-dcae367643f2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:39.555031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3de81-be9b-4b9e-b515-dcae367643f2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:39.555182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3de81-be9b-4b9e-b515-dcae367643f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:39.630962 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-45a3de81-be9b-4b9e-b515-dcae367643f2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:15:39.632188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-45a3de81-be9b-4b9e-b515-dcae367643f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:39.727505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 661/1325] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:15:40.030594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a86f5e-be31-48c8-90b8-f717138ac941 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:40.030881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a86f5e-be31-48c8-90b8-f717138ac941 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:40.031391 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a86f5e-be31-48c8-90b8-f717138ac941 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:40.033134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 665/1326] 10.222.0.57 () {54 vars in 964 bytes} [Tue Sep 27 17:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:15:40.043666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5683-0f5a-403d-a8a7-65ef6fec2a7c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:40.043666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5683-0f5a-403d-a8a7-65ef6fec2a7c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:40.043666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5683-0f5a-403d-a8a7-65ef6fec2a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:40.078287 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:40.128523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-505b5683-0f5a-403d-a8a7-65ef6fec2a7c None None] MFA Rules not processed for user `008cfc0b27d7448b9c84f8087c969e55`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:15:40.129889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-505b5683-0f5a-403d-a8a7-65ef6fec2a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:40.207898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 662/1327] 10.222.0.57 () {58 vars in 1061 bytes} [Tue Sep 27 17:15:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:15:40.217169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a86f5e-be31-48c8-90b8-f717138ac941 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:15:40.219089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-65a86f5e-be31-48c8-90b8-f717138ac941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:40.330793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a86f5e-be31-48c8-90b8-f717138ac941 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:15:40.405627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7603be5-8f1e-41fc-9b26-9197b025288d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:15:40.406264 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7603be5-8f1e-41fc-9b26-9197b025288d service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:40.406530 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7603be5-8f1e-41fc-9b26-9197b025288d service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:40.406796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7603be5-8f1e-41fc-9b26-9197b025288d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:40.408466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d7603be5-8f1e-41fc-9b26-9197b025288d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:40.427226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:40.523585 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7603be5-8f1e-41fc-9b26-9197b025288d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:15:40.525227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7603be5-8f1e-41fc-9b26-9197b025288d service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:15:40.543921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 666/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:15:43.008061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38e23e-898a-4a8e-a181-ab1a1aa36da9 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:43.008615 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38e23e-898a-4a8e-a181-ab1a1aa36da9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:43.008615 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38e23e-898a-4a8e-a181-ab1a1aa36da9 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:43.010052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 663/1329] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:15:43.015826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ae2af-5dd6-49cd-8ed2-1126b3a8bd99 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:43.016308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ae2af-5dd6-49cd-8ed2-1126b3a8bd99 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:43.016412 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ae2af-5dd6-49cd-8ed2-1126b3a8bd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:43.086251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e17ae2af-5dd6-49cd-8ed2-1126b3a8bd99 None None] MFA Rules not processed for user `ed4262f495154c89b56a75b3077cbe77`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:15:43.087445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e17ae2af-5dd6-49cd-8ed2-1126b3a8bd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:43.151722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:43.184722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 667/1330] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:15:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:15:43.470819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38e23e-898a-4a8e-a181-ab1a1aa36da9 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:15:43.472424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1b38e23e-898a-4a8e-a181-ab1a1aa36da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:43.581816 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38e23e-898a-4a8e-a181-ab1a1aa36da9 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:15:43.605651 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:43.665216 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8fae7-54e0-490c-a10f-78547ed72ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:15:43.665855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8fae7-54e0-490c-a10f-78547ed72ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:43.666137 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8fae7-54e0-490c-a10f-78547ed72ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:43.666409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8fae7-54e0-490c-a10f-78547ed72ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:43.668010 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8ea8fae7-54e0-490c-a10f-78547ed72ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:43.778255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8fae7-54e0-490c-a10f-78547ed72ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:15:43.779627 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8fae7-54e0-490c-a10f-78547ed72ed2 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:15:43.797950 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 664/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:15:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:15:46.348005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af0d98-db6d-4d6c-a839-86fa2d4df2bd None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:46.349179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af0d98-db6d-4d6c-a839-86fa2d4df2bd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:46.349179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af0d98-db6d-4d6c-a839-86fa2d4df2bd None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:46.350675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 668/1332] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:15:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:15:46.355805 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb1a13-1554-4f2c-ac42-b3ae57e13e64 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:46.356204 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb1a13-1554-4f2c-ac42-b3ae57e13e64 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:46.356352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb1a13-1554-4f2c-ac42-b3ae57e13e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:46.419687 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:46.422965 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-abcb1a13-1554-4f2c-ac42-b3ae57e13e64 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:15:46.424830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-abcb1a13-1554-4f2c-ac42-b3ae57e13e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:46.519159 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 665/1333] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:15:46.798663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af0d98-db6d-4d6c-a839-86fa2d4df2bd None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:15:46.800181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-54af0d98-db6d-4d6c-a839-86fa2d4df2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:46.901269 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af0d98-db6d-4d6c-a839-86fa2d4df2bd None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:15:46.974798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8123731-1fb0-4944-b6f5-38ff2745172b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:15:46.975397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8123731-1fb0-4944-b6f5-38ff2745172b service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:46.975675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8123731-1fb0-4944-b6f5-38ff2745172b service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:46.975945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8123731-1fb0-4944-b6f5-38ff2745172b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:46.977515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a8123731-1fb0-4944-b6f5-38ff2745172b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:47.003735 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:47.084993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8123731-1fb0-4944-b6f5-38ff2745172b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:15:47.086399 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8123731-1fb0-4944-b6f5-38ff2745172b service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:15:47.104314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 669/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:15:49.307164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2511f5-424f-4412-8fc2-0e099c338d69 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:49.307771 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2511f5-424f-4412-8fc2-0e099c338d69 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:49.307771 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2511f5-424f-4412-8fc2-0e099c338d69 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:49.308945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 666/1335] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:15:49.314229 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192261b5-c8d9-4be0-8257-d03e40b29bfb None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:49.314686 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192261b5-c8d9-4be0-8257-d03e40b29bfb None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:49.314788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192261b5-c8d9-4be0-8257-d03e40b29bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:49.379342 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-192261b5-c8d9-4be0-8257-d03e40b29bfb None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:15:49.380653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-192261b5-c8d9-4be0-8257-d03e40b29bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:49.456063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:49.478783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 670/1336] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:15:49.763206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2511f5-424f-4412-8fc2-0e099c338d69 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:15:49.764737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-de2511f5-424f-4412-8fc2-0e099c338d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:49.867627 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2511f5-424f-4412-8fc2-0e099c338d69 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:15:49.895915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:49.941534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd0737-c37c-4da4-b240-908ba90bf793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:15:49.942787 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd0737-c37c-4da4-b240-908ba90bf793 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:49.943315 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd0737-c37c-4da4-b240-908ba90bf793 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:49.943619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd0737-c37c-4da4-b240-908ba90bf793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:49.945200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-abfd0737-c37c-4da4-b240-908ba90bf793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:50.057862 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd0737-c37c-4da4-b240-908ba90bf793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:15:50.059235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd0737-c37c-4da4-b240-908ba90bf793 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:15:50.077438 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 667/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:15:52.552640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802c6b4-520c-48e8-802a-aa448a3ce3b7 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:52.553190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802c6b4-520c-48e8-802a-aa448a3ce3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:52.553190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802c6b4-520c-48e8-802a-aa448a3ce3b7 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:52.554560 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 671/1338] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:15:52.559739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16679eb-1970-4f65-93dc-03fd5eeaad73 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:52.560129 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16679eb-1970-4f65-93dc-03fd5eeaad73 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:52.560280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16679eb-1970-4f65-93dc-03fd5eeaad73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:52.626420 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f16679eb-1970-4f65-93dc-03fd5eeaad73 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:15:52.627604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f16679eb-1970-4f65-93dc-03fd5eeaad73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:52.636528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:52.724867 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 668/1339] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:15:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:15:53.002522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802c6b4-520c-48e8-802a-aa448a3ce3b7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:15:53.004071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d802c6b4-520c-48e8-802a-aa448a3ce3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:53.109860 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802c6b4-520c-48e8-802a-aa448a3ce3b7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:15:53.183156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e2be0-258a-4bb6-8b34-d4318b944fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:15:53.183751 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e2be0-258a-4bb6-8b34-d4318b944fea service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:53.184028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e2be0-258a-4bb6-8b34-d4318b944fea service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:53.184294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e2be0-258a-4bb6-8b34-d4318b944fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:53.185893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ad9e2be0-258a-4bb6-8b34-d4318b944fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:53.220548 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:53.295326 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e2be0-258a-4bb6-8b34-d4318b944fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:15:53.296677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e2be0-258a-4bb6-8b34-d4318b944fea service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:15:53.315096 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 672/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:15:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:15:57.537945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50ab93-c483-48a7-958e-008f727eee5d None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:57.538417 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50ab93-c483-48a7-958e-008f727eee5d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:57.538618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50ab93-c483-48a7-958e-008f727eee5d None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:57.539995 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 669/1341] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:15:57.545306 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffe2d5-1f12-4020-be1c-8279cf9ab1f8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:57.545850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffe2d5-1f12-4020-be1c-8279cf9ab1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:57.545943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffe2d5-1f12-4020-be1c-8279cf9ab1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:57.615716 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-94ffe2d5-1f12-4020-be1c-8279cf9ab1f8 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:15:57.616836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-94ffe2d5-1f12-4020-be1c-8279cf9ab1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:57.705667 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:57.723937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 673/1342] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:15:58.005053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50ab93-c483-48a7-958e-008f727eee5d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:15:58.006624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1b50ab93-c483-48a7-958e-008f727eee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:58.113023 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50ab93-c483-48a7-958e-008f727eee5d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:15:58.153061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:15:58.191794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d00d2-014d-43c8-a456-a9c74588460f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:15:58.192408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d00d2-014d-43c8-a456-a9c74588460f service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:15:58.192691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d00d2-014d-43c8-a456-a9c74588460f service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:15:58.192962 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d00d2-014d-43c8-a456-a9c74588460f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:15:58.194585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-de8d00d2-014d-43c8-a456-a9c74588460f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:15:58.305880 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d00d2-014d-43c8-a456-a9c74588460f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:15:58.307307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d00d2-014d-43c8-a456-a9c74588460f service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:15:58.325510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 670/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:16:01.153613 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5284724-8447-49e2-94e8-91fa7ceecfee None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:01.154180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5284724-8447-49e2-94e8-91fa7ceecfee None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:01.154180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5284724-8447-49e2-94e8-91fa7ceecfee None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:01.155406 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 674/1344] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:01.161133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd49eb-3dc3-4c44-8c17-4e1ec77b2838 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:01.161570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd49eb-3dc3-4c44-8c17-4e1ec77b2838 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:01.161729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd49eb-3dc3-4c44-8c17-4e1ec77b2838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:01.227606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4efd49eb-3dc3-4c44-8c17-4e1ec77b2838 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:01.228805 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4efd49eb-3dc3-4c44-8c17-4e1ec77b2838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:01.247163 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:01.328643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 671/1345] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:01.614741 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5284724-8447-49e2-94e8-91fa7ceecfee None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:01.616395 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b5284724-8447-49e2-94e8-91fa7ceecfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:01.724473 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5284724-8447-49e2-94e8-91fa7ceecfee None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:01.800569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a510e-1383-46ca-8399-075dcd8c7c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:01.801208 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a510e-1383-46ca-8399-075dcd8c7c54 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:01.801493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a510e-1383-46ca-8399-075dcd8c7c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:01.801800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a510e-1383-46ca-8399-075dcd8c7c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:01.803385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-761a510e-1383-46ca-8399-075dcd8c7c54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:01.847874 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:01.916804 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a510e-1383-46ca-8399-075dcd8c7c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:01.918283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a510e-1383-46ca-8399-075dcd8c7c54 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:01.937060 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 675/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:16:06.399618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1750fe9-1daa-40ac-be86-44d53594a74a None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:06.400082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1750fe9-1daa-40ac-be86-44d53594a74a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:06.400195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1750fe9-1daa-40ac-be86-44d53594a74a None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:06.401549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 672/1347] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:06.407230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ead9e-e43e-48fc-95de-2762ffa6ac4f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:06.407705 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ead9e-e43e-48fc-95de-2762ffa6ac4f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:06.407820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ead9e-e43e-48fc-95de-2762ffa6ac4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:06.477064 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-258ead9e-e43e-48fc-95de-2762ffa6ac4f None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:06.478334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-258ead9e-e43e-48fc-95de-2762ffa6ac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:06.573992 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:06.576157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 676/1348] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:06.859794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1750fe9-1daa-40ac-be86-44d53594a74a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:06.861330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c1750fe9-1daa-40ac-be86-44d53594a74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:06.962511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1750fe9-1daa-40ac-be86-44d53594a74a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:07.011040 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:07.037013 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b339ccb-0111-403d-9148-62b39b97da72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:07.037608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b339ccb-0111-403d-9148-62b39b97da72 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:07.037912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b339ccb-0111-403d-9148-62b39b97da72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:07.038185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b339ccb-0111-403d-9148-62b39b97da72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:07.039737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3b339ccb-0111-403d-9148-62b39b97da72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:07.146830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b339ccb-0111-403d-9148-62b39b97da72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:07.148167 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b339ccb-0111-403d-9148-62b39b97da72 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:07.165968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 673/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:16:12.114369 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2419a27-b582-4f6f-9dd5-0fc873d41480 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:12.115298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2419a27-b582-4f6f-9dd5-0fc873d41480 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:12.115750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2419a27-b582-4f6f-9dd5-0fc873d41480 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:12.117294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 677/1350] 10.222.0.57 () {54 vars in 921 bytes} [Tue Sep 27 17:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:12.122513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e96f4-1d37-49b8-9a96-a3ab1ac23279 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:12.123313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e96f4-1d37-49b8-9a96-a3ab1ac23279 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:12.123783 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e96f4-1d37-49b8-9a96-a3ab1ac23279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:12.259678 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-764e96f4-1d37-49b8-9a96-a3ab1ac23279 None None] MFA Rules not processed for user `08cedb97f3c84faeaeef2b3209356842`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:12.261101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-764e96f4-1d37-49b8-9a96-a3ab1ac23279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:12.281633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:12.383511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 674/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Sep 27 17:16:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:16.441673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b58a9f-1f5d-42fb-9817-f1d9790613d0 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:16.442199 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b58a9f-1f5d-42fb-9817-f1d9790613d0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:16.442314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b58a9f-1f5d-42fb-9817-f1d9790613d0 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:16.443755 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 678/1352] 10.222.0.57 () {54 vars in 921 bytes} [Tue Sep 27 17:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:16.448886 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9981b6-0afc-497c-bd46-62cf781d6818 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:16.449627 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9981b6-0afc-497c-bd46-62cf781d6818 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:16.450011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9981b6-0afc-497c-bd46-62cf781d6818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:16.533778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-cd9981b6-0afc-497c-bd46-62cf781d6818 None None] MFA Rules not processed for user `08cedb97f3c84faeaeef2b3209356842`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:16.536097 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cd9981b6-0afc-497c-bd46-62cf781d6818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:16.611283 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:16.649654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 675/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Sep 27 17:16:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:18.129714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6f87-4a49-4edd-aca6-b769ba38ea73 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:18.130249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6f87-4a49-4edd-aca6-b769ba38ea73 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:18.130249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd6f87-4a49-4edd-aca6-b769ba38ea73 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:18.131564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 679/1354] 10.222.0.57 () {54 vars in 921 bytes} [Tue Sep 27 17:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:18.136714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae155d99-0ebb-4fb9-b64e-a3f4663d6e77 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:18.137141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae155d99-0ebb-4fb9-b64e-a3f4663d6e77 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:18.137271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae155d99-0ebb-4fb9-b64e-a3f4663d6e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:18.215181 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ae155d99-0ebb-4fb9-b64e-a3f4663d6e77 None None] MFA Rules not processed for user `08cedb97f3c84faeaeef2b3209356842`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:18.216419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ae155d99-0ebb-4fb9-b64e-a3f4663d6e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:18.332501 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 676/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Sep 27 17:16:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:16:21.844837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3b4ad-0624-447b-85e7-15570ede6817 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:21.845404 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3b4ad-0624-447b-85e7-15570ede6817 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:21.845404 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3b4ad-0624-447b-85e7-15570ede6817 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:21.847525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 680/1356] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:21.852870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26c319-689d-4532-9314-30c17fbd6d36 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:21.853313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26c319-689d-4532-9314-30c17fbd6d36 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:21.853612 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26c319-689d-4532-9314-30c17fbd6d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:21.893360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:21.928334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-5f26c319-689d-4532-9314-30c17fbd6d36 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:21.929887 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5f26c319-689d-4532-9314-30c17fbd6d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:22.033295 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 677/1357] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:22.341521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf75bb-5f82-421c-96e3-a8141b6d22aa None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:22.342243 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf75bb-5f82-421c-96e3-a8141b6d22aa None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:22.343052 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf75bb-5f82-421c-96e3-a8141b6d22aa None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:22.345041 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 681/1358] 10.222.0.57 () {54 vars in 961 bytes} [Tue Sep 27 17:16:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:22.354342 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6f2a-454d-43bc-a81e-451f14538766 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:22.355141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6f2a-454d-43bc-a81e-451f14538766 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:22.356224 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6f2a-454d-43bc-a81e-451f14538766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:22.455949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-254b6f2a-454d-43bc-a81e-451f14538766 None None] MFA Rules not processed for user `e75b03fde75e411bace8d406237a7e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:22.457156 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-254b6f2a-454d-43bc-a81e-451f14538766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:22.512037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:22.600362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 678/1359] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Sep 27 17:16:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:16:22.608662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf75bb-5f82-421c-96e3-a8141b6d22aa None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:22.610284 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5baf75bb-5f82-421c-96e3-a8141b6d22aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:22.772806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf75bb-5f82-421c-96e3-a8141b6d22aa None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:22.855597 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:22.900035 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0861a-9e3c-4118-bffd-58009ccca360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:22.900650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0861a-9e3c-4118-bffd-58009ccca360 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:22.900945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0861a-9e3c-4118-bffd-58009ccca360 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:22.901258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0861a-9e3c-4118-bffd-58009ccca360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:22.902871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c1d0861a-9e3c-4118-bffd-58009ccca360 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:23.003517 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0861a-9e3c-4118-bffd-58009ccca360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:23.005221 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0861a-9e3c-4118-bffd-58009ccca360 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:23.025101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 682/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:16:25.497714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9fa31-12c4-4376-9e86-b0589762cdf5 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:25.498241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9fa31-12c4-4376-9e86-b0589762cdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:25.498337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9fa31-12c4-4376-9e86-b0589762cdf5 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:25.499795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 679/1361] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:25.505011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565989-80ea-4afa-b93f-7542fa9d4e56 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:25.505438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565989-80ea-4afa-b93f-7542fa9d4e56 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:25.505547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565989-80ea-4afa-b93f-7542fa9d4e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:25.573400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b3565989-80ea-4afa-b93f-7542fa9d4e56 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:25.574576 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b3565989-80ea-4afa-b93f-7542fa9d4e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:25.614222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:25.679120 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 683/1362] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:25.975890 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9fa31-12c4-4376-9e86-b0589762cdf5 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:25.977453 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c7f9fa31-12c4-4376-9e86-b0589762cdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:26.143857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9fa31-12c4-4376-9e86-b0589762cdf5 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:26.153168 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:26.260359 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da74864-074a-4321-8678-e9682f08a1c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:26.260969 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da74864-074a-4321-8678-e9682f08a1c7 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:26.261248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da74864-074a-4321-8678-e9682f08a1c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:26.261510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da74864-074a-4321-8678-e9682f08a1c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:26.263133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2da74864-074a-4321-8678-e9682f08a1c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:26.359493 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da74864-074a-4321-8678-e9682f08a1c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:26.361654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da74864-074a-4321-8678-e9682f08a1c7 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:26.380164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 680/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:16:28.886711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b5f74-af10-436c-9f1f-ca70c0436a2b None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:28.887273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b5f74-af10-436c-9f1f-ca70c0436a2b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:28.887621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b5f74-af10-436c-9f1f-ca70c0436a2b None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:28.889304 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 684/1364] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:28.895439 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4b252-eb42-4d7d-a220-ae7a9d34f8b5 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:28.895891 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4b252-eb42-4d7d-a220-ae7a9d34f8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:28.895975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4b252-eb42-4d7d-a220-ae7a9d34f8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:28.911982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:28.967522 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-15d4b252-eb42-4d7d-a220-ae7a9d34f8b5 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:28.968731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-15d4b252-eb42-4d7d-a220-ae7a9d34f8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:29.077329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 681/1365] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:29.368975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18d5bb-1d48-4c82-8b66-9609cd8aecbb None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:29.369264 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18d5bb-1d48-4c82-8b66-9609cd8aecbb None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:29.369541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18d5bb-1d48-4c82-8b66-9609cd8aecbb None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:29.370896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 685/1366] 10.222.0.57 () {54 vars in 961 bytes} [Tue Sep 27 17:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:29.376248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0de0f-471d-4680-87b6-3f4a029226a7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:29.377318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0de0f-471d-4680-87b6-3f4a029226a7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:29.377744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0de0f-471d-4680-87b6-3f4a029226a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:29.471290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-bef0de0f-471d-4680-87b6-3f4a029226a7 None None] MFA Rules not processed for user `e75b03fde75e411bace8d406237a7e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:29.472661 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bef0de0f-471d-4680-87b6-3f4a029226a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:29.510184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:29.598969 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 682/1367] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Sep 27 17:16:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:29.607136 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18d5bb-1d48-4c82-8b66-9609cd8aecbb None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:29.608746 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-aa18d5bb-1d48-4c82-8b66-9609cd8aecbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:29.766859 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18d5bb-1d48-4c82-8b66-9609cd8aecbb None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:29.788609 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:29.894189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb865241-a43b-4022-bb8e-542c7932f5e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:29.894853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb865241-a43b-4022-bb8e-542c7932f5e3 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:29.895243 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb865241-a43b-4022-bb8e-542c7932f5e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:29.895612 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb865241-a43b-4022-bb8e-542c7932f5e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:29.897302 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bb865241-a43b-4022-bb8e-542c7932f5e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:29.950004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f8d54-96fe-4987-9919-4675f414b5af None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:29.950517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f8d54-96fe-4987-9919-4675f414b5af None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:29.950610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f8d54-96fe-4987-9919-4675f414b5af None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:29.952027 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 683/1368] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:16:29.956931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f5f7d-457e-451e-a5b3-7cadd4ad2050 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:29.957215 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f5f7d-457e-451e-a5b3-7cadd4ad2050 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:29.957490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f5f7d-457e-451e-a5b3-7cadd4ad2050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:29.998289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb865241-a43b-4022-bb8e-542c7932f5e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:29.999885 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb865241-a43b-4022-bb8e-542c7932f5e3 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:30.019478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 686/1369] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:16:30.036657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-548f5f7d-457e-451e-a5b3-7cadd4ad2050 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:30.038010 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-548f5f7d-457e-451e-a5b3-7cadd4ad2050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:30.283539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:30.299213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 684/1370] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:16:30.639501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fba50-eeaa-484f-aeec-97d22604123f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:30.639791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fba50-eeaa-484f-aeec-97d22604123f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:30.640065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fba50-eeaa-484f-aeec-97d22604123f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:30.641589 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 687/1371] 10.222.0.57 () {54 vars in 963 bytes} [Tue Sep 27 17:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:30.646689 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eb6ff-363c-4a29-b843-babdb3898d83 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:30.646977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eb6ff-363c-4a29-b843-babdb3898d83 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:30.647281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eb6ff-363c-4a29-b843-babdb3898d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:30.727857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6e0eb6ff-363c-4a29-b843-babdb3898d83 None None] MFA Rules not processed for user `2c57bac4e0f54d2596fe1fda9a7dfc76`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:30.729112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6e0eb6ff-363c-4a29-b843-babdb3898d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:30.809543 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 685/1372] 10.222.0.57 () {58 vars in 1060 bytes} [Tue Sep 27 17:16:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:16:30.818106 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fba50-eeaa-484f-aeec-97d22604123f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:30.819785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-291fba50-eeaa-484f-aeec-97d22604123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:30.851303 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:30.937854 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fba50-eeaa-484f-aeec-97d22604123f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:31.045375 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e0542-4151-409e-8fb9-bf4c4b7a560a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:31.046274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e0542-4151-409e-8fb9-bf4c4b7a560a service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:31.046745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e0542-4151-409e-8fb9-bf4c4b7a560a service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:31.047187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e0542-4151-409e-8fb9-bf4c4b7a560a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:31.051096 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c74e0542-4151-409e-8fb9-bf4c4b7a560a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:31.166625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:31.224489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e0542-4151-409e-8fb9-bf4c4b7a560a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:31.226802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e0542-4151-409e-8fb9-bf4c4b7a560a service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:31.262376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 688/1373] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:16:32.384094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b074-9413-4815-97b4-2e3719c7d62f None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:32.385337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b074-9413-4815-97b4-2e3719c7d62f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:32.385337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b074-9413-4815-97b4-2e3719c7d62f None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:32.386334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 686/1374] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:32.391595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5a342-6669-436e-8a88-0d45d555d35c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:32.392094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5a342-6669-436e-8a88-0d45d555d35c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:32.392397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5a342-6669-436e-8a88-0d45d555d35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:32.460302 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-98b5a342-6669-436e-8a88-0d45d555d35c None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:32.461499 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-98b5a342-6669-436e-8a88-0d45d555d35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:32.559575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 689/1375] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:32.853654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91b074-9413-4815-97b4-2e3719c7d62f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:32.855338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5b91b074-9413-4815-97b4-2e3719c7d62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:32.947061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:33.013322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91b074-9413-4815-97b4-2e3719c7d62f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:33.133944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8173881-6a3d-436f-8f19-cdc945669719 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:33.134553 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8173881-6a3d-436f-8f19-cdc945669719 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:33.134851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8173881-6a3d-436f-8f19-cdc945669719 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:33.135113 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8173881-6a3d-436f-8f19-cdc945669719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:33.136677 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d8173881-6a3d-436f-8f19-cdc945669719 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:33.187012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:33.232295 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8173881-6a3d-436f-8f19-cdc945669719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:33.233902 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8173881-6a3d-436f-8f19-cdc945669719 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:33.253264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 687/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:16:35.484467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e6815-566a-4300-9d2f-59c471ff432b None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:35.484980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e6815-566a-4300-9d2f-59c471ff432b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:35.485099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e6815-566a-4300-9d2f-59c471ff432b None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:35.486892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 690/1377] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:35.492302 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42791df0-b1a5-4f49-a1bf-1b085f15654f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:35.492730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42791df0-b1a5-4f49-a1bf-1b085f15654f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:35.492940 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42791df0-b1a5-4f49-a1bf-1b085f15654f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:35.561471 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-42791df0-b1a5-4f49-a1bf-1b085f15654f None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:35.562693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-42791df0-b1a5-4f49-a1bf-1b085f15654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:35.670868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 688/1378] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:35.960751 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e6815-566a-4300-9d2f-59c471ff432b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:35.962292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b51e6815-566a-4300-9d2f-59c471ff432b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:36.002390 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:36.123953 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e6815-566a-4300-9d2f-59c471ff432b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:36.235805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:36.242221 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b42de6-22a7-4ba7-92bf-1c373e9d2d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:36.242856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b42de6-22a7-4ba7-92bf-1c373e9d2d11 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:36.243134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b42de6-22a7-4ba7-92bf-1c373e9d2d11 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:36.243401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b42de6-22a7-4ba7-92bf-1c373e9d2d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:36.245087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f2b42de6-22a7-4ba7-92bf-1c373e9d2d11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:36.339734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b42de6-22a7-4ba7-92bf-1c373e9d2d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:36.341308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b42de6-22a7-4ba7-92bf-1c373e9d2d11 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:36.360286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 691/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:16:38.607362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b67e22-46f0-4328-bca5-f9d274d3307e None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:38.607941 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b67e22-46f0-4328-bca5-f9d274d3307e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:38.607941 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b67e22-46f0-4328-bca5-f9d274d3307e None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:38.609375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 689/1380] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:38.614548 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b578bd1-b4df-4a4d-b97c-1dbdf18e8684 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:38.614950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b578bd1-b4df-4a4d-b97c-1dbdf18e8684 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:38.615190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b578bd1-b4df-4a4d-b97c-1dbdf18e8684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:38.686419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6b578bd1-b4df-4a4d-b97c-1dbdf18e8684 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:38.687691 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6b578bd1-b4df-4a4d-b97c-1dbdf18e8684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:38.769892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:38.812086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 692/1381] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:39.124113 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b67e22-46f0-4328-bca5-f9d274d3307e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:39.125619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c9b67e22-46f0-4328-bca5-f9d274d3307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:39.156493 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:39.287900 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b67e22-46f0-4328-bca5-f9d274d3307e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:39.406979 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:39.429768 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e9414-c97b-4086-8060-39a9a488b283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:39.430846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e9414-c97b-4086-8060-39a9a488b283 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:39.431768 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e9414-c97b-4086-8060-39a9a488b283 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:39.431768 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e9414-c97b-4086-8060-39a9a488b283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:39.433607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-da2e9414-c97b-4086-8060-39a9a488b283 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:39.545753 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e9414-c97b-4086-8060-39a9a488b283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:39.547790 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e9414-c97b-4086-8060-39a9a488b283 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:39.572068 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 690/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:16:41.825292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c76e2f-d432-4825-98d2-b40a1cf16616 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:41.825853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c76e2f-d432-4825-98d2-b40a1cf16616 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:41.826021 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c76e2f-d432-4825-98d2-b40a1cf16616 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:41.827831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 693/1383] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:41.833638 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ddcf2-40e0-4cb8-8226-31c6208ca7d4 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:41.834100 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ddcf2-40e0-4cb8-8226-31c6208ca7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:41.834224 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ddcf2-40e0-4cb8-8226-31c6208ca7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:41.900891 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-fc5ddcf2-40e0-4cb8-8226-31c6208ca7d4 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:41.902144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fc5ddcf2-40e0-4cb8-8226-31c6208ca7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:41.967174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:42.008548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 691/1384] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:42.298117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c76e2f-d432-4825-98d2-b40a1cf16616 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:42.300681 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d7c76e2f-d432-4825-98d2-b40a1cf16616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:42.490359 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c76e2f-d432-4825-98d2-b40a1cf16616 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:42.547157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:42.621757 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a81f0-47f2-4613-86ae-51591b768b36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:42.622358 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a81f0-47f2-4613-86ae-51591b768b36 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:42.622636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a81f0-47f2-4613-86ae-51591b768b36 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:42.622903 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a81f0-47f2-4613-86ae-51591b768b36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:42.624511 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0a6a81f0-47f2-4613-86ae-51591b768b36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:42.728407 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a81f0-47f2-4613-86ae-51591b768b36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:42.730354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a81f0-47f2-4613-86ae-51591b768b36 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:42.752906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 694/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:16:44.940868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8a399-194e-4622-bd45-2f539114f598 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:44.941434 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8a399-194e-4622-bd45-2f539114f598 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:44.941434 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8a399-194e-4622-bd45-2f539114f598 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:44.942795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 692/1386] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:44.948596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8100ec-9acd-40b9-815a-ec98e8341520 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:44.949009 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8100ec-9acd-40b9-815a-ec98e8341520 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:44.949132 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8100ec-9acd-40b9-815a-ec98e8341520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:45.015035 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-dd8100ec-9acd-40b9-815a-ec98e8341520 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:45.016231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-dd8100ec-9acd-40b9-815a-ec98e8341520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:45.025187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:45.116506 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 695/1387] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:45.411929 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8a399-194e-4622-bd45-2f539114f598 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:45.413525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bfa8a399-194e-4622-bd45-2f539114f598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:45.565227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8a399-194e-4622-bd45-2f539114f598 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:45.612412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:45.680000 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea41c81-0612-4faf-bc9c-c0e06c33d00a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:45.680520 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea41c81-0612-4faf-bc9c-c0e06c33d00a service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:45.680796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea41c81-0612-4faf-bc9c-c0e06c33d00a service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:45.681068 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea41c81-0612-4faf-bc9c-c0e06c33d00a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:45.682682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4ea41c81-0612-4faf-bc9c-c0e06c33d00a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:45.771666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea41c81-0612-4faf-bc9c-c0e06c33d00a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:45.773246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea41c81-0612-4faf-bc9c-c0e06c33d00a service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:45.791578 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 693/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:16:46.629916 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176a05d-6a29-4761-93f0-c45905f07870 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:46.630501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176a05d-6a29-4761-93f0-c45905f07870 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:46.630501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176a05d-6a29-4761-93f0-c45905f07870 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:46.631799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 696/1389] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:46.637113 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed2aa3-89fa-4c7e-80b0-a1a7b137a803 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:46.637550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed2aa3-89fa-4c7e-80b0-a1a7b137a803 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:46.637767 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed2aa3-89fa-4c7e-80b0-a1a7b137a803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:46.703325 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:46.708113 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-01ed2aa3-89fa-4c7e-80b0-a1a7b137a803 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:46.709743 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-01ed2aa3-89fa-4c7e-80b0-a1a7b137a803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:46.806085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 694/1390] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:47.112557 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c232e-7348-4492-8c32-1d9302eec965 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:47.112865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c232e-7348-4492-8c32-1d9302eec965 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:47.113141 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c232e-7348-4492-8c32-1d9302eec965 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:47.114526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 697/1391] 10.222.0.57 () {54 vars in 962 bytes} [Tue Sep 27 17:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:47.119745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7fcf-5294-4047-b088-9e3deaf1d940 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:47.120104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7fcf-5294-4047-b088-9e3deaf1d940 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:47.120556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7fcf-5294-4047-b088-9e3deaf1d940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:47.195918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-38ae7fcf-5294-4047-b088-9e3deaf1d940 None None] MFA Rules not processed for user `2a6c4a886aec4dd290b13118e2528fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:47.197375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-38ae7fcf-5294-4047-b088-9e3deaf1d940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:47.269235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:47.275853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 695/1392] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Sep 27 17:16:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:16:47.285654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c232e-7348-4492-8c32-1d9302eec965 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:47.287187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-799c232e-7348-4492-8c32-1d9302eec965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:47.389370 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c232e-7348-4492-8c32-1d9302eec965 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:47.431702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:47.469363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e212bd-abc9-42d5-a5b4-bc2a4e00a284 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6c4a886aec4dd290b13118e2528fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:47.470018 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e212bd-abc9-42d5-a5b4-bc2a4e00a284 service glance] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:47.470296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e212bd-abc9-42d5-a5b4-bc2a4e00a284 service glance] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:47.470565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e212bd-abc9-42d5-a5b4-bc2a4e00a284 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:47.473120 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-02e212bd-abc9-42d5-a5b4-bc2a4e00a284 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:47.586084 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e212bd-abc9-42d5-a5b4-bc2a4e00a284 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:47.587528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e212bd-abc9-42d5-a5b4-bc2a4e00a284 service glance] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:47.605314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 698/1393] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:16:47.988821 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f4772-90a9-4fcf-8855-f6ecbc76ad64 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:47.989360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f4772-90a9-4fcf-8855-f6ecbc76ad64 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:47.989360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f4772-90a9-4fcf-8855-f6ecbc76ad64 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:47.990988 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 696/1394] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:47.996473 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaebcf-1c13-4964-94da-32e12f338816 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:47.997334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaebcf-1c13-4964-94da-32e12f338816 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:47.997854 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaebcf-1c13-4964-94da-32e12f338816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:48.073291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cdaaebcf-1c13-4964-94da-32e12f338816 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:48.074521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cdaaebcf-1c13-4964-94da-32e12f338816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:48.093712 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:48.187277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 699/1395] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:48.358432 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c8c4f-39c7-4f6b-9fd1-7c546451264c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:48.358718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c8c4f-39c7-4f6b-9fd1-7c546451264c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:48.358991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c8c4f-39c7-4f6b-9fd1-7c546451264c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:48.427303 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-af6c8c4f-39c7-4f6b-9fd1-7c546451264c None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:48.428514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-af6c8c4f-39c7-4f6b-9fd1-7c546451264c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:48.483829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaebcf-1c13-4964-94da-32e12f338816 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:48.485064 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cdaaebcf-1c13-4964-94da-32e12f338816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:48.520811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 697/1396] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Sep 27 17:16:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:48.565269 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45c26-cc86-4513-95a5-905932f736f7 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:48.565618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45c26-cc86-4513-95a5-905932f736f7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:48.566039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45c26-cc86-4513-95a5-905932f736f7 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:48.567399 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 698/1397] 10.222.0.57 () {54 vars in 943 bytes} [Tue Sep 27 17:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:16:48.573794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052155a-4466-4ccf-af31-5b2c1294fcd6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:48.574077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052155a-4466-4ccf-af31-5b2c1294fcd6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:48.574647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052155a-4466-4ccf-af31-5b2c1294fcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:48.606983 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaebcf-1c13-4964-94da-32e12f338816 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:48.644196 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:48.652567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f052155a-4466-4ccf-af31-5b2c1294fcd6 None None] MFA Rules not processed for user `87a74ab0288847a7bb8b63756985e509`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:48.653795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f052155a-4466-4ccf-af31-5b2c1294fcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:48.680961 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:48.723002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14364f1-ef34-43d4-bd16-05174287d82c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:48.723607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14364f1-ef34-43d4-bd16-05174287d82c service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:48.723886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14364f1-ef34-43d4-bd16-05174287d82c service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:48.724155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14364f1-ef34-43d4-bd16-05174287d82c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:48.725773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c14364f1-ef34-43d4-bd16-05174287d82c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:48.764363 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 699/1398] 10.222.0.57 () {58 vars in 1040 bytes} [Tue Sep 27 17:16:48 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:16:48.773826 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052155a-4466-4ccf-af31-5b2c1294fcd6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:48.783422 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052155a-4466-4ccf-af31-5b2c1294fcd6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:48.816780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14364f1-ef34-43d4-bd16-05174287d82c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:48.818328 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14364f1-ef34-43d4-bd16-05174287d82c service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:48.836250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 700/1399] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:16:48.892572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cd4a0-468a-4e16-b20b-f6430dd261a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:48.894163 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cd4a0-468a-4e16-b20b-f6430dd261a8 service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:48.894605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cd4a0-468a-4e16-b20b-f6430dd261a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:48.894867 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cd4a0-468a-4e16-b20b-f6430dd261a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:48.896511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bd4cd4a0-468a-4e16-b20b-f6430dd261a8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:48.936220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:48.994687 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cd4a0-468a-4e16-b20b-f6430dd261a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:48.996515 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cd4a0-468a-4e16-b20b-f6430dd261a8 service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:49.009450 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 700/1400] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:16:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 27 17:16:51.076875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb110af-da4e-4558-b58a-b0f7beaf185b None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:51.077454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb110af-da4e-4558-b58a-b0f7beaf185b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:51.077454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb110af-da4e-4558-b58a-b0f7beaf185b None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:51.078974 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 701/1401] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:51.085653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90660f-6fda-46a2-b66a-b351a88ba6f3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:51.086166 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90660f-6fda-46a2-b66a-b351a88ba6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:51.086270 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90660f-6fda-46a2-b66a-b351a88ba6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:51.166576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4d90660f-6fda-46a2-b66a-b351a88ba6f3 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:51.167790 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4d90660f-6fda-46a2-b66a-b351a88ba6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:51.273481 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 701/1402] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:16:51.570204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb110af-da4e-4558-b58a-b0f7beaf185b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:51.571681 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-dfb110af-da4e-4558-b58a-b0f7beaf185b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:51.618241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:51.739859 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb110af-da4e-4558-b58a-b0f7beaf185b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:51.861419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d92dac-7f54-49f9-9a67-8312961e37dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:51.862623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d92dac-7f54-49f9-9a67-8312961e37dd service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:51.862904 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d92dac-7f54-49f9-9a67-8312961e37dd service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:51.863176 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d92dac-7f54-49f9-9a67-8312961e37dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:51.864769 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-10d92dac-7f54-49f9-9a67-8312961e37dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:51.867042 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:51.960385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d92dac-7f54-49f9-9a67-8312961e37dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:51.962171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d92dac-7f54-49f9-9a67-8312961e37dd service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:51.981210 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 702/1403] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:16:54.217187 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db1213-0851-4251-9242-d7cf817863ca None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:54.217754 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db1213-0851-4251-9242-d7cf817863ca None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:54.217754 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db1213-0851-4251-9242-d7cf817863ca None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:54.219291 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 702/1404] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:54.225916 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e782bfc-da75-4158-8add-1a3062b8436f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:54.226486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e782bfc-da75-4158-8add-1a3062b8436f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:54.226486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e782bfc-da75-4158-8add-1a3062b8436f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:54.321761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3e782bfc-da75-4158-8add-1a3062b8436f None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:54.323245 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3e782bfc-da75-4158-8add-1a3062b8436f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:54.408181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:54.449727 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 703/1405] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:16:54.741443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db1213-0851-4251-9242-d7cf817863ca None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:54.742973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-10db1213-0851-4251-9242-d7cf817863ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:54.775788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:54.907389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db1213-0851-4251-9242-d7cf817863ca None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:55.018009 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:55.036079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce9814-8bef-4b3b-ae3a-316895cc8e0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:55.036693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce9814-8bef-4b3b-ae3a-316895cc8e0f service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:55.036974 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce9814-8bef-4b3b-ae3a-316895cc8e0f service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:55.039370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce9814-8bef-4b3b-ae3a-316895cc8e0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:55.039370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-95ce9814-8bef-4b3b-ae3a-316895cc8e0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:55.141735 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce9814-8bef-4b3b-ae3a-316895cc8e0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:55.144598 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce9814-8bef-4b3b-ae3a-316895cc8e0f service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:55.164713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 703/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:16:57.491538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf5cb0-34ab-4fa0-af18-9b96b585da86 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:57.492090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf5cb0-34ab-4fa0-af18-9b96b585da86 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:57.492090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf5cb0-34ab-4fa0-af18-9b96b585da86 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:57.497359 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 704/1407] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:16:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:16:57.498797 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d2f64-01ea-49df-8652-ed6fc01755b0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:57.499263 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d2f64-01ea-49df-8652-ed6fc01755b0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:57.499348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d2f64-01ea-49df-8652-ed6fc01755b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:57.577960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2b7d2f64-01ea-49df-8652-ed6fc01755b0 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:16:57.579182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2b7d2f64-01ea-49df-8652-ed6fc01755b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:57.644688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:57.686839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 704/1408] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:16:57.993594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf5cb0-34ab-4fa0-af18-9b96b585da86 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:16:57.995565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3aaf5cb0-34ab-4fa0-af18-9b96b585da86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:58.164371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf5cb0-34ab-4fa0-af18-9b96b585da86 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:16:58.228108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:16:58.294625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd924e9-f29d-464d-af8b-5a78f4f48e06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:16:58.296615 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd924e9-f29d-464d-af8b-5a78f4f48e06 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:16:58.297071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd924e9-f29d-464d-af8b-5a78f4f48e06 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:16:58.297596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd924e9-f29d-464d-af8b-5a78f4f48e06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:16:58.299418 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-abd924e9-f29d-464d-af8b-5a78f4f48e06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:16:58.400627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd924e9-f29d-464d-af8b-5a78f4f48e06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:16:58.402593 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd924e9-f29d-464d-af8b-5a78f4f48e06 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:16:58.432260 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 705/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:07.685178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=16 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:08.426814 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=71 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:11.789270 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85050d-a201-42ad-999b-c404680b5bea None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:11.789871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85050d-a201-42ad-999b-c404680b5bea None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:11.789871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85050d-a201-42ad-999b-c404680b5bea None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:11.791182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 705/1410] 10.222.0.57 () {54 vars in 918 bytes} [Tue Sep 27 17:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:11.796266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeeaaa-9270-4787-91e2-36adeec2364e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:11.796684 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeeaaa-9270-4787-91e2-36adeec2364e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:11.796880 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeeaaa-9270-4787-91e2-36adeec2364e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:11.872174 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-04aeeaaa-9270-4787-91e2-36adeec2364e None None] MFA Rules not processed for user `08cedb97f3c84faeaeef2b3209356842`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:11.873387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-04aeeaaa-9270-4787-91e2-36adeec2364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:11.976936 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 706/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Tue Sep 27 17:17:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:11.993243 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b51b1-06d2-4dae-b136-8949aeafbee6 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:11.993746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b51b1-06d2-4dae-b136-8949aeafbee6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:11.994202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b51b1-06d2-4dae-b136-8949aeafbee6 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:11.996557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 706/1412] 10.222.0.57 () {54 vars in 918 bytes} [Tue Sep 27 17:17:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:12.001147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56339573-f9b4-462b-8c9c-f4608436b284 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:12.001462 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56339573-f9b4-462b-8c9c-f4608436b284 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:12.001775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56339573-f9b4-462b-8c9c-f4608436b284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:12.073522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:12.076900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-56339573-f9b4-462b-8c9c-f4608436b284 None None] MFA Rules not processed for user `e75b03fde75e411bace8d406237a7e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:12.078649 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-56339573-f9b4-462b-8c9c-f4608436b284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:12.194532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 707/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Tue Sep 27 17:17:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:14.806508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ed18e-a372-44b1-8be5-a6dc65f745fc None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:14.807095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ed18e-a372-44b1-8be5-a6dc65f745fc None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:14.807095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ed18e-a372-44b1-8be5-a6dc65f745fc None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:14.808392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 17:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:14.813617 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50694d-d13c-4e03-88ec-ba09d8803406 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:14.814061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50694d-d13c-4e03-88ec-ba09d8803406 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:14.814198 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50694d-d13c-4e03-88ec-ba09d8803406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:14.881321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5e50694d-d13c-4e03-88ec-ba09d8803406 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:14.882532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5e50694d-d13c-4e03-88ec-ba09d8803406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:14.936945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:14.979461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 17:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:15.274438 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ed18e-a372-44b1-8be5-a6dc65f745fc None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:15.276071 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9e9ed18e-a372-44b1-8be5-a6dc65f745fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:15.420132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ed18e-a372-44b1-8be5-a6dc65f745fc None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:15.493599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:15.538028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a759ef9-6d19-4646-8b64-b4eece638756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:15.538541 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a759ef9-6d19-4646-8b64-b4eece638756 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:15.538818 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a759ef9-6d19-4646-8b64-b4eece638756 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:15.539086 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a759ef9-6d19-4646-8b64-b4eece638756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:15.540705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0a759ef9-6d19-4646-8b64-b4eece638756 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:15.633443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a759ef9-6d19-4646-8b64-b4eece638756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:15.635049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a759ef9-6d19-4646-8b64-b4eece638756 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:15.652896 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 708/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:16.785750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e8a27-59b4-44e3-a240-d9d852c57009 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:16.786413 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e8a27-59b4-44e3-a240-d9d852c57009 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:16.786413 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e8a27-59b4-44e3-a240-d9d852c57009 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:16.787792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 17:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:16.794104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362d1e7-54d3-48b6-bc45-102be19955b4 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:16.794536 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362d1e7-54d3-48b6-bc45-102be19955b4 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:16.794658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362d1e7-54d3-48b6-bc45-102be19955b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:16.869705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-c362d1e7-54d3-48b6-bc45-102be19955b4 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:16.870935 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c362d1e7-54d3-48b6-bc45-102be19955b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:16.897890 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:16.966053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 17:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:17.128896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e8a27-59b4-44e3-a240-d9d852c57009 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:17.130734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-411e8a27-59b4-44e3-a240-d9d852c57009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:17.275719 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e8a27-59b4-44e3-a240-d9d852c57009 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:17.315288 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:17.388649 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617aaca-ec60-496c-a834-6801bb533a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:17.389167 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617aaca-ec60-496c-a834-6801bb533a12 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:17.389442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617aaca-ec60-496c-a834-6801bb533a12 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:17.389736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617aaca-ec60-496c-a834-6801bb533a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:17.391323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1617aaca-ec60-496c-a834-6801bb533a12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:17.481584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617aaca-ec60-496c-a834-6801bb533a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:17.483200 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617aaca-ec60-496c-a834-6801bb533a12 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:17.500667 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 710/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:18.652228 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f580e00-e2ba-45ed-ad42-cf988f2ab691 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:18.652769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f580e00-e2ba-45ed-ad42-cf988f2ab691 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:18.652769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f580e00-e2ba-45ed-ad42-cf988f2ab691 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:18.654172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 17:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:18.660551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1ca50-b0d0-4a9e-b55f-2a74b4f4a090 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:18.660973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1ca50-b0d0-4a9e-b55f-2a74b4f4a090 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:18.661086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1ca50-b0d0-4a9e-b55f-2a74b4f4a090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:18.716618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:18.743500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-24d1ca50-b0d0-4a9e-b55f-2a74b4f4a090 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:18.744700 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-24d1ca50-b0d0-4a9e-b55f-2a74b4f4a090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:18.839986 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:18.996717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f580e00-e2ba-45ed-ad42-cf988f2ab691 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:18.999362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2f580e00-e2ba-45ed-ad42-cf988f2ab691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:19.144671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f580e00-e2ba-45ed-ad42-cf988f2ab691 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:19.157068 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:19.257256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f38909-c160-4463-99a6-de4308ad8def service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:19.257806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f38909-c160-4463-99a6-de4308ad8def service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:19.258093 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f38909-c160-4463-99a6-de4308ad8def service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:19.258361 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f38909-c160-4463-99a6-de4308ad8def service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:19.259943 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f0f38909-c160-4463-99a6-de4308ad8def service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:19.348411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f38909-c160-4463-99a6-de4308ad8def service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:19.350568 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f38909-c160-4463-99a6-de4308ad8def service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:19.367909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 711/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:20.497720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69996e-1733-4976-bc24-88fde5fc0b18 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:20.498251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69996e-1733-4976-bc24-88fde5fc0b18 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:20.498348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69996e-1733-4976-bc24-88fde5fc0b18 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:20.499650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 17:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:20.506659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941946c4-a0ff-4ff6-a343-ea8ffc8924d6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:20.507064 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941946c4-a0ff-4ff6-a343-ea8ffc8924d6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:20.507225 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941946c4-a0ff-4ff6-a343-ea8ffc8924d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:20.527077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:20.584505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-941946c4-a0ff-4ff6-a343-ea8ffc8924d6 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:20.585711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-941946c4-a0ff-4ff6-a343-ea8ffc8924d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:20.677802 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 17:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:20.829510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69996e-1733-4976-bc24-88fde5fc0b18 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:20.831065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-df69996e-1733-4976-bc24-88fde5fc0b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:20.940197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:20.976249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69996e-1733-4976-bc24-88fde5fc0b18 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:21.090525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1699a3f-209b-41c7-97f3-588038fff550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:21.091145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1699a3f-209b-41c7-97f3-588038fff550 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:21.091480 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1699a3f-209b-41c7-97f3-588038fff550 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:21.091720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1699a3f-209b-41c7-97f3-588038fff550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:21.093421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f1699a3f-209b-41c7-97f3-588038fff550 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:21.169827 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:21.184339 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1699a3f-209b-41c7-97f3-588038fff550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:21.185960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1699a3f-209b-41c7-97f3-588038fff550 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:21.204253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 713/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:22.327752 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d76a94-4a3d-4e79-8172-0fbafd678e07 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:22.328301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d76a94-4a3d-4e79-8172-0fbafd678e07 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:22.328301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d76a94-4a3d-4e79-8172-0fbafd678e07 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:22.329819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 17:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:22.336621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127e42e-6b50-43a8-b2a0-02b3f317fa2e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:22.337075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127e42e-6b50-43a8-b2a0-02b3f317fa2e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:22.337181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127e42e-6b50-43a8-b2a0-02b3f317fa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:22.411475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c127e42e-6b50-43a8-b2a0-02b3f317fa2e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:22.413257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c127e42e-6b50-43a8-b2a0-02b3f317fa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:22.509253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 17:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:22.662122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d76a94-4a3d-4e79-8172-0fbafd678e07 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:22.663582 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b3d76a94-4a3d-4e79-8172-0fbafd678e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:22.745554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:22.808939 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d76a94-4a3d-4e79-8172-0fbafd678e07 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:22.919282 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef9bab-1bc4-4620-a897-d1940e5f71c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:22.919801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef9bab-1bc4-4620-a897-d1940e5f71c1 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:22.920079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef9bab-1bc4-4620-a897-d1940e5f71c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:22.920350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef9bab-1bc4-4620-a897-d1940e5f71c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:22.921952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2fef9bab-1bc4-4620-a897-d1940e5f71c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:22.969115 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:23.010621 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef9bab-1bc4-4620-a897-d1940e5f71c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:23.012217 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef9bab-1bc4-4620-a897-d1940e5f71c1 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:23.030355 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 714/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:24.085101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9595d11-a80c-40b1-983f-411d17331e12 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:24.085647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9595d11-a80c-40b1-983f-411d17331e12 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:24.085780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9595d11-a80c-40b1-983f-411d17331e12 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:24.087051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 17:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:24.093473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aba754-8052-4af7-a099-ea51973898e3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:24.094238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aba754-8052-4af7-a099-ea51973898e3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:24.094238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aba754-8052-4af7-a099-ea51973898e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:24.169033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-90aba754-8052-4af7-a099-ea51973898e3 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:24.170247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-90aba754-8052-4af7-a099-ea51973898e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:24.265623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 17:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:24.417569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9595d11-a80c-40b1-983f-411d17331e12 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:24.419103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d9595d11-a80c-40b1-983f-411d17331e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:24.469045 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:24.566437 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9595d11-a80c-40b1-983f-411d17331e12 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:24.678486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c57ea6-2141-47c6-9fc7-09f181248cfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:24.679086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c57ea6-2141-47c6-9fc7-09f181248cfe service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:24.679363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c57ea6-2141-47c6-9fc7-09f181248cfe service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:24.679634 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c57ea6-2141-47c6-9fc7-09f181248cfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:24.681207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-73c57ea6-2141-47c6-9fc7-09f181248cfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:24.687932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:24.770682 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c57ea6-2141-47c6-9fc7-09f181248cfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:24.772418 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c57ea6-2141-47c6-9fc7-09f181248cfe service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:24.790404 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 716/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:25.847747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5943b42-affb-43ee-85b1-39c30bc7c86f None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:25.848289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5943b42-affb-43ee-85b1-39c30bc7c86f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:25.848289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5943b42-affb-43ee-85b1-39c30bc7c86f None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:25.849827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 17:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:25.855972 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43828ee-042b-4fc3-9174-c561755381b9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:25.856409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43828ee-042b-4fc3-9174-c561755381b9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:25.856503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43828ee-042b-4fc3-9174-c561755381b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:25.930905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a43828ee-042b-4fc3-9174-c561755381b9 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:25.932103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a43828ee-042b-4fc3-9174-c561755381b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:25.999707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:26.029484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 17:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:17:26.182034 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5943b42-affb-43ee-85b1-39c30bc7c86f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:26.183470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a5943b42-affb-43ee-85b1-39c30bc7c86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:26.201586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:26.327180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5943b42-affb-43ee-85b1-39c30bc7c86f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:26.412914 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:26.439814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1a601-9442-4fb2-b3db-d3b5d96b7659 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:26.440421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1a601-9442-4fb2-b3db-d3b5d96b7659 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:26.440701 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1a601-9442-4fb2-b3db-d3b5d96b7659 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:26.440975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1a601-9442-4fb2-b3db-d3b5d96b7659 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:26.442587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-48a1a601-9442-4fb2-b3db-d3b5d96b7659 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:26.530528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1a601-9442-4fb2-b3db-d3b5d96b7659 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:26.532102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1a601-9442-4fb2-b3db-d3b5d96b7659 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:26.550323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 717/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:27.608415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c9a39-3a5a-47eb-b870-6a5ca101f4fa None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:27.608990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c9a39-3a5a-47eb-b870-6a5ca101f4fa None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:27.608990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c9a39-3a5a-47eb-b870-6a5ca101f4fa None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:27.610419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 17:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:27.617092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eabcd-1698-4f06-97a0-8c3d8c990a27 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:27.617547 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eabcd-1698-4f06-97a0-8c3d8c990a27 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:27.617658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eabcd-1698-4f06-97a0-8c3d8c990a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:27.692866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-475eabcd-1698-4f06-97a0-8c3d8c990a27 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:27.694941 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-475eabcd-1698-4f06-97a0-8c3d8c990a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:27.736488 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:27.790564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 17:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:27.943178 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c9a39-3a5a-47eb-b870-6a5ca101f4fa None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:27.944923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fe5c9a39-3a5a-47eb-b870-6a5ca101f4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:28.095847 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c9a39-3a5a-47eb-b870-6a5ca101f4fa None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:28.154982 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:28.214800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac492aca-a4ca-43d2-b0cb-ab67c64ccab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:28.215327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac492aca-a4ca-43d2-b0cb-ab67c64ccab8 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:28.215606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac492aca-a4ca-43d2-b0cb-ab67c64ccab8 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:28.215877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac492aca-a4ca-43d2-b0cb-ab67c64ccab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:28.217463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ac492aca-a4ca-43d2-b0cb-ab67c64ccab8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:28.306791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac492aca-a4ca-43d2-b0cb-ab67c64ccab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:28.308386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac492aca-a4ca-43d2-b0cb-ab67c64ccab8 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:28.328874 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 719/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:17:29.395074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcb36e-2e0a-44ef-ad99-193fe0d24361 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:29.395627 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcb36e-2e0a-44ef-ad99-193fe0d24361 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:29.395627 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcb36e-2e0a-44ef-ad99-193fe0d24361 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:29.397052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 17:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:29.403507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ea554-8ca2-47bf-b30f-f4df55b2ce82 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:29.403959 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ea554-8ca2-47bf-b30f-f4df55b2ce82 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:29.404052 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ea554-8ca2-47bf-b30f-f4df55b2ce82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:29.481258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6a3ea554-8ca2-47bf-b30f-f4df55b2ce82 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:29.482489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6a3ea554-8ca2-47bf-b30f-f4df55b2ce82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:29.484475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:29.579663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 17:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:29.730400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcb36e-2e0a-44ef-ad99-193fe0d24361 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:29.732248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4abcb36e-2e0a-44ef-ad99-193fe0d24361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:29.898855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcb36e-2e0a-44ef-ad99-193fe0d24361 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:29.930423 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:30.030822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135c773-7284-4b11-9183-8bb927a7fd14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:30.031494 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135c773-7284-4b11-9183-8bb927a7fd14 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:30.031778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135c773-7284-4b11-9183-8bb927a7fd14 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:30.032152 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135c773-7284-4b11-9183-8bb927a7fd14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:30.034049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0135c773-7284-4b11-9183-8bb927a7fd14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:30.156503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135c773-7284-4b11-9183-8bb927a7fd14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:30.158931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135c773-7284-4b11-9183-8bb927a7fd14 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:30.185054 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 720/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:32.387436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be801109-c731-450d-9741-d532df68a45a None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:32.388063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be801109-c731-450d-9741-d532df68a45a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:32.388063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be801109-c731-450d-9741-d532df68a45a None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:32.389252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 17:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:32.394681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfda90b-db01-4925-957c-909a753a87d8 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:32.395116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfda90b-db01-4925-957c-909a753a87d8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:32.395218 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfda90b-db01-4925-957c-909a753a87d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:32.436586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:32.462852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0bfda90b-db01-4925-957c-909a753a87d8 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:32.464042 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0bfda90b-db01-4925-957c-909a753a87d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:32.558013 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 17:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:32.843942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be801109-c731-450d-9741-d532df68a45a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:32.845579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-be801109-c731-450d-9741-d532df68a45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:32.948628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be801109-c731-450d-9741-d532df68a45a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:32.981846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:33.024202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a2cb4-6c16-4106-ab28-d203a320d778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:33.024802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a2cb4-6c16-4106-ab28-d203a320d778 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:33.025078 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a2cb4-6c16-4106-ab28-d203a320d778 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:33.025348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a2cb4-6c16-4106-ab28-d203a320d778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:33.026959 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-791a2cb4-6c16-4106-ab28-d203a320d778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:33.139303 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a2cb4-6c16-4106-ab28-d203a320d778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:33.140630 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a2cb4-6c16-4106-ab28-d203a320d778 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:33.159722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 722/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:35.436954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44a648-38d7-42f6-a61d-9adf01771785 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:35.437375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44a648-38d7-42f6-a61d-9adf01771785 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:35.437509 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44a648-38d7-42f6-a61d-9adf01771785 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:35.438903 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 17:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:35.444815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066857fc-385e-426b-ac60-7079d60e0e35 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:35.445335 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066857fc-385e-426b-ac60-7079d60e0e35 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:35.445335 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066857fc-385e-426b-ac60-7079d60e0e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:35.511975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-066857fc-385e-426b-ac60-7079d60e0e35 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:35.513353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-066857fc-385e-426b-ac60-7079d60e0e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:35.527249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:35.610044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 17:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:35.895526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44a648-38d7-42f6-a61d-9adf01771785 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:35.897107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ef44a648-38d7-42f6-a61d-9adf01771785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:35.998439 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44a648-38d7-42f6-a61d-9adf01771785 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:36.011857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:36.073818 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b5fe4-d4b8-47d3-9726-34abda17cce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:36.074421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b5fe4-d4b8-47d3-9726-34abda17cce8 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:36.074701 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b5fe4-d4b8-47d3-9726-34abda17cce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:36.074971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b5fe4-d4b8-47d3-9726-34abda17cce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:36.076537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-278b5fe4-d4b8-47d3-9726-34abda17cce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:36.184920 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b5fe4-d4b8-47d3-9726-34abda17cce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:36.186375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b5fe4-d4b8-47d3-9726-34abda17cce8 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:36.204666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 723/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:38.675078 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee05fb-7b0e-4a05-9377-c7edd97d0ac9 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:38.675644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee05fb-7b0e-4a05-9377-c7edd97d0ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:38.675644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee05fb-7b0e-4a05-9377-c7edd97d0ac9 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:38.676933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 17:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:38.682549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0c954-4954-4c78-bf3c-6cee0e7a375e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:38.682969 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0c954-4954-4c78-bf3c-6cee0e7a375e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:38.683070 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0c954-4954-4c78-bf3c-6cee0e7a375e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:38.730907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:38.749284 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6db0c954-4954-4c78-bf3c-6cee0e7a375e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:38.750516 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6db0c954-4954-4c78-bf3c-6cee0e7a375e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:38.844286 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 17:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:39.134961 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee05fb-7b0e-4a05-9377-c7edd97d0ac9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:39.136519 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0cee05fb-7b0e-4a05-9377-c7edd97d0ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:39.239438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee05fb-7b0e-4a05-9377-c7edd97d0ac9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:39.279824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:39.313033 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecff350-06f3-473f-b2bc-81a4cf358c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:39.313658 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecff350-06f3-473f-b2bc-81a4cf358c3a service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:39.313988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecff350-06f3-473f-b2bc-81a4cf358c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:39.314258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecff350-06f3-473f-b2bc-81a4cf358c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:39.315821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-eecff350-06f3-473f-b2bc-81a4cf358c3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:39.423584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecff350-06f3-473f-b2bc-81a4cf358c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:39.424962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecff350-06f3-473f-b2bc-81a4cf358c3a service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:39.442586 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 725/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:41.727467 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f4041-c73b-4473-a066-6df0f9d0b075 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:41.728051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f4041-c73b-4473-a066-6df0f9d0b075 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:41.728051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f4041-c73b-4473-a066-6df0f9d0b075 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:41.729359 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 17:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:17:41.734812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39764a2-cb7b-4f3c-a68e-8d1a9024da32 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:41.735240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39764a2-cb7b-4f3c-a68e-8d1a9024da32 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:41.735350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39764a2-cb7b-4f3c-a68e-8d1a9024da32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:41.800021 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d39764a2-cb7b-4f3c-a68e-8d1a9024da32 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:41.801207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d39764a2-cb7b-4f3c-a68e-8d1a9024da32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:41.822215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:41.896057 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 17:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:42.182754 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f4041-c73b-4473-a066-6df0f9d0b075 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:42.184315 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a37f4041-c73b-4473-a066-6df0f9d0b075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:42.285584 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f4041-c73b-4473-a066-6df0f9d0b075 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:42.306552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:42.359344 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11308d3-0f8c-4025-ad00-32ed38d43e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:42.359949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11308d3-0f8c-4025-ad00-32ed38d43e2b service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:42.360225 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11308d3-0f8c-4025-ad00-32ed38d43e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:42.360495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11308d3-0f8c-4025-ad00-32ed38d43e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:42.362118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a11308d3-0f8c-4025-ad00-32ed38d43e2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:42.471205 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11308d3-0f8c-4025-ad00-32ed38d43e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:42.472623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11308d3-0f8c-4025-ad00-32ed38d43e2b service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:42.490364 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 726/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:44.714184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacf726-05fe-4232-bbcd-188f475ed5ec None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:44.714729 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacf726-05fe-4232-bbcd-188f475ed5ec None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:44.714729 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacf726-05fe-4232-bbcd-188f475ed5ec None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:44.716061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 17:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:44.721420 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd54df-a2c1-4768-bbf5-bbe768e6305f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:44.721897 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd54df-a2c1-4768-bbf5-bbe768e6305f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:44.722004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd54df-a2c1-4768-bbf5-bbe768e6305f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:44.785155 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:44.788109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-1dbd54df-a2c1-4768-bbf5-bbe768e6305f None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:44.790640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1dbd54df-a2c1-4768-bbf5-bbe768e6305f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:44.889778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 17:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:45.181800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacf726-05fe-4232-bbcd-188f475ed5ec None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:45.183338 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ddacf726-05fe-4232-bbcd-188f475ed5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:45.286207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacf726-05fe-4232-bbcd-188f475ed5ec None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:45.336698 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:45.361136 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f54c7-16bc-4f19-95de-9480c42096a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:45.361793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f54c7-16bc-4f19-95de-9480c42096a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:45.362070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f54c7-16bc-4f19-95de-9480c42096a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:45.362336 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f54c7-16bc-4f19-95de-9480c42096a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:45.363888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-770f54c7-16bc-4f19-95de-9480c42096a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:45.471878 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f54c7-16bc-4f19-95de-9480c42096a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:45.473317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f54c7-16bc-4f19-95de-9480c42096a5 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:45.491455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 728/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:47.723970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676549d-fe3d-4bf7-976d-8727d157e789 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:47.724519 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676549d-fe3d-4bf7-976d-8727d157e789 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:47.724519 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676549d-fe3d-4bf7-976d-8727d157e789 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:47.725874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 17:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:47.731603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b14e5d-37b1-400d-985a-fc0a864587bc None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:47.732029 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b14e5d-37b1-400d-985a-fc0a864587bc None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:47.732131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b14e5d-37b1-400d-985a-fc0a864587bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:47.797125 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-48b14e5d-37b1-400d-985a-fc0a864587bc None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:47.798382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-48b14e5d-37b1-400d-985a-fc0a864587bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:47.827986 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:47.897405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 17:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:48.184325 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676549d-fe3d-4bf7-976d-8727d157e789 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:48.185877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c676549d-fe3d-4bf7-976d-8727d157e789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:48.285879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676549d-fe3d-4bf7-976d-8727d157e789 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:48.314355 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:48.361397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bd111-461a-4fa5-8ef1-60156b536e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:48.362023 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bd111-461a-4fa5-8ef1-60156b536e90 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:48.362300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bd111-461a-4fa5-8ef1-60156b536e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:48.362567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bd111-461a-4fa5-8ef1-60156b536e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:48.364140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9d2bd111-461a-4fa5-8ef1-60156b536e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:48.472206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bd111-461a-4fa5-8ef1-60156b536e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:48.473803 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bd111-461a-4fa5-8ef1-60156b536e90 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:48.493177 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 729/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:50.712379 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e3b06-b96d-426b-ad82-e6c42ba0e3d2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:50.712947 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e3b06-b96d-426b-ad82-e6c42ba0e3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:50.712947 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e3b06-b96d-426b-ad82-e6c42ba0e3d2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:50.714292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 17:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:50.719532 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f47c3-2a48-4e12-b6ab-71f6bb7f3a81 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:50.719916 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f47c3-2a48-4e12-b6ab-71f6bb7f3a81 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:50.720079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f47c3-2a48-4e12-b6ab-71f6bb7f3a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:50.785158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-5d5f47c3-2a48-4e12-b6ab-71f6bb7f3a81 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:50.786385 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5d5f47c3-2a48-4e12-b6ab-71f6bb7f3a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:50.795317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:50.882043 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 17:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:51.172283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e3b06-b96d-426b-ad82-e6c42ba0e3d2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:51.173843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cf9e3b06-b96d-426b-ad82-e6c42ba0e3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:51.277480 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e3b06-b96d-426b-ad82-e6c42ba0e3d2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:51.332229 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:51.350789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69811921-f54a-4d59-80fe-52cac88ff78a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:51.351439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69811921-f54a-4d59-80fe-52cac88ff78a service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:51.351715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69811921-f54a-4d59-80fe-52cac88ff78a service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:51.351985 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69811921-f54a-4d59-80fe-52cac88ff78a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:51.353567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-69811921-f54a-4d59-80fe-52cac88ff78a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:51.465556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69811921-f54a-4d59-80fe-52cac88ff78a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:51.467068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69811921-f54a-4d59-80fe-52cac88ff78a service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:51.485429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 731/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:53.696568 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8cf0e-4fb7-4905-add0-ead788bc9e20 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:53.697430 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8cf0e-4fb7-4905-add0-ead788bc9e20 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:53.697918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8cf0e-4fb7-4905-add0-ead788bc9e20 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:53.700229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 17:17:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:53.706687 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becbe49-b490-4ed5-9465-f51868b3a4a4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:53.707189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becbe49-b490-4ed5-9465-f51868b3a4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:53.707300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becbe49-b490-4ed5-9465-f51868b3a4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:53.772123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6becbe49-b490-4ed5-9465-f51868b3a4a4 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:53.773361 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6becbe49-b490-4ed5-9465-f51868b3a4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:53.811246 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:53.869341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 17:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:54.155272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8cf0e-4fb7-4905-add0-ead788bc9e20 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:54.156830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-55f8cf0e-4fb7-4905-add0-ead788bc9e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:54.259633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8cf0e-4fb7-4905-add0-ead788bc9e20 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:54.299230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:54.335643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db2126-9140-4cda-94db-55372003a774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:54.337007 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db2126-9140-4cda-94db-55372003a774 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:54.337319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db2126-9140-4cda-94db-55372003a774 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:54.337592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db2126-9140-4cda-94db-55372003a774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:54.339226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-88db2126-9140-4cda-94db-55372003a774 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:54.447531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db2126-9140-4cda-94db-55372003a774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:54.448992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db2126-9140-4cda-94db-55372003a774 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:54.467726 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 732/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:56.638490 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa127d62-a88f-4616-b25e-899f5ae7f79c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:56.639071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa127d62-a88f-4616-b25e-899f5ae7f79c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:56.639071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa127d62-a88f-4616-b25e-899f5ae7f79c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:56.640439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 17:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:17:56.645861 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73616-0594-4e2a-a3d7-c89b4be6b332 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:56.646281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73616-0594-4e2a-a3d7-c89b4be6b332 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:56.646418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73616-0594-4e2a-a3d7-c89b4be6b332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:56.712514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8ce73616-0594-4e2a-a3d7-c89b4be6b332 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:56.713748 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8ce73616-0594-4e2a-a3d7-c89b4be6b332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:56.731244 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:56.808634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 17:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:17:57.092597 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa127d62-a88f-4616-b25e-899f5ae7f79c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:17:57.094470 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-aa127d62-a88f-4616-b25e-899f5ae7f79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:57.197803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa127d62-a88f-4616-b25e-899f5ae7f79c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:17:57.264510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:57.271603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c2c7f-5f55-472f-b03f-d415ebddb882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:17:57.272201 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c2c7f-5f55-472f-b03f-d415ebddb882 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:57.272475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c2c7f-5f55-472f-b03f-d415ebddb882 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:57.272745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c2c7f-5f55-472f-b03f-d415ebddb882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:57.275216 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-530c2c7f-5f55-472f-b03f-d415ebddb882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:57.384492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c2c7f-5f55-472f-b03f-d415ebddb882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:17:57.385870 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c2c7f-5f55-472f-b03f-d415ebddb882 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:17:57.404805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 734/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:17:59.574891 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc860b1-31c7-4c45-8b8b-da72f18be0df None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:59.575421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc860b1-31c7-4c45-8b8b-da72f18be0df None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:59.575421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc860b1-31c7-4c45-8b8b-da72f18be0df None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:59.576784 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 17:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:17:59.582402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92539f80-fd5b-4089-88f6-90253e639a43 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:17:59.582813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92539f80-fd5b-4089-88f6-90253e639a43 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:17:59.582952 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92539f80-fd5b-4089-88f6-90253e639a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:17:59.647776 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-92539f80-fd5b-4089-88f6-90253e639a43 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:17:59.649511 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-92539f80-fd5b-4089-88f6-90253e639a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:17:59.696305 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:59.744544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 17:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:18:00.024843 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc860b1-31c7-4c45-8b8b-da72f18be0df None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:18:00.026428 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2bc860b1-31c7-4c45-8b8b-da72f18be0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:00.129192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc860b1-31c7-4c45-8b8b-da72f18be0df None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:18:00.175943 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:00.202384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ee2ee-2669-4b01-918a-fd373bee8e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:18:00.202988 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ee2ee-2669-4b01-918a-fd373bee8e72 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:00.203269 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ee2ee-2669-4b01-918a-fd373bee8e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:00.203538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ee2ee-2669-4b01-918a-fd373bee8e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:00.205369 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ab4ee2ee-2669-4b01-918a-fd373bee8e72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:00.313233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ee2ee-2669-4b01-918a-fd373bee8e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:18:00.314631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ee2ee-2669-4b01-918a-fd373bee8e72 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:18:00.332471 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 735/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:18:09.742353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=22 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:10.330140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=66 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:20.447471 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678bcdd-ba2e-452d-a0b5-a12722b7f00f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:20.447988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678bcdd-ba2e-452d-a0b5-a12722b7f00f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:20.448102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678bcdd-ba2e-452d-a0b5-a12722b7f00f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:20.449374 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 736/1471] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:18:20.454607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67eee5-94ba-43bd-ab98-e14f029ea980 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:20.455053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67eee5-94ba-43bd-ab98-e14f029ea980 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:20.455185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67eee5-94ba-43bd-ab98-e14f029ea980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:20.519957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6e67eee5-94ba-43bd-ab98-e14f029ea980 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:18:20.521142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6e67eee5-94ba-43bd-ab98-e14f029ea980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:20.617992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 736/1472] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:18:20.919422 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a4add-78ee-45fd-b3d6-92ddca21b679 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:20.919710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a4add-78ee-45fd-b3d6-92ddca21b679 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:20.919991 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a4add-78ee-45fd-b3d6-92ddca21b679 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:20.921313 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 737/1473] 10.222.0.57 () {54 vars in 962 bytes} [Tue Sep 27 17:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:18:20.926301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709820bd-48a9-48af-b331-17902d80a62f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:20.926588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709820bd-48a9-48af-b331-17902d80a62f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:20.926868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709820bd-48a9-48af-b331-17902d80a62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:21.002232 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-709820bd-48a9-48af-b331-17902d80a62f None None] MFA Rules not processed for user `2a6c4a886aec4dd290b13118e2528fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:18:21.003438 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-709820bd-48a9-48af-b331-17902d80a62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:21.024079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:21.083000 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 737/1474] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Sep 27 17:18:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:18:21.090849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a4add-78ee-45fd-b3d6-92ddca21b679 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:18:21.092359 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e22a4add-78ee-45fd-b3d6-92ddca21b679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:21.196232 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a4add-78ee-45fd-b3d6-92ddca21b679 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:18:21.268998 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873f36f-464b-4377-913b-80ddd898a065 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6c4a886aec4dd290b13118e2528fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:18:21.269593 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873f36f-464b-4377-913b-80ddd898a065 service glance] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:21.269903 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873f36f-464b-4377-913b-80ddd898a065 service glance] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:21.270171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873f36f-464b-4377-913b-80ddd898a065 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:21.271773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9873f36f-464b-4377-913b-80ddd898a065 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:21.326031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:21.386212 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873f36f-464b-4377-913b-80ddd898a065 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:18:21.387659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873f36f-464b-4377-913b-80ddd898a065 service glance] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:18:21.405780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 738/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:18:23.646229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55556aa6-56ca-4dab-b9d9-7d2ecc7f4b98 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:23.646777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55556aa6-56ca-4dab-b9d9-7d2ecc7f4b98 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:23.646777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55556aa6-56ca-4dab-b9d9-7d2ecc7f4b98 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:23.648124 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 738/1476] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:18:23.653530 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66505de1-c731-439f-b1a7-7ba7e3dfa1bb None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:23.653973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66505de1-c731-439f-b1a7-7ba7e3dfa1bb None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:23.654096 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66505de1-c731-439f-b1a7-7ba7e3dfa1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:23.721206 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-66505de1-c731-439f-b1a7-7ba7e3dfa1bb None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:18:23.722443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-66505de1-c731-439f-b1a7-7ba7e3dfa1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:23.817817 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 739/1477] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:18:24.095766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55556aa6-56ca-4dab-b9d9-7d2ecc7f4b98 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:18:24.097330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-55556aa6-56ca-4dab-b9d9-7d2ecc7f4b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:24.221017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55556aa6-56ca-4dab-b9d9-7d2ecc7f4b98 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:18:24.271436 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:24.316777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385b461-20e8-4e26-8286-20cc5d2209fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:18:24.317388 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385b461-20e8-4e26-8286-20cc5d2209fb admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:24.317669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385b461-20e8-4e26-8286-20cc5d2209fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:24.317968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385b461-20e8-4e26-8286-20cc5d2209fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:24.318610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385b461-20e8-4e26-8286-20cc5d2209fb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:18:24.320337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: WARNING py.warnings [None req-2385b461-20e8-4e26-8286-20cc5d2209fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 17:18:24.320337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: warnings.warn(msg) Sep 27 17:18:24.320337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: Sep 27 17:18:24.321982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385b461-20e8-4e26-8286-20cc5d2209fb admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:18:24.342404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 739/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Sep 27 17:18:24 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:18:26.495379 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8fa50-c679-4686-8389-2fb3b9d5c156 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:26.495912 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8fa50-c679-4686-8389-2fb3b9d5c156 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:26.495912 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8fa50-c679-4686-8389-2fb3b9d5c156 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:26.497262 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 740/1479] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:18:26.502711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb252bc3-1c6a-4158-9f42-3af591c885b4 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:26.503122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb252bc3-1c6a-4158-9f42-3af591c885b4 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:26.503325 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb252bc3-1c6a-4158-9f42-3af591c885b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:26.567520 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-fb252bc3-1c6a-4158-9f42-3af591c885b4 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:18:26.568713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fb252bc3-1c6a-4158-9f42-3af591c885b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:26.661329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 740/1480] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:18:26.959537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8fa50-c679-4686-8389-2fb3b9d5c156 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:18:26.961112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b4a8fa50-c679-4686-8389-2fb3b9d5c156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:26.970939 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:27.106484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8fa50-c679-4686-8389-2fb3b9d5c156 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:18:27.187187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:27.219746 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3afa3-a07a-48f7-9986-b728c3fab238 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:18:27.220284 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3afa3-a07a-48f7-9986-b728c3fab238 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:27.220561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3afa3-a07a-48f7-9986-b728c3fab238 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:27.220833 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3afa3-a07a-48f7-9986-b728c3fab238 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:27.222467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fdc3afa3-a07a-48f7-9986-b728c3fab238 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:27.312413 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3afa3-a07a-48f7-9986-b728c3fab238 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:18:27.314035 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3afa3-a07a-48f7-9986-b728c3fab238 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:18:27.331710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 741/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:18:29.671284 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd4df1-fc00-457d-854f-c2154fad526e None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:29.671838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd4df1-fc00-457d-854f-c2154fad526e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:29.671838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd4df1-fc00-457d-854f-c2154fad526e None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:29.673217 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 741/1482] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:18:29.678673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc17a77-3346-427e-9555-56c70263f175 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:29.679097 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc17a77-3346-427e-9555-56c70263f175 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:29.679205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc17a77-3346-427e-9555-56c70263f175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:29.745225 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5dc17a77-3346-427e-9555-56c70263f175 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:18:29.746664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5dc17a77-3346-427e-9555-56c70263f175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:29.792878 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:29.843501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 742/1483] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:18:30.134271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd4df1-fc00-457d-854f-c2154fad526e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:18:30.136534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b5fd4df1-fc00-457d-854f-c2154fad526e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:30.160331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:30.238733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd4df1-fc00-457d-854f-c2154fad526e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:18:30.311812 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5406ff8-5e9f-4bf9-8295-074c2311508b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:18:30.312367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406ff8-5e9f-4bf9-8295-074c2311508b service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:30.312640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406ff8-5e9f-4bf9-8295-074c2311508b service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:30.312904 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5406ff8-5e9f-4bf9-8295-074c2311508b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:30.314506 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f5406ff8-5e9f-4bf9-8295-074c2311508b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:30.389306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:30.423799 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5406ff8-5e9f-4bf9-8295-074c2311508b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:18:30.425214 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5406ff8-5e9f-4bf9-8295-074c2311508b service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:18:30.443016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 742/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:18:32.773860 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8a971-a043-4dc6-af86-a7130450d470 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:32.774446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8a971-a043-4dc6-af86-a7130450d470 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:32.774446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8a971-a043-4dc6-af86-a7130450d470 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:32.775845 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 743/1485] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:18:32.782080 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734839e-1ad5-421e-bed3-bf22203712c7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:32.782542 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734839e-1ad5-421e-bed3-bf22203712c7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:32.782714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734839e-1ad5-421e-bed3-bf22203712c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:32.864772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e734839e-1ad5-421e-bed3-bf22203712c7 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:18:32.866026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e734839e-1ad5-421e-bed3-bf22203712c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:32.978241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 743/1486] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:18:33.271291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8a971-a043-4dc6-af86-a7130450d470 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:18:33.272844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ffe8a971-a043-4dc6-af86-a7130450d470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:33.377288 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8a971-a043-4dc6-af86-a7130450d470 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:18:33.449505 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:33.451060 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840af55-4566-4f6d-a03b-164deebca896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:18:33.451754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840af55-4566-4f6d-a03b-164deebca896 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:33.452242 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840af55-4566-4f6d-a03b-164deebca896 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:33.452742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840af55-4566-4f6d-a03b-164deebca896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:33.454625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3840af55-4566-4f6d-a03b-164deebca896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:33.567504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840af55-4566-4f6d-a03b-164deebca896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:18:33.568852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840af55-4566-4f6d-a03b-164deebca896 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:18:33.587889 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 744/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:18:35.849943 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879d992-d6ea-41d0-8592-4236adcfdd64 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:35.850557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879d992-d6ea-41d0-8592-4236adcfdd64 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:35.850557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879d992-d6ea-41d0-8592-4236adcfdd64 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:35.851811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 744/1488] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:18:35.857886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169629a1-f88f-4233-9b09-da7f3382aec9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:35.858302 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169629a1-f88f-4233-9b09-da7f3382aec9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:35.858424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169629a1-f88f-4233-9b09-da7f3382aec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:35.924107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-169629a1-f88f-4233-9b09-da7f3382aec9 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:18:35.925314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-169629a1-f88f-4233-9b09-da7f3382aec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:35.978278 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:36.023642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 745/1489] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:18:36.319487 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879d992-d6ea-41d0-8592-4236adcfdd64 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:18:36.321044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f879d992-d6ea-41d0-8592-4236adcfdd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:36.358850 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:36.427389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879d992-d6ea-41d0-8592-4236adcfdd64 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:18:36.501189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf6349-baf7-4077-a492-e902e8ae7bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:18:36.501829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf6349-baf7-4077-a492-e902e8ae7bbf service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:36.502111 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf6349-baf7-4077-a492-e902e8ae7bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:36.502385 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf6349-baf7-4077-a492-e902e8ae7bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:36.503971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-beaf6349-baf7-4077-a492-e902e8ae7bbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:36.584101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:36.612637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf6349-baf7-4077-a492-e902e8ae7bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:18:36.614098 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf6349-baf7-4077-a492-e902e8ae7bbf service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:18:36.632225 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 745/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:18:39.068288 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e20c6e-17df-4a1b-ba83-edf60bbd9760 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:39.068868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e20c6e-17df-4a1b-ba83-edf60bbd9760 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:39.068868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e20c6e-17df-4a1b-ba83-edf60bbd9760 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:39.070202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 746/1491] 10.222.0.57 () {54 vars in 927 bytes} [Tue Sep 27 17:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:18:39.075786 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dfb72-0eee-431f-b014-64cf35e9ecd6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:39.076199 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dfb72-0eee-431f-b014-64cf35e9ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:39.076332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dfb72-0eee-431f-b014-64cf35e9ecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:39.143412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-173dfb72-0eee-431f-b014-64cf35e9ecd6 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:18:39.144605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-173dfb72-0eee-431f-b014-64cf35e9ecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:39.240262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 746/1492] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Sep 27 17:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:18:39.539133 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e20c6e-17df-4a1b-ba83-edf60bbd9760 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:18:39.540642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-17e20c6e-17df-4a1b-ba83-edf60bbd9760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:39.644304 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e20c6e-17df-4a1b-ba83-edf60bbd9760 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:18:39.716350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da598ca-3eb7-4ca9-873c-8fa5f021846e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:18:39.716945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da598ca-3eb7-4ca9-873c-8fa5f021846e service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:18:39.717224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da598ca-3eb7-4ca9-873c-8fa5f021846e service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:18:39.717494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da598ca-3eb7-4ca9-873c-8fa5f021846e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:18:39.719093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7da598ca-3eb7-4ca9-873c-8fa5f021846e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:18:39.727428 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:39.827426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da598ca-3eb7-4ca9-873c-8fa5f021846e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:18:39.828854 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da598ca-3eb7-4ca9-873c-8fa5f021846e service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:18:39.847724 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 747/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:18:49.238720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=82 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:49.845437 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=50 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:19:59.625019 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc274a-0228-49c5-99fd-3ae13a9dd0ed None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:19:59.625612 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc274a-0228-49c5-99fd-3ae13a9dd0ed None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:19:59.625612 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc274a-0228-49c5-99fd-3ae13a9dd0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:19:59.701442 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-68cc274a-0228-49c5-99fd-3ae13a9dd0ed None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:19:59.702667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-68cc274a-0228-49c5-99fd-3ae13a9dd0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:19:59.799355 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 747/1494] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:19:59.807368 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2233d-5646-4e79-b411-38432074871e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:19:59.807866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2233d-5646-4e79-b411-38432074871e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:19:59.807973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2233d-5646-4e79-b411-38432074871e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:19:59.882165 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-aae2233d-5646-4e79-b411-38432074871e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:19:59.883371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-aae2233d-5646-4e79-b411-38432074871e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:19:59.978049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 748/1495] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:19:59.983465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc274a-0228-49c5-99fd-3ae13a9dd0ed None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:19:59.984684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-68cc274a-0228-49c5-99fd-3ae13a9dd0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:19:59.996007 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc274a-0228-49c5-99fd-3ae13a9dd0ed None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:20:00.057607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:20:00.090133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d31688-63a1-4a2e-98f6-9eec99ae03ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:20:00.090743 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d31688-63a1-4a2e-98f6-9eec99ae03ac admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:20:00.091537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d31688-63a1-4a2e-98f6-9eec99ae03ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:20:00.091823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d31688-63a1-4a2e-98f6-9eec99ae03ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:20:00.092457 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d31688-63a1-4a2e-98f6-9eec99ae03ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:20:00.092757 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d31688-63a1-4a2e-98f6-9eec99ae03ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:20:00.093791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: WARNING py.warnings [None req-23d31688-63a1-4a2e-98f6-9eec99ae03ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 17:20:00.093791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: warnings.warn(msg) Sep 27 17:20:00.093791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: Sep 27 17:20:00.094686 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d31688-63a1-4a2e-98f6-9eec99ae03ac admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:20:00.106409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 748/1496] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:20:00.115254 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2233d-5646-4e79-b411-38432074871e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:20:00.124474 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2233d-5646-4e79-b411-38432074871e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:20:00.184684 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:20:00.220118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f446d2d-561b-4803-b8a0-86ce366fbce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:20:00.220718 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f446d2d-561b-4803-b8a0-86ce366fbce2 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:20:00.220993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f446d2d-561b-4803-b8a0-86ce366fbce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:20:00.221264 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f446d2d-561b-4803-b8a0-86ce366fbce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:20:00.221933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f446d2d-561b-4803-b8a0-86ce366fbce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:20:00.223713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-7f446d2d-561b-4803-b8a0-86ce366fbce2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 17:20:00.223713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: warnings.warn(msg) Sep 27 17:20:00.223713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: Sep 27 17:20:00.224937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f446d2d-561b-4803-b8a0-86ce366fbce2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:20:00.283112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 749/1497] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:20:00 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:20:00.287264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d31688-63a1-4a2e-98f6-9eec99ae03ac admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:20:00.288845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-23d31688-63a1-4a2e-98f6-9eec99ae03ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:20:00.320908 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d31688-63a1-4a2e-98f6-9eec99ae03ac admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:20:00.414611 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea5606-423a-44d7-941f-8a8375bc57f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:20:00.415210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea5606-423a-44d7-941f-8a8375bc57f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:20:00.415485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea5606-423a-44d7-941f-8a8375bc57f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:20:00.415750 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea5606-423a-44d7-941f-8a8375bc57f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:20:00.416378 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea5606-423a-44d7-941f-8a8375bc57f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:20:00.417375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: WARNING py.warnings [None req-58ea5606-423a-44d7-941f-8a8375bc57f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 17:20:00.417375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: warnings.warn(msg) Sep 27 17:20:00.417375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: Sep 27 17:20:00.418606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea5606-423a-44d7-941f-8a8375bc57f6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:20:00.462162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 749/1498] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:20:00 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:20:00.466864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f446d2d-561b-4803-b8a0-86ce366fbce2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:20:00.468365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7f446d2d-561b-4803-b8a0-86ce366fbce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:20:00.530978 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f446d2d-561b-4803-b8a0-86ce366fbce2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:20:00.615065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:20:00.626944 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289a574-50c1-4d2d-82ed-ae865d2da2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:20:00.627561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289a574-50c1-4d2d-82ed-ae865d2da2aa admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:20:00.627819 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289a574-50c1-4d2d-82ed-ae865d2da2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:20:00.628085 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289a574-50c1-4d2d-82ed-ae865d2da2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:20:00.628710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289a574-50c1-4d2d-82ed-ae865d2da2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:20:00.629737 dv-cinder-849143-8-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-1289a574-50c1-4d2d-82ed-ae865d2da2aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 17:20:00.629737 dv-cinder-849143-8-smb devstack@keystone.service[81379]: warnings.warn(msg) Sep 27 17:20:00.629737 dv-cinder-849143-8-smb devstack@keystone.service[81379]: Sep 27 17:20:00.630618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289a574-50c1-4d2d-82ed-ae865d2da2aa admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:20:00.642792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 750/1499] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:20:00.647078 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea5606-423a-44d7-941f-8a8375bc57f6 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:20:00.648596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-58ea5606-423a-44d7-941f-8a8375bc57f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:20:00.660509 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea5606-423a-44d7-941f-8a8375bc57f6 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:20:00.685614 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:20:00.755366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d0e5f-07b1-4fef-9def-c09b1223ee8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:20:00.755971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d0e5f-07b1-4fef-9def-c09b1223ee8b admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:20:00.756248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d0e5f-07b1-4fef-9def-c09b1223ee8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:20:00.756514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d0e5f-07b1-4fef-9def-c09b1223ee8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:20:00.757149 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d0e5f-07b1-4fef-9def-c09b1223ee8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:20:00.758179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: WARNING py.warnings [None req-c38d0e5f-07b1-4fef-9def-c09b1223ee8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 17:20:00.758179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: warnings.warn(msg) Sep 27 17:20:00.758179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: Sep 27 17:20:00.759062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d0e5f-07b1-4fef-9def-c09b1223ee8b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:20:00.771150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 750/1500] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:20:00.775478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289a574-50c1-4d2d-82ed-ae865d2da2aa admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:20:00.777015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1289a574-50c1-4d2d-82ed-ae865d2da2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:20:00.811142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289a574-50c1-4d2d-82ed-ae865d2da2aa admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:20:00.904676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26312736-64f9-4980-a2fd-c6d8f30989ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:20:00.905252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26312736-64f9-4980-a2fd-c6d8f30989ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:20:00.905533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26312736-64f9-4980-a2fd-c6d8f30989ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:20:00.905833 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26312736-64f9-4980-a2fd-c6d8f30989ff admin admin] PATH_INFO: `/v3/projects/07d303bb34824a7d8fc6f12c7475e266/users/0f5c337733a04545bcda2c1c622ecabf/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:20:00.927867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26312736-64f9-4980-a2fd-c6d8f30989ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d303bb34824a7d8fc6f12c7475e266, user_id=0f5c337733a04545bcda2c1c622ecabf, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:20:00.928900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-26312736-64f9-4980-a2fd-c6d8f30989ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 17:20:00.928900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: warnings.warn(msg) Sep 27 17:20:00.928900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: Sep 27 17:20:00.930852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26312736-64f9-4980-a2fd-c6d8f30989ff admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:20:00.955272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 751/1501] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:20:00 2022] PUT /identity/v3/projects/07d303bb34824a7d8fc6f12c7475e266/users/0f5c337733a04545bcda2c1c622ecabf/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:20:00.968208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab3657-e799-40f3-bb26-886b21072172 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:20:00.968498 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab3657-e799-40f3-bb26-886b21072172 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:20:00.968772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab3657-e799-40f3-bb26-886b21072172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:20:01.027854 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ddab3657-e799-40f3-bb26-886b21072172 None None] MFA Rules not processed for user `0f5c337733a04545bcda2c1c622ecabf`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:20:01.029789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ddab3657-e799-40f3-bb26-886b21072172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:20:01.107008 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 751/1502] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:20:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:20:01.120451 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22331d-494b-4526-b0fa-c79ff74dbb68 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:20:01.120735 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22331d-494b-4526-b0fa-c79ff74dbb68 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:20:01.121002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22331d-494b-4526-b0fa-c79ff74dbb68 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:20:01.122574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 752/1503] 10.222.0.57 () {54 vars in 963 bytes} [Tue Sep 27 17:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:20:01.127284 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f1f2-42e5-4bd5-90f3-e1e99eda34cd None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:20:01.127568 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f1f2-42e5-4bd5-90f3-e1e99eda34cd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:20:01.127842 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f1f2-42e5-4bd5-90f3-e1e99eda34cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:20:01.159793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:20:01.203727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0f01f1f2-42e5-4bd5-90f3-e1e99eda34cd None None] MFA Rules not processed for user `2c57bac4e0f54d2596fe1fda9a7dfc76`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:20:01.204929 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0f01f1f2-42e5-4bd5-90f3-e1e99eda34cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:20:01.280075 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 752/1504] 10.222.0.57 () {58 vars in 1060 bytes} [Tue Sep 27 17:20:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:20:01.287986 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22331d-494b-4526-b0fa-c79ff74dbb68 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:20:01.289541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2d22331d-494b-4526-b0fa-c79ff74dbb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:20:01.339909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:20:01.393919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22331d-494b-4526-b0fa-c79ff74dbb68 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:20:01.468376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8f473-3a91-480b-bf1e-9f15d5210f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:20:01.468979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8f473-3a91-480b-bf1e-9f15d5210f03 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:20:01.469260 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8f473-3a91-480b-bf1e-9f15d5210f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:20:01.469541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8f473-3a91-480b-bf1e-9f15d5210f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:20:01.471186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-06e8f473-3a91-480b-bf1e-9f15d5210f03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:20:01.570074 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8f473-3a91-480b-bf1e-9f15d5210f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:20:01.571507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8f473-3a91-480b-bf1e-9f15d5210f03 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:20:01.574948 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:20:01.590141 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 753/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:20:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:20:01.636762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f6f0a-1984-40b6-849f-e04c83dc2426 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:20:01.637105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f6f0a-1984-40b6-849f-e04c83dc2426 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:20:01.637384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f6f0a-1984-40b6-849f-e04c83dc2426 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:20:01.638882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 753/1506] 10.222.0.57 () {52 vars in 830 bytes} [Tue Sep 27 17:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:20:01.642538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8f473-3a91-480b-bf1e-9f15d5210f03 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:20:01.643750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-06e8f473-3a91-480b-bf1e-9f15d5210f03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:20:01.743421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8f473-3a91-480b-bf1e-9f15d5210f03 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:20:01.834361 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8730b-560b-4a88-8900-714e95690b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:20:01.835017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8730b-560b-4a88-8900-714e95690b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:20:01.835241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8730b-560b-4a88-8900-714e95690b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:20:01.835508 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8730b-560b-4a88-8900-714e95690b14 admin admin] PATH_INFO: `/v3/users/0f5c337733a04545bcda2c1c622ecabf` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:20:01.848489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8730b-560b-4a88-8900-714e95690b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f5c337733a04545bcda2c1c622ecabf)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:20:01.849509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-c1f8730b-560b-4a88-8900-714e95690b14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 17:20:01.849509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: warnings.warn(msg) Sep 27 17:20:01.849509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: Sep 27 17:20:01.850769 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8730b-560b-4a88-8900-714e95690b14 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:20:01.861239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:20:01.915679 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c1f8730b-560b-4a88-8900-714e95690b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f5c337733a04545bcda2c1c622ecabf'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:20:01.925235 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c1f8730b-560b-4a88-8900-714e95690b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f5c337733a04545bcda2c1c622ecabf'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:20:01.948953 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c1f8730b-560b-4a88-8900-714e95690b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f5c337733a04545bcda2c1c622ecabf'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:20:01.962417 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c1f8730b-560b-4a88-8900-714e95690b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f5c337733a04545bcda2c1c622ecabf'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:20:01.962867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c1f8730b-560b-4a88-8900-714e95690b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f5c337733a04545bcda2c1c622ecabf'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:20:01.969013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 754/1507] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:20:01 2022] DELETE /identity/v3/users/0f5c337733a04545bcda2c1c622ecabf => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:20:01.973603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a24c3-2126-4628-b558-f9a216ae361a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:20:01.974110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a24c3-2126-4628-b558-f9a216ae361a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:20:01.974208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a24c3-2126-4628-b558-f9a216ae361a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:20:02.031082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-573a24c3-2126-4628-b558-f9a216ae361a None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:20:02.032203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-573a24c3-2126-4628-b558-f9a216ae361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:20:02.106614 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:20:02.120282 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 754/1508] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:20:02.130165 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8730b-560b-4a88-8900-714e95690b14 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:20:02.131377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c1f8730b-560b-4a88-8900-714e95690b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:20:02.236917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8730b-560b-4a88-8900-714e95690b14 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:20:02.413240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:20:02.434223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43b184-fcb8-4679-a33c-e16b696bbef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:20:02.434857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43b184-fcb8-4679-a33c-e16b696bbef9 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:20:02.435738 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43b184-fcb8-4679-a33c-e16b696bbef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:20:02.436007 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43b184-fcb8-4679-a33c-e16b696bbef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:20:02.437628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ad43b184-fcb8-4679-a33c-e16b696bbef9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:20:02.545811 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43b184-fcb8-4679-a33c-e16b696bbef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:20:02.547247 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43b184-fcb8-4679-a33c-e16b696bbef9 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:20:02.565530 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 755/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:20:02.905180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a24c3-2126-4628-b558-f9a216ae361a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:20:02.906536 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-573a24c3-2126-4628-b558-f9a216ae361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:20:02.917979 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a24c3-2126-4628-b558-f9a216ae361a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:20:03.017983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:20:03.018640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:20:03.018883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:20:03.019162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5 admin admin] PATH_INFO: `/v3/projects/07d303bb34824a7d8fc6f12c7475e266` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:20:03.029740 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d303bb34824a7d8fc6f12c7475e266)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:20:03.030768 dv-cinder-849143-8-smb devstack@keystone.service[81378]: WARNING py.warnings [None req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 17:20:03.030768 dv-cinder-849143-8-smb devstack@keystone.service[81378]: warnings.warn(msg) Sep 27 17:20:03.030768 dv-cinder-849143-8-smb devstack@keystone.service[81378]: Sep 27 17:20:03.031993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:20:03.089944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d303bb34824a7d8fc6f12c7475e266', 'request_id': 'req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:20:03.096859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d303bb34824a7d8fc6f12c7475e266', 'request_id': 'req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:20:03.111193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d303bb34824a7d8fc6f12c7475e266', 'request_id': 'req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:20:03.135895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5 admin admin] The token cache is being invalidate because project 07d303bb34824a7d8fc6f12c7475e266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:20:03.136185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:20:03.136702 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4000ad6-e4a4-41b4-9d7c-43a1c77a7ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:20:03.138586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 755/1510] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:20:02 2022] DELETE /identity/v3/projects/07d303bb34824a7d8fc6f12c7475e266 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:20:12.563314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=62 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:20:13.133970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:21:30.457178 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c5767-4a70-4f62-b472-00469ec0ac5f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:30.457644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c5767-4a70-4f62-b472-00469ec0ac5f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:30.457772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c5767-4a70-4f62-b472-00469ec0ac5f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:30.459094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 17:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:21:30.463917 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017d7e-8d1b-412a-be37-e745068693ba None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:30.464378 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017d7e-8d1b-412a-be37-e745068693ba None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:30.464484 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017d7e-8d1b-412a-be37-e745068693ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:30.548467 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d3017d7e-8d1b-412a-be37-e745068693ba None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:21:30.549714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d3017d7e-8d1b-412a-be37-e745068693ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:21:30.651730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 17:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:21:30.808008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c5767-4a70-4f62-b472-00469ec0ac5f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:21:30.810203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-430c5767-4a70-4f62-b472-00469ec0ac5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:21:30.930294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c5767-4a70-4f62-b472-00469ec0ac5f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:21:30.936281 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea914c-8cbf-4bbb-b08a-f48099722d45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:21:30.937069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea914c-8cbf-4bbb-b08a-f48099722d45 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:30.937382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea914c-8cbf-4bbb-b08a-f48099722d45 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:30.937656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea914c-8cbf-4bbb-b08a-f48099722d45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:30.947157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea914c-8cbf-4bbb-b08a-f48099722d45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:21:30.948814 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea914c-8cbf-4bbb-b08a-f48099722d45 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:21:30.958822 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 757/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:21:32.110497 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f85d6-0ec7-447c-9dbb-692ec83cc4ab None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:32.111144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f85d6-0ec7-447c-9dbb-692ec83cc4ab None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:32.111144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f85d6-0ec7-447c-9dbb-692ec83cc4ab None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:32.112657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 17:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:21:32.119762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2933db-6330-4540-be62-5d00916d266c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:32.120169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2933db-6330-4540-be62-5d00916d266c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:32.120298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2933db-6330-4540-be62-5d00916d266c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:32.142798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0a2933db-6330-4540-be62-5d00916d266c None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:21:32.143982 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0a2933db-6330-4540-be62-5d00916d266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:21:32.152748 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 17:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:21:32.326077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f85d6-0ec7-447c-9dbb-692ec83cc4ab None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:21:32.342075 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f85d6-0ec7-447c-9dbb-692ec83cc4ab None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:21:32.349268 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ae664-48e0-4730-a66b-3ea15eb784aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:21:32.350048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ae664-48e0-4730-a66b-3ea15eb784aa service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:32.350334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ae664-48e0-4730-a66b-3ea15eb784aa service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:32.350606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ae664-48e0-4730-a66b-3ea15eb784aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:32.360991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ae664-48e0-4730-a66b-3ea15eb784aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:21:32.362596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ae664-48e0-4730-a66b-3ea15eb784aa service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:21:32.374085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 758/1516] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:21:32.582697 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b074b-741c-47fe-8520-8e048ca9d50b None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:32.582978 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b074b-741c-47fe-8520-8e048ca9d50b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:32.583247 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b074b-741c-47fe-8520-8e048ca9d50b None None] PATH_INFO: `/v3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:32.584508 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 759/1517] 10.222.0.48 () {54 vars in 925 bytes} [Tue Sep 27 17:21:32 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:21:32.590527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e46434-5f58-4b0d-bab8-19873adb5c4f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:32.590812 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e46434-5f58-4b0d-bab8-19873adb5c4f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:32.591170 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e46434-5f58-4b0d-bab8-19873adb5c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:32.654389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-10e46434-5f58-4b0d-bab8-19873adb5c4f None None] MFA Rules not processed for user `08cedb97f3c84faeaeef2b3209356842`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:21:32.655514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-10e46434-5f58-4b0d-bab8-19873adb5c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:21:32.673933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:21:32.732081 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 759/1518] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Sep 27 17:21:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:21:36.310372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63c7b-c845-4d4c-8f0e-f92710c3e605 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:36.310803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63c7b-c845-4d4c-8f0e-f92710c3e605 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:36.310905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63c7b-c845-4d4c-8f0e-f92710c3e605 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:36.312257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 760/1519] 10.222.0.57 () {54 vars in 961 bytes} [Tue Sep 27 17:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:21:36.317187 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c8b49-44be-4242-a53e-b16e452a9b25 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:36.317613 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c8b49-44be-4242-a53e-b16e452a9b25 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:36.317771 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c8b49-44be-4242-a53e-b16e452a9b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:36.337340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4b1c8b49-44be-4242-a53e-b16e452a9b25 None None] MFA Rules not processed for user `08cedb97f3c84faeaeef2b3209356842`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:21:36.338561 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4b1c8b49-44be-4242-a53e-b16e452a9b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:21:36.348128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 760/1520] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Sep 27 17:21:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:21:36.355553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63c7b-c845-4d4c-8f0e-f92710c3e605 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:21:36.368919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63c7b-c845-4d4c-8f0e-f92710c3e605 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:21:36.374279 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11334da0-e4a1-41e8-b498-a4be1fe7f737 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cedb97f3c84faeaeef2b3209356842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:21:36.374824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11334da0-e4a1-41e8-b498-a4be1fe7f737 service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:36.375104 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11334da0-e4a1-41e8-b498-a4be1fe7f737 service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:36.375401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11334da0-e4a1-41e8-b498-a4be1fe7f737 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:36.384128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11334da0-e4a1-41e8-b498-a4be1fe7f737 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:21:36.385782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11334da0-e4a1-41e8-b498-a4be1fe7f737 service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:21:36.396232 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 761/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:21:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:21:43.873761 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2c1fa-dfb9-466d-a4e5-b877431774fa None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:43.874412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2c1fa-dfb9-466d-a4e5-b877431774fa None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:43.874412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2c1fa-dfb9-466d-a4e5-b877431774fa None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:43.875732 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 17:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:21:43.882010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee9df9-3934-40f1-9db5-c6bab49631d2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:43.882476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee9df9-3934-40f1-9db5-c6bab49631d2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:43.882580 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee9df9-3934-40f1-9db5-c6bab49631d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:43.902199 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ecee9df9-3934-40f1-9db5-c6bab49631d2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:21:43.903398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ecee9df9-3934-40f1-9db5-c6bab49631d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:21:43.911754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 17:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:21:44.065909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2c1fa-dfb9-466d-a4e5-b877431774fa None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:21:44.080537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2c1fa-dfb9-466d-a4e5-b877431774fa None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:21:44.085934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814b5bf-1985-4ba8-9cc7-5e0cd59e7395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:21:44.086528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814b5bf-1985-4ba8-9cc7-5e0cd59e7395 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:44.086808 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814b5bf-1985-4ba8-9cc7-5e0cd59e7395 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:44.087079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814b5bf-1985-4ba8-9cc7-5e0cd59e7395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:44.095548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814b5bf-1985-4ba8-9cc7-5e0cd59e7395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:21:44.097147 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814b5bf-1985-4ba8-9cc7-5e0cd59e7395 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:21:44.106448 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 762/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:21:45.214122 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a7f3c-71ba-476f-ad89-ecc00a5a5472 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:45.214732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a7f3c-71ba-476f-ad89-ecc00a5a5472 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:45.214732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a7f3c-71ba-476f-ad89-ecc00a5a5472 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:45.215967 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 17:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:21:45.222550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f27c2b-166d-4cd0-baf9-34dcfb32720b None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:45.223006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f27c2b-166d-4cd0-baf9-34dcfb32720b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:45.223119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f27c2b-166d-4cd0-baf9-34dcfb32720b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:45.242923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a3f27c2b-166d-4cd0-baf9-34dcfb32720b None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:21:45.244104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a3f27c2b-166d-4cd0-baf9-34dcfb32720b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:21:45.252324 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 17:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:21:45.405166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a7f3c-71ba-476f-ad89-ecc00a5a5472 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:21:45.420333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a7f3c-71ba-476f-ad89-ecc00a5a5472 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:21:45.426411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef90104-a63b-4e3a-a330-b9cea27632c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:21:45.427006 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef90104-a63b-4e3a-a330-b9cea27632c7 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:45.427282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef90104-a63b-4e3a-a330-b9cea27632c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:45.427551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef90104-a63b-4e3a-a330-b9cea27632c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:45.435678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef90104-a63b-4e3a-a330-b9cea27632c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:21:45.437235 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef90104-a63b-4e3a-a330-b9cea27632c7 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:21:45.446838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 764/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:21:49.483197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7784e8-368a-4e51-937d-3896af6b577a None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:49.483730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7784e8-368a-4e51-937d-3896af6b577a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:49.483730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7784e8-368a-4e51-937d-3896af6b577a None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:49.485074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 17:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:21:49.490279 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0882c-f429-489e-9232-c7b44579ff24 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:49.490704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0882c-f429-489e-9232-c7b44579ff24 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:49.490816 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0882c-f429-489e-9232-c7b44579ff24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:49.510676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-60b0882c-f429-489e-9232-c7b44579ff24 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:21:49.511852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-60b0882c-f429-489e-9232-c7b44579ff24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:21:49.520600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 17:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:21:49.811618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7784e8-368a-4e51-937d-3896af6b577a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:21:49.813294 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bb7784e8-368a-4e51-937d-3896af6b577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:21:49.890941 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7784e8-368a-4e51-937d-3896af6b577a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:21:49.894549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b973112-41fc-4177-89e9-23f19717d5f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:21:49.895144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b973112-41fc-4177-89e9-23f19717d5f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:49.895417 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b973112-41fc-4177-89e9-23f19717d5f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:49.895682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b973112-41fc-4177-89e9-23f19717d5f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:49.904265 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b973112-41fc-4177-89e9-23f19717d5f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:21:49.905665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b973112-41fc-4177-89e9-23f19717d5f2 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:21:49.915310 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 765/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:21:52.061146 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8603e8e-1a13-4d41-89b8-f133ecc81f38 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:52.061750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8603e8e-1a13-4d41-89b8-f133ecc81f38 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:52.061750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8603e8e-1a13-4d41-89b8-f133ecc81f38 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:52.063089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 17:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:21:52.069054 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8929a-c613-42c9-8a25-ee29477351f1 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:52.069498 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8929a-c613-42c9-8a25-ee29477351f1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:52.069595 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8929a-c613-42c9-8a25-ee29477351f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:52.090212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ebf8929a-c613-42c9-8a25-ee29477351f1 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:21:52.091406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ebf8929a-c613-42c9-8a25-ee29477351f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:21:52.099563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 17:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:21:52.388164 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8603e8e-1a13-4d41-89b8-f133ecc81f38 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:21:52.399649 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8603e8e-1a13-4d41-89b8-f133ecc81f38 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:21:52.403182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d704b9f-1405-4ef7-9e43-06cdfd4493eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:21:52.403771 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d704b9f-1405-4ef7-9e43-06cdfd4493eb service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:52.404048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d704b9f-1405-4ef7-9e43-06cdfd4493eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:52.404317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d704b9f-1405-4ef7-9e43-06cdfd4493eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:52.413374 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d704b9f-1405-4ef7-9e43-06cdfd4493eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:21:52.414983 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d704b9f-1405-4ef7-9e43-06cdfd4493eb service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:21:52.424846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 767/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:21:56.368339 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654f363-42d4-439d-9e3d-e9ff0680557c None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:56.368899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654f363-42d4-439d-9e3d-e9ff0680557c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:56.368899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654f363-42d4-439d-9e3d-e9ff0680557c None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:56.370269 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 17:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:21:56.375399 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2ab5f-9fb6-4dcb-9f78-4ced54ef72ef None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:56.375825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2ab5f-9fb6-4dcb-9f78-4ced54ef72ef None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:56.375955 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2ab5f-9fb6-4dcb-9f78-4ced54ef72ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:56.384371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=81 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:21:56.397735 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-55e2ab5f-9fb6-4dcb-9f78-4ced54ef72ef None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:21:56.398935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-55e2ab5f-9fb6-4dcb-9f78-4ced54ef72ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:21:56.406755 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 17:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:21:56.709094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654f363-42d4-439d-9e3d-e9ff0680557c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:21:56.710813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3654f363-42d4-439d-9e3d-e9ff0680557c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:21:56.775437 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:21:56.789077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654f363-42d4-439d-9e3d-e9ff0680557c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:21:56.792697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c40da2-76a3-4d4c-9a6f-35f6837b7163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:21:56.793300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c40da2-76a3-4d4c-9a6f-35f6837b7163 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:56.793579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c40da2-76a3-4d4c-9a6f-35f6837b7163 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:56.793881 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c40da2-76a3-4d4c-9a6f-35f6837b7163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:56.802881 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c40da2-76a3-4d4c-9a6f-35f6837b7163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:21:56.804302 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c40da2-76a3-4d4c-9a6f-35f6837b7163 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:21:56.813515 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 768/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:21:58.936282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e25c3c-3f94-494b-80d5-40506c42a7cf None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:58.936852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e25c3c-3f94-494b-80d5-40506c42a7cf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:58.936852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e25c3c-3f94-494b-80d5-40506c42a7cf None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:58.938185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 27 17:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:21:58.943448 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a45aa-4b78-4b0a-8f42-84ed5b215c86 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:58.943857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a45aa-4b78-4b0a-8f42-84ed5b215c86 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:58.944004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a45aa-4b78-4b0a-8f42-84ed5b215c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:58.963192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-917a45aa-4b78-4b0a-8f42-84ed5b215c86 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:21:58.964392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-917a45aa-4b78-4b0a-8f42-84ed5b215c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:21:58.973112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 27 17:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:21:59.276452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e25c3c-3f94-494b-80d5-40506c42a7cf None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:21:59.278151 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-97e25c3c-3f94-494b-80d5-40506c42a7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:21:59.291588 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e25c3c-3f94-494b-80d5-40506c42a7cf None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:21:59.295152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a71beb-bca8-4210-88f4-c411e30b4fe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:21:59.295734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a71beb-bca8-4210-88f4-c411e30b4fe2 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:21:59.296014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a71beb-bca8-4210-88f4-c411e30b4fe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:21:59.296287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a71beb-bca8-4210-88f4-c411e30b4fe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:21:59.305870 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a71beb-bca8-4210-88f4-c411e30b4fe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:21:59.307279 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a71beb-bca8-4210-88f4-c411e30b4fe2 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:21:59.316879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 770/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:22:08.958435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=11 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:22:09.312481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=8 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:25.506864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb5ed6-a426-4f85-aa4d-432c1308b6f9 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:25.506864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb5ed6-a426-4f85-aa4d-432c1308b6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:25.506864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb5ed6-a426-4f85-aa4d-432c1308b6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:25.533664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-65cb5ed6-a426-4f85-aa4d-432c1308b6f9 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:25.534952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-65cb5ed6-a426-4f85-aa4d-432c1308b6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:25.547876 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 770/1540] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:25.557865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d993bdb-3d1d-4c85-bb66-15cee91df5b8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:25.558564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d993bdb-3d1d-4c85-bb66-15cee91df5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:25.558564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d993bdb-3d1d-4c85-bb66-15cee91df5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:25.586938 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6d993bdb-3d1d-4c85-bb66-15cee91df5b8 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:25.588582 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6d993bdb-3d1d-4c85-bb66-15cee91df5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:25.602655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 771/1541] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:25.607711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb5ed6-a426-4f85-aa4d-432c1308b6f9 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:25.619158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb5ed6-a426-4f85-aa4d-432c1308b6f9 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:25.630907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b650a3-12f1-45a9-b30c-a8006cda7aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:25.631560 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b650a3-12f1-45a9-b30c-a8006cda7aec admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:25.631840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b650a3-12f1-45a9-b30c-a8006cda7aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:25.632112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b650a3-12f1-45a9-b30c-a8006cda7aec admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:25.632767 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b650a3-12f1-45a9-b30c-a8006cda7aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:23:25.633075 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b650a3-12f1-45a9-b30c-a8006cda7aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:25.634706 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b650a3-12f1-45a9-b30c-a8006cda7aec admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:25.652679 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 771/1542] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:23:25.661050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d993bdb-3d1d-4c85-bb66-15cee91df5b8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:25.673135 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d993bdb-3d1d-4c85-bb66-15cee91df5b8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:25.683568 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabf60b-f9bb-42b8-a41c-c0de5af1e9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:25.684566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabf60b-f9bb-42b8-a41c-c0de5af1e9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:25.685068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabf60b-f9bb-42b8-a41c-c0de5af1e9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:25.685570 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabf60b-f9bb-42b8-a41c-c0de5af1e9c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:25.686470 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabf60b-f9bb-42b8-a41c-c0de5af1e9c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:25.688883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabf60b-f9bb-42b8-a41c-c0de5af1e9c2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:25.754739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 772/1543] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:25 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:25.759366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b650a3-12f1-45a9-b30c-a8006cda7aec admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:25.763431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b3fd7-c9c5-40b8-b550-0061510e12c7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:25.764037 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b3fd7-c9c5-40b8-b550-0061510e12c7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:25.764535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b3fd7-c9c5-40b8-b550-0061510e12c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:25.775666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b650a3-12f1-45a9-b30c-a8006cda7aec admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:25.790754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b71b3fd7-c9c5-40b8-b550-0061510e12c7 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:25.792941 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b71b3fd7-c9c5-40b8-b550-0061510e12c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:25.868458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 773/1544] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:25.870141 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c70d24-7d82-42fc-b589-7fabfab2e5d6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:25.870660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c70d24-7d82-42fc-b589-7fabfab2e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:25.871156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c70d24-7d82-42fc-b589-7fabfab2e5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:25.883871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dab098-0fca-4dd3-b3ef-4d964829930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:25.884500 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dab098-0fca-4dd3-b3ef-4d964829930e admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:25.884782 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dab098-0fca-4dd3-b3ef-4d964829930e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:25.885057 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dab098-0fca-4dd3-b3ef-4d964829930e admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:25.885711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dab098-0fca-4dd3-b3ef-4d964829930e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:25.887768 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dab098-0fca-4dd3-b3ef-4d964829930e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:25.895758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-24c70d24-7d82-42fc-b589-7fabfab2e5d6 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:25.897458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-24c70d24-7d82-42fc-b589-7fabfab2e5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:25.906181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 774/1545] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:25.907671 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3252631-ca84-4129-a782-8564b8d02ef2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:25.908260 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3252631-ca84-4129-a782-8564b8d02ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:25.908745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3252631-ca84-4129-a782-8564b8d02ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:25.925020 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 772/1546] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:25 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:25.925987 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a59abf-eaca-4a23-8e90-94e5797e143e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:25.926280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a59abf-eaca-4a23-8e90-94e5797e143e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:25.926553 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a59abf-eaca-4a23-8e90-94e5797e143e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:25.941720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d3252631-ca84-4129-a782-8564b8d02ef2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:25.943831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d3252631-ca84-4129-a782-8564b8d02ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:25.953109 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 775/1547] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:25.954667 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5da31-5d91-48be-b8c0-783275a001db None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:25.955197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5da31-5d91-48be-b8c0-783275a001db None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:25.955735 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5da31-5d91-48be-b8c0-783275a001db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:25.969706 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-39a59abf-eaca-4a23-8e90-94e5797e143e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:25.971194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-39a59abf-eaca-4a23-8e90-94e5797e143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:25.978547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b0a5da31-5d91-48be-b8c0-783275a001db None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:25.980384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b0a5da31-5d91-48be-b8c0-783275a001db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:25.989220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 776/1548] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:25.990731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5da31-5d91-48be-b8c0-783275a001db None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:25.991173 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 773/1549] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:25.991942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a59abf-eaca-4a23-8e90-94e5797e143e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.002692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5da31-5d91-48be-b8c0-783275a001db None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.006403 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a59abf-eaca-4a23-8e90-94e5797e143e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.009042 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86182d1-c8bb-4609-81bc-485436fbc1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.010294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86182d1-c8bb-4609-81bc-485436fbc1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.010810 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86182d1-c8bb-4609-81bc-485436fbc1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.011313 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86182d1-c8bb-4609-81bc-485436fbc1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.012177 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86182d1-c8bb-4609-81bc-485436fbc1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.014464 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86182d1-c8bb-4609-81bc-485436fbc1e5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.018191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d25c7f-28d1-46c7-b6a8-d403e2ef0e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.018820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d25c7f-28d1-46c7-b6a8-d403e2ef0e48 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.019099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d25c7f-28d1-46c7-b6a8-d403e2ef0e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.019372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d25c7f-28d1-46c7-b6a8-d403e2ef0e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.020015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d25c7f-28d1-46c7-b6a8-d403e2ef0e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:23:26.020321 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d25c7f-28d1-46c7-b6a8-d403e2ef0e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.022708 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d25c7f-28d1-46c7-b6a8-d403e2ef0e48 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.037792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 777/1550] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:26.038886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86182d1-c8bb-4609-81bc-485436fbc1e5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.050620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86182d1-c8bb-4609-81bc-485436fbc1e5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.051747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 774/1551] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:23:26.054299 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea9d22-f5b7-47d8-8095-3ba25da535a2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.054588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea9d22-f5b7-47d8-8095-3ba25da535a2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.054864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea9d22-f5b7-47d8-8095-3ba25da535a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.056629 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45392212-26c8-4453-913f-226c1bd3ad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.057349 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45392212-26c8-4453-913f-226c1bd3ad61 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.057899 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45392212-26c8-4453-913f-226c1bd3ad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.058321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45392212-26c8-4453-913f-226c1bd3ad61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.059240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45392212-26c8-4453-913f-226c1bd3ad61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:23:26.059760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45392212-26c8-4453-913f-226c1bd3ad61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.061186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-45392212-26c8-4453-913f-226c1bd3ad61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 17:23:26.061186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: warnings.warn(msg) Sep 27 17:23:26.061186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: Sep 27 17:23:26.062551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45392212-26c8-4453-913f-226c1bd3ad61 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.077080 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 778/1552] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:23:26.077480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-90ea9d22-f5b7-47d8-8095-3ba25da535a2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:26.078174 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45392212-26c8-4453-913f-226c1bd3ad61 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.078990 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-90ea9d22-f5b7-47d8-8095-3ba25da535a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:26.088326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 775/1553] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:26.089794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38877403-3cbc-4728-9278-1498681b1eda None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.090150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38877403-3cbc-4728-9278-1498681b1eda None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.090495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38877403-3cbc-4728-9278-1498681b1eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.090612 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45392212-26c8-4453-913f-226c1bd3ad61 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.096191 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b8fb8-8a83-40e1-a437-6542c100b15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.096891 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b8fb8-8a83-40e1-a437-6542c100b15e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.097293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b8fb8-8a83-40e1-a437-6542c100b15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.097533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b8fb8-8a83-40e1-a437-6542c100b15e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.098209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b8fb8-8a83-40e1-a437-6542c100b15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.100486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b8fb8-8a83-40e1-a437-6542c100b15e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.111298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 779/1554] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:26.114461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb09a7-45f6-49cb-9ead-62993fac6c8d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.114634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-38877403-3cbc-4728-9278-1498681b1eda None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:26.114763 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb09a7-45f6-49cb-9ead-62993fac6c8d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.114763 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb09a7-45f6-49cb-9ead-62993fac6c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.115039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-38877403-3cbc-4728-9278-1498681b1eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:26.123195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 776/1555] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:26.124194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38877403-3cbc-4728-9278-1498681b1eda None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.134857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-48bb09a7-45f6-49cb-9ead-62993fac6c8d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:26.135515 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38877403-3cbc-4728-9278-1498681b1eda None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.136144 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-48bb09a7-45f6-49cb-9ead-62993fac6c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:26.141335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7114816-c51b-4371-8e38-88db97cb6ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.141972 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7114816-c51b-4371-8e38-88db97cb6ecd admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.142249 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7114816-c51b-4371-8e38-88db97cb6ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.142518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7114816-c51b-4371-8e38-88db97cb6ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.143141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7114816-c51b-4371-8e38-88db97cb6ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.144139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: WARNING py.warnings [None req-e7114816-c51b-4371-8e38-88db97cb6ecd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 17:23:26.144139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: warnings.warn(msg) Sep 27 17:23:26.144139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: Sep 27 17:23:26.144921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 780/1556] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:26.145305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7114816-c51b-4371-8e38-88db97cb6ecd admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.146489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb09a7-45f6-49cb-9ead-62993fac6c8d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.156293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb09a7-45f6-49cb-9ead-62993fac6c8d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.161102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe0004-3323-4701-b84a-81155e29a616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.161821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe0004-3323-4701-b84a-81155e29a616 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.162115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe0004-3323-4701-b84a-81155e29a616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.162394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe0004-3323-4701-b84a-81155e29a616 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.163042 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe0004-3323-4701-b84a-81155e29a616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.164924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe0004-3323-4701-b84a-81155e29a616 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.175116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 777/1557] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:26.176001 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7114816-c51b-4371-8e38-88db97cb6ecd admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.196108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 781/1558] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:26.197348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494adc7-c6cc-44e7-a14c-f5dc16686249 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.197638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494adc7-c6cc-44e7-a14c-f5dc16686249 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.197953 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494adc7-c6cc-44e7-a14c-f5dc16686249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.217012 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2494adc7-c6cc-44e7-a14c-f5dc16686249 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:26.218239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2494adc7-c6cc-44e7-a14c-f5dc16686249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:26.244570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7114816-c51b-4371-8e38-88db97cb6ecd admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.252689 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:26.263916 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:26.283769 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 782/1559] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:26.284447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494adc7-c6cc-44e7-a14c-f5dc16686249 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.296232 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494adc7-c6cc-44e7-a14c-f5dc16686249 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.300825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84ebef-07d1-4575-991c-ab5554821596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.301493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84ebef-07d1-4575-991c-ab5554821596 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.302012 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84ebef-07d1-4575-991c-ab5554821596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.303229 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84ebef-07d1-4575-991c-ab5554821596 admin admin] PATH_INFO: `/v3/projects/857d90442c4b4fc8b5b7fdf1f24963de/users/41d1e8b097a14cba91218e7a9b32f6e0/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.310987 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4383e5-7714-41fe-af3f-a0069df5f0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.311635 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4383e5-7714-41fe-af3f-a0069df5f0bd admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.311917 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4383e5-7714-41fe-af3f-a0069df5f0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.312182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4383e5-7714-41fe-af3f-a0069df5f0bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.312819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4383e5-7714-41fe-af3f-a0069df5f0bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:23:26.313210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4383e5-7714-41fe-af3f-a0069df5f0bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.314755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4383e5-7714-41fe-af3f-a0069df5f0bd admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.318860 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84ebef-07d1-4575-991c-ab5554821596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=857d90442c4b4fc8b5b7fdf1f24963de, user_id=41d1e8b097a14cba91218e7a9b32f6e0, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.321720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84ebef-07d1-4575-991c-ab5554821596 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.327521 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 778/1560] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:23:26.328990 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37d966-60ab-4347-bf58-447a911eaeb7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.329281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37d966-60ab-4347-bf58-447a911eaeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.329556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37d966-60ab-4347-bf58-447a911eaeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.337721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 783/1561] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:26 2022] PUT /identity/v3/projects/857d90442c4b4fc8b5b7fdf1f24963de/users/41d1e8b097a14cba91218e7a9b32f6e0/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:26.339222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b7193-a611-4804-bc9e-f7261f1bc422 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.340145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b7193-a611-4804-bc9e-f7261f1bc422 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.340498 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b7193-a611-4804-bc9e-f7261f1bc422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.350804 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8a37d966-60ab-4347-bf58-447a911eaeb7 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:26.352064 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8a37d966-60ab-4347-bf58-447a911eaeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:26.359836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-343b7193-a611-4804-bc9e-f7261f1bc422 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:26.361008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-343b7193-a611-4804-bc9e-f7261f1bc422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:26.413133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 779/1562] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:26.417997 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8227e-5950-4ba3-b7e4-e7e1469889b3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.418289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8227e-5950-4ba3-b7e4-e7e1469889b3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.418568 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8227e-5950-4ba3-b7e4-e7e1469889b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.421742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 784/1563] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:26.422423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b7193-a611-4804-bc9e-f7261f1bc422 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.436429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b7193-a611-4804-bc9e-f7261f1bc422 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.441039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c31a57-5a40-42cf-82b1-234fbd419fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.441651 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-bae8227e-5950-4ba3-b7e4-e7e1469889b3 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:26.441784 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c31a57-5a40-42cf-82b1-234fbd419fdf admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.442122 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c31a57-5a40-42cf-82b1-234fbd419fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.442453 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c31a57-5a40-42cf-82b1-234fbd419fdf admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.443565 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bae8227e-5950-4ba3-b7e4-e7e1469889b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:26.445173 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c31a57-5a40-42cf-82b1-234fbd419fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.446335 dv-cinder-849143-8-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-86c31a57-5a40-42cf-82b1-234fbd419fdf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 17:23:26.446335 dv-cinder-849143-8-smb devstack@keystone.service[81379]: warnings.warn(msg) Sep 27 17:23:26.446335 dv-cinder-849143-8-smb devstack@keystone.service[81379]: Sep 27 17:23:26.447468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c31a57-5a40-42cf-82b1-234fbd419fdf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.452146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 780/1564] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:26.452873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8227e-5950-4ba3-b7e4-e7e1469889b3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.463168 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8227e-5950-4ba3-b7e4-e7e1469889b3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.467856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec69d69-c2d3-46af-a984-29ba8ec09634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.468455 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec69d69-c2d3-46af-a984-29ba8ec09634 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.468735 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec69d69-c2d3-46af-a984-29ba8ec09634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.469002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 785/1565] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:26.472416 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec69d69-c2d3-46af-a984-29ba8ec09634 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.472416 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec69d69-c2d3-46af-a984-29ba8ec09634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.472614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff9d61-1d42-4300-a1b0-30e0345cfb13 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.472614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff9d61-1d42-4300-a1b0-30e0345cfb13 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.472614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff9d61-1d42-4300-a1b0-30e0345cfb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.472873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec69d69-c2d3-46af-a984-29ba8ec09634 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.491688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b3ff9d61-1d42-4300-a1b0-30e0345cfb13 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:26.492884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b3ff9d61-1d42-4300-a1b0-30e0345cfb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:26.493801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 781/1566] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/users => generated 294 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:26.494596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec69d69-c2d3-46af-a984-29ba8ec09634 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.501529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 786/1567] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:26.502828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182627b-69d2-4546-880a-53bce5f8ec15 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.503110 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182627b-69d2-4546-880a-53bce5f8ec15 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.503379 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182627b-69d2-4546-880a-53bce5f8ec15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.504611 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec69d69-c2d3-46af-a984-29ba8ec09634 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.510231 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a4e08-8c24-49bd-95e1-1be34b74560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.510858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a4e08-8c24-49bd-95e1-1be34b74560d admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.511091 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a4e08-8c24-49bd-95e1-1be34b74560d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.511361 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a4e08-8c24-49bd-95e1-1be34b74560d admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.511981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a4e08-8c24-49bd-95e1-1be34b74560d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.513893 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a4e08-8c24-49bd-95e1-1be34b74560d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.523740 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f182627b-69d2-4546-880a-53bce5f8ec15 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:26.524940 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f182627b-69d2-4546-880a-53bce5f8ec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:26.532577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 787/1568] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:26.533427 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182627b-69d2-4546-880a-53bce5f8ec15 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.544627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182627b-69d2-4546-880a-53bce5f8ec15 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.547107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 782/1569] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:26.548228 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4693c51-81a0-4457-8908-2484c9149af0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.548511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4693c51-81a0-4457-8908-2484c9149af0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.548785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4693c51-81a0-4457-8908-2484c9149af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.552131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e55bb-405b-48c0-8f65-5e175ce4c934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.552734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e55bb-405b-48c0-8f65-5e175ce4c934 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.553010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e55bb-405b-48c0-8f65-5e175ce4c934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.553281 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e55bb-405b-48c0-8f65-5e175ce4c934 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.553948 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e55bb-405b-48c0-8f65-5e175ce4c934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:23:26.554252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e55bb-405b-48c0-8f65-5e175ce4c934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.555868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e55bb-405b-48c0-8f65-5e175ce4c934 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.567487 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 788/1570] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:23:26.569538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e55bb-405b-48c0-8f65-5e175ce4c934 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.570628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a4693c51-81a0-4457-8908-2484c9149af0 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:26.571824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a4693c51-81a0-4457-8908-2484c9149af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:26.578979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e55bb-405b-48c0-8f65-5e175ce4c934 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.633884 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 783/1571] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:26.634724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4693c51-81a0-4457-8908-2484c9149af0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.640933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891129b-314f-4a6a-aa47-262266099ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.641546 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891129b-314f-4a6a-aa47-262266099ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.641856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891129b-314f-4a6a-aa47-262266099ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.642133 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891129b-314f-4a6a-aa47-262266099ed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.642773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891129b-314f-4a6a-aa47-262266099ed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:23:26.643076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891129b-314f-4a6a-aa47-262266099ed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.643454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4693c51-81a0-4457-8908-2484c9149af0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.644711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891129b-314f-4a6a-aa47-262266099ed4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.648518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f2607-07e9-4103-a5e3-7e2e986f4865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.649094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f2607-07e9-4103-a5e3-7e2e986f4865 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.649370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f2607-07e9-4103-a5e3-7e2e986f4865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.649640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f2607-07e9-4103-a5e3-7e2e986f4865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.650293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f2607-07e9-4103-a5e3-7e2e986f4865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.651848 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f2607-07e9-4103-a5e3-7e2e986f4865 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.656922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:26.657879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 789/1572] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:23:26.663458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891129b-314f-4a6a-aa47-262266099ed4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.665006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 784/1573] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:26.665748 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f2607-07e9-4103-a5e3-7e2e986f4865 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.674867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891129b-314f-4a6a-aa47-262266099ed4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.675155 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f2607-07e9-4103-a5e3-7e2e986f4865 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.679698 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898c24a-4046-4e38-812c-9d71278faf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.679908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fa35b-f05e-4982-8e5b-60ae8268a9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.680404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898c24a-4046-4e38-812c-9d71278faf19 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.680504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fa35b-f05e-4982-8e5b-60ae8268a9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.680684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898c24a-4046-4e38-812c-9d71278faf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.680787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fa35b-f05e-4982-8e5b-60ae8268a9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.680955 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898c24a-4046-4e38-812c-9d71278faf19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.681057 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fa35b-f05e-4982-8e5b-60ae8268a9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.681613 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898c24a-4046-4e38-812c-9d71278faf19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:23:26.681724 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fa35b-f05e-4982-8e5b-60ae8268a9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.681944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898c24a-4046-4e38-812c-9d71278faf19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.683275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fa35b-f05e-4982-8e5b-60ae8268a9b0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.683485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898c24a-4046-4e38-812c-9d71278faf19 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.684579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:26.695267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 790/1574] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:26.696102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fa35b-f05e-4982-8e5b-60ae8268a9b0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.701985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 785/1575] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:23:26.701985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898c24a-4046-4e38-812c-9d71278faf19 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.707991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898c24a-4046-4e38-812c-9d71278faf19 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.713196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98159e36-95d5-476e-86e0-10c0e04553f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.713810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98159e36-95d5-476e-86e0-10c0e04553f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.714090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98159e36-95d5-476e-86e0-10c0e04553f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.714362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98159e36-95d5-476e-86e0-10c0e04553f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.714980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98159e36-95d5-476e-86e0-10c0e04553f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.716870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98159e36-95d5-476e-86e0-10c0e04553f9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.738000 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 786/1576] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/users => generated 296 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:26.738968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98159e36-95d5-476e-86e0-10c0e04553f9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.748513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98159e36-95d5-476e-86e0-10c0e04553f9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.753069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccd0a2-3aa4-4cd3-988e-c2676be9b9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.753659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccd0a2-3aa4-4cd3-988e-c2676be9b9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.753967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccd0a2-3aa4-4cd3-988e-c2676be9b9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.754240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccd0a2-3aa4-4cd3-988e-c2676be9b9c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.754860 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccd0a2-3aa4-4cd3-988e-c2676be9b9c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.757360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccd0a2-3aa4-4cd3-988e-c2676be9b9c4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.759701 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fa35b-f05e-4982-8e5b-60ae8268a9b0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.763650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4a76c-4567-424d-8643-e68cd708832a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.764249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4a76c-4567-424d-8643-e68cd708832a service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.764522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4a76c-4567-424d-8643-e68cd708832a service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.764787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4a76c-4567-424d-8643-e68cd708832a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.774742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4a76c-4567-424d-8643-e68cd708832a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.776911 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4a76c-4567-424d-8643-e68cd708832a service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.789618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 787/1577] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:26.789618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccd0a2-3aa4-4cd3-988e-c2676be9b9c4 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.789945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 791/1578] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:26.789945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4a76c-4567-424d-8643-e68cd708832a service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.797949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4a76c-4567-424d-8643-e68cd708832a service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.859967 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f0976-8916-452f-9389-a65807276184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.860582 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f0976-8916-452f-9389-a65807276184 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.860863 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f0976-8916-452f-9389-a65807276184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.861305 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f0976-8916-452f-9389-a65807276184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.862143 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f0976-8916-452f-9389-a65807276184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.863779 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f0976-8916-452f-9389-a65807276184 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.873298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccd0a2-3aa4-4cd3-988e-c2676be9b9c4 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.875818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 792/1579] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:26.876640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f0976-8916-452f-9389-a65807276184 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.882174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acbf2a-186b-47ae-a1fd-9e048f8dfe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.883068 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acbf2a-186b-47ae-a1fd-9e048f8dfe2e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.883498 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acbf2a-186b-47ae-a1fd-9e048f8dfe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.883957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acbf2a-186b-47ae-a1fd-9e048f8dfe2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.884755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acbf2a-186b-47ae-a1fd-9e048f8dfe2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:23:26.885238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acbf2a-186b-47ae-a1fd-9e048f8dfe2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.886844 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acbf2a-186b-47ae-a1fd-9e048f8dfe2e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.891216 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f0976-8916-452f-9389-a65807276184 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.897246 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227dfc8-a2cc-4ee4-b759-5837f86d0511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.897884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227dfc8-a2cc-4ee4-b759-5837f86d0511 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.898164 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227dfc8-a2cc-4ee4-b759-5837f86d0511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.898531 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227dfc8-a2cc-4ee4-b759-5837f86d0511 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.899065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227dfc8-a2cc-4ee4-b759-5837f86d0511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.900813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 788/1580] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:23:26.900953 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227dfc8-a2cc-4ee4-b759-5837f86d0511 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.901482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acbf2a-186b-47ae-a1fd-9e048f8dfe2e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.911183 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acbf2a-186b-47ae-a1fd-9e048f8dfe2e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:26.915922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b46dd-0141-4dba-9b82-7183224747ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:26.916521 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b46dd-0141-4dba-9b82-7183224747ad admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:26.916796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b46dd-0141-4dba-9b82-7183224747ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:26.917065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b46dd-0141-4dba-9b82-7183224747ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:26.917717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b46dd-0141-4dba-9b82-7183224747ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:26.919462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b46dd-0141-4dba-9b82-7183224747ad admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:26.933968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 789/1581] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:26.933968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b46dd-0141-4dba-9b82-7183224747ad admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.936244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 793/1582] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:26.937764 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227dfc8-a2cc-4ee4-b759-5837f86d0511 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:26.942223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b46dd-0141-4dba-9b82-7183224747ad admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.013903 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065af32-e215-4367-b0d0-b76ebecf5f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.014763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065af32-e215-4367-b0d0-b76ebecf5f34 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.015237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065af32-e215-4367-b0d0-b76ebecf5f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.015881 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065af32-e215-4367-b0d0-b76ebecf5f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.016956 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065af32-e215-4367-b0d0-b76ebecf5f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.020251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065af32-e215-4367-b0d0-b76ebecf5f34 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.022027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227dfc8-a2cc-4ee4-b759-5837f86d0511 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.029171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5662b-c42a-4701-a7c4-e004342fa7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.030126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5662b-c42a-4701-a7c4-e004342fa7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.030490 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5662b-c42a-4701-a7c4-e004342fa7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.030831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5662b-c42a-4701-a7c4-e004342fa7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.031610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5662b-c42a-4701-a7c4-e004342fa7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.033548 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5662b-c42a-4701-a7c4-e004342fa7c3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.046198 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 794/1583] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:27.047053 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5662b-c42a-4701-a7c4-e004342fa7c3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.061012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 790/1584] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:26 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:27.061012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065af32-e215-4367-b0d0-b76ebecf5f34 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.061306 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5662b-c42a-4701-a7c4-e004342fa7c3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.065185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:27.079164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:27.132643 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11c0e3-3239-48bd-a129-b7659b50ab84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.133417 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11c0e3-3239-48bd-a129-b7659b50ab84 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.133730 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11c0e3-3239-48bd-a129-b7659b50ab84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.134008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11c0e3-3239-48bd-a129-b7659b50ab84 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.134637 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11c0e3-3239-48bd-a129-b7659b50ab84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.134841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065af32-e215-4367-b0d0-b76ebecf5f34 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.136696 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11c0e3-3239-48bd-a129-b7659b50ab84 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.153591 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e80703-fc0c-410b-8804-5e268235496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.155136 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80703-fc0c-410b-8804-5e268235496f admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.156175 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80703-fc0c-410b-8804-5e268235496f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.157238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80703-fc0c-410b-8804-5e268235496f admin admin] PATH_INFO: `/v3/projects/f2a0e09b11e34588bb78f236a0428fe9/users/e3a27cdca85d4af8aa4028cd045969f1/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.162607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 795/1585] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:27 2022] POST /identity/v3/users => generated 302 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:27.164363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11c0e3-3239-48bd-a129-b7659b50ab84 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.177161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11c0e3-3239-48bd-a129-b7659b50ab84 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.179487 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e80703-fc0c-410b-8804-5e268235496f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a0e09b11e34588bb78f236a0428fe9, user_id=e3a27cdca85d4af8aa4028cd045969f1, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.180706 dv-cinder-849143-8-smb devstack@keystone.service[81378]: WARNING py.warnings [None req-51e80703-fc0c-410b-8804-5e268235496f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 17:23:27.180706 dv-cinder-849143-8-smb devstack@keystone.service[81378]: warnings.warn(msg) Sep 27 17:23:27.180706 dv-cinder-849143-8-smb devstack@keystone.service[81378]: Sep 27 17:23:27.182831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b12bf-c39a-4c21-a539-c03c391928ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.183501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b12bf-c39a-4c21-a539-c03c391928ea admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.183780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b12bf-c39a-4c21-a539-c03c391928ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.184085 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b12bf-c39a-4c21-a539-c03c391928ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.184413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e80703-fc0c-410b-8804-5e268235496f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.185041 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b12bf-c39a-4c21-a539-c03c391928ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.187494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b12bf-c39a-4c21-a539-c03c391928ea admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.202240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 791/1586] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:27 2022] PUT /identity/v3/projects/f2a0e09b11e34588bb78f236a0428fe9/users/e3a27cdca85d4af8aa4028cd045969f1/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:27.203845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e80703-fc0c-410b-8804-5e268235496f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.223568 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 796/1587] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:27 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:27.224737 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b12bf-c39a-4c21-a539-c03c391928ea admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.291608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e80703-fc0c-410b-8804-5e268235496f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.297062 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b12bf-c39a-4c21-a539-c03c391928ea admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.297418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318dbbf-1db1-418f-ada1-50ae0b170128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.298115 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318dbbf-1db1-418f-ada1-50ae0b170128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.298394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318dbbf-1db1-418f-ada1-50ae0b170128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.298665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318dbbf-1db1-418f-ada1-50ae0b170128 admin admin] PATH_INFO: `/v3/projects/22876639e9a446a3902e19c2e3ad90a5/users/28c03fdc58424a9793e3df8579a8f78b/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.302457 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6a0aa-bb71-4ab2-9e01-1c1037a50e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.303283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6a0aa-bb71-4ab2-9e01-1c1037a50e65 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.303558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6a0aa-bb71-4ab2-9e01-1c1037a50e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.303827 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6a0aa-bb71-4ab2-9e01-1c1037a50e65 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.304457 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6a0aa-bb71-4ab2-9e01-1c1037a50e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.306431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6a0aa-bb71-4ab2-9e01-1c1037a50e65 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.317460 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318dbbf-1db1-418f-ada1-50ae0b170128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22876639e9a446a3902e19c2e3ad90a5, user_id=28c03fdc58424a9793e3df8579a8f78b, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.322753 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318dbbf-1db1-418f-ada1-50ae0b170128 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.330757 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 797/1588] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:27 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:27.335584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6a0aa-bb71-4ab2-9e01-1c1037a50e65 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.338862 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 792/1589] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:27 2022] PUT /identity/v3/projects/22876639e9a446a3902e19c2e3ad90a5/users/28c03fdc58424a9793e3df8579a8f78b/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:27.339889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318dbbf-1db1-418f-ada1-50ae0b170128 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.348973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6a0aa-bb71-4ab2-9e01-1c1037a50e65 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.416486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8ff47-2cce-4d6e-bebe-8cbb0aba0415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.416486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8ff47-2cce-4d6e-bebe-8cbb0aba0415 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.416486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8ff47-2cce-4d6e-bebe-8cbb0aba0415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.416486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8ff47-2cce-4d6e-bebe-8cbb0aba0415 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.416937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8ff47-2cce-4d6e-bebe-8cbb0aba0415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.417393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8ff47-2cce-4d6e-bebe-8cbb0aba0415 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.417511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318dbbf-1db1-418f-ada1-50ae0b170128 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.423518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25794bff-76c5-4ec2-a121-5efd347b981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.424161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25794bff-76c5-4ec2-a121-5efd347b981e admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.424803 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25794bff-76c5-4ec2-a121-5efd347b981e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.425212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25794bff-76c5-4ec2-a121-5efd347b981e admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.425918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25794bff-76c5-4ec2-a121-5efd347b981e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.431333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 798/1590] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:27.431499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25794bff-76c5-4ec2-a121-5efd347b981e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.431610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8ff47-2cce-4d6e-bebe-8cbb0aba0415 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.437286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:27.442252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8ff47-2cce-4d6e-bebe-8cbb0aba0415 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.450806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41c6f1-352e-47a9-8438-84e4fb7a8de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.453765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41c6f1-352e-47a9-8438-84e4fb7a8de9 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.453765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41c6f1-352e-47a9-8438-84e4fb7a8de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.453765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41c6f1-352e-47a9-8438-84e4fb7a8de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.453765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41c6f1-352e-47a9-8438-84e4fb7a8de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.455278 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41c6f1-352e-47a9-8438-84e4fb7a8de9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.466644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 793/1591] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:27 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:27.467773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 799/1592] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:27.468635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41c6f1-352e-47a9-8438-84e4fb7a8de9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.471789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff5a4c-3937-4ec6-a710-7fb6f3d768cd None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.472076 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff5a4c-3937-4ec6-a710-7fb6f3d768cd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.472349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff5a4c-3937-4ec6-a710-7fb6f3d768cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.483330 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41c6f1-352e-47a9-8438-84e4fb7a8de9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.488679 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28fee-d1b1-4918-81f7-ac79adfca4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.489379 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28fee-d1b1-4918-81f7-ac79adfca4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.489992 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28fee-d1b1-4918-81f7-ac79adfca4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.490416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28fee-d1b1-4918-81f7-ac79adfca4a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.491076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f28fee-d1b1-4918-81f7-ac79adfca4a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.493153 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f28fee-d1b1-4918-81f7-ac79adfca4a4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.497593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:27.507584 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b1ff5a4c-3937-4ec6-a710-7fb6f3d768cd None None] MFA Rules not processed for user `e3a27cdca85d4af8aa4028cd045969f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:27.509544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b1ff5a4c-3937-4ec6-a710-7fb6f3d768cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:27.517186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 800/1593] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:27 2022] POST /identity/v3/users => generated 283 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:27.518146 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28fee-d1b1-4918-81f7-ac79adfca4a4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.530717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28fee-d1b1-4918-81f7-ac79adfca4a4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.535580 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85467d0-7546-4899-b958-0d2b8075bb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.536180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85467d0-7546-4899-b958-0d2b8075bb7e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.537217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85467d0-7546-4899-b958-0d2b8075bb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.537577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85467d0-7546-4899-b958-0d2b8075bb7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.538228 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85467d0-7546-4899-b958-0d2b8075bb7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.539951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85467d0-7546-4899-b958-0d2b8075bb7e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.553021 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 801/1594] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:27.554423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e7bf8-07e6-4cbb-b7f3-1f3f7bb5648e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.554711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e7bf8-07e6-4cbb-b7f3-1f3f7bb5648e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.554985 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e7bf8-07e6-4cbb-b7f3-1f3f7bb5648e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.577951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-294e7bf8-07e6-4cbb-b7f3-1f3f7bb5648e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:27.579952 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-294e7bf8-07e6-4cbb-b7f3-1f3f7bb5648e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:27.589449 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 802/1595] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:27.590379 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e7bf8-07e6-4cbb-b7f3-1f3f7bb5648e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.603350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e7bf8-07e6-4cbb-b7f3-1f3f7bb5648e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.604674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 794/1596] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:27.606235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff5a4c-3937-4ec6-a710-7fb6f3d768cd None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.626419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5dcbcf-8a2b-4bb2-84cd-c0f978030303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.626581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff5a4c-3937-4ec6-a710-7fb6f3d768cd None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.628483 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dcbcf-8a2b-4bb2-84cd-c0f978030303 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.628767 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dcbcf-8a2b-4bb2-84cd-c0f978030303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.630627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dcbcf-8a2b-4bb2-84cd-c0f978030303 admin admin] PATH_INFO: `/v3/projects/170c7ffa38ec452db0de29953a0bf755/users/0b41c6ab73144570a7291dc674d95e66/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.634639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0c34c-0107-45cf-b80f-3ae7ae75cda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.635701 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0c34c-0107-45cf-b80f-3ae7ae75cda8 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.636775 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0c34c-0107-45cf-b80f-3ae7ae75cda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.637271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0c34c-0107-45cf-b80f-3ae7ae75cda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.638179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0c34c-0107-45cf-b80f-3ae7ae75cda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.640412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0c34c-0107-45cf-b80f-3ae7ae75cda8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.654273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 795/1597] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:27.655745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0c34c-0107-45cf-b80f-3ae7ae75cda8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.668928 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5dcbcf-8a2b-4bb2-84cd-c0f978030303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=170c7ffa38ec452db0de29953a0bf755, user_id=0b41c6ab73144570a7291dc674d95e66, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.672460 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5dcbcf-8a2b-4bb2-84cd-c0f978030303 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.676313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0c34c-0107-45cf-b80f-3ae7ae75cda8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.682062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fac300-20c0-43cf-97bf-139065ca61ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.683169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fac300-20c0-43cf-97bf-139065ca61ff admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.683624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fac300-20c0-43cf-97bf-139065ca61ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.684155 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fac300-20c0-43cf-97bf-139065ca61ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.685442 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fac300-20c0-43cf-97bf-139065ca61ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.687670 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fac300-20c0-43cf-97bf-139065ca61ff admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.697289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 803/1598] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:27 2022] PUT /identity/v3/projects/170c7ffa38ec452db0de29953a0bf755/users/0b41c6ab73144570a7291dc674d95e66/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:27.699420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5dcbcf-8a2b-4bb2-84cd-c0f978030303 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.706373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 796/1599] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:27.706373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fac300-20c0-43cf-97bf-139065ca61ff admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.719774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fac300-20c0-43cf-97bf-139065ca61ff admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.789821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5dcbcf-8a2b-4bb2-84cd-c0f978030303 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.797992 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe227af-19f5-4191-9ba7-2ed753640ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.798840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2e9ea-3601-4224-aa76-8b11ca259926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.799341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe227af-19f5-4191-9ba7-2ed753640ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.800034 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2e9ea-3601-4224-aa76-8b11ca259926 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.800292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2e9ea-3601-4224-aa76-8b11ca259926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.800654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe227af-19f5-4191-9ba7-2ed753640ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.801110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2e9ea-3601-4224-aa76-8b11ca259926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.801296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe227af-19f5-4191-9ba7-2ed753640ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.802680 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2e9ea-3601-4224-aa76-8b11ca259926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.803670 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe227af-19f5-4191-9ba7-2ed753640ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.804841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2e9ea-3601-4224-aa76-8b11ca259926 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.805731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe227af-19f5-4191-9ba7-2ed753640ef8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.817863 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 804/1600] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:27.819350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe227af-19f5-4191-9ba7-2ed753640ef8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.821572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 797/1601] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:27.823057 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0995429-07c7-4f73-8611-9cfe0d0de45a None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.823270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0fe227af-19f5-4191-9ba7-2ed753640ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:27.823728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0995429-07c7-4f73-8611-9cfe0d0de45a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.824099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0995429-07c7-4f73-8611-9cfe0d0de45a None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.825789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 798/1602] 10.222.0.57 () {54 vars in 961 bytes} [Tue Sep 27 17:23:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:23:27.827269 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0995429-07c7-4f73-8611-9cfe0d0de45a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.842740 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0995429-07c7-4f73-8611-9cfe0d0de45a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.848114 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d96b12-67f2-4f92-94d1-0ae5df9a75ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.848820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d96b12-67f2-4f92-94d1-0ae5df9a75ea admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.849271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d96b12-67f2-4f92-94d1-0ae5df9a75ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.849640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d96b12-67f2-4f92-94d1-0ae5df9a75ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.850392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d96b12-67f2-4f92-94d1-0ae5df9a75ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.852533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d96b12-67f2-4f92-94d1-0ae5df9a75ea admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.866379 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 799/1603] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:27.868024 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba0629-ae50-4930-96be-31065cbe6147 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.868399 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba0629-ae50-4930-96be-31065cbe6147 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.868770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba0629-ae50-4930-96be-31065cbe6147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.911870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-83ba0629-ae50-4930-96be-31065cbe6147 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:27.914318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-83ba0629-ae50-4930-96be-31065cbe6147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:27.916500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe227af-19f5-4191-9ba7-2ed753640ef8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.920631 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dedec-4c0c-47ae-a8eb-4cf925e0c7b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.921404 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dedec-4c0c-47ae-a8eb-4cf925e0c7b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.921769 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dedec-4c0c-47ae-a8eb-4cf925e0c7b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.922341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dedec-4c0c-47ae-a8eb-4cf925e0c7b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.923781 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 800/1604] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:27.924630 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba0629-ae50-4930-96be-31065cbe6147 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.938242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba0629-ae50-4930-96be-31065cbe6147 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.938995 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668dedec-4c0c-47ae-a8eb-4cf925e0c7b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.940653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668dedec-4c0c-47ae-a8eb-4cf925e0c7b9 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.943940 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d29f21-c772-4366-8f00-ba92f6ee2709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.944640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d29f21-c772-4366-8f00-ba92f6ee2709 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.944919 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d29f21-c772-4366-8f00-ba92f6ee2709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.945191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d29f21-c772-4366-8f00-ba92f6ee2709 admin admin] PATH_INFO: `/v3/projects/104aa7d64f794f75a200c20283b7aa87/users/440627e1d7e542039a3cee9d057e78e9/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.954401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 805/1605] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:27.955680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dedec-4c0c-47ae-a8eb-4cf925e0c7b9 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:27.966428 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d29f21-c772-4366-8f00-ba92f6ee2709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104aa7d64f794f75a200c20283b7aa87, user_id=440627e1d7e542039a3cee9d057e78e9, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.967477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dedec-4c0c-47ae-a8eb-4cf925e0c7b9 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:27.969433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d29f21-c772-4366-8f00-ba92f6ee2709 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.973673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee426c5e-211c-4725-bdd9-1f5e40b779c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:27.975779 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee426c5e-211c-4725-bdd9-1f5e40b779c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:27.976200 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee426c5e-211c-4725-bdd9-1f5e40b779c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:27.976843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee426c5e-211c-4725-bdd9-1f5e40b779c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:27.977757 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee426c5e-211c-4725-bdd9-1f5e40b779c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:27.979464 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee426c5e-211c-4725-bdd9-1f5e40b779c7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:27.996199 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 806/1607] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:27.996199 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee426c5e-211c-4725-bdd9-1f5e40b779c7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:28.003733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 801/1607] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:27 2022] PUT /identity/v3/projects/104aa7d64f794f75a200c20283b7aa87/users/440627e1d7e542039a3cee9d057e78e9/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:28.007022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf14dd-ba6c-4308-83b9-77febfda34d3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:28.007464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf14dd-ba6c-4308-83b9-77febfda34d3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:28.007840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf14dd-ba6c-4308-83b9-77febfda34d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:28.016149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee426c5e-211c-4725-bdd9-1f5e40b779c7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:28.052906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:28.070878 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4edf14dd-ba6c-4308-83b9-77febfda34d3 None None] MFA Rules not processed for user `e75b03fde75e411bace8d406237a7e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:28.072497 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4edf14dd-ba6c-4308-83b9-77febfda34d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:28.102045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:28.125782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f0d38-5a92-4057-b293-7b391c04dd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:28.127022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f0d38-5a92-4057-b293-7b391c04dd60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:28.127309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f0d38-5a92-4057-b293-7b391c04dd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:28.127586 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f0d38-5a92-4057-b293-7b391c04dd60 admin admin] PATH_INFO: `/v3/projects/657140f6249e40b685211cc602392c54/users/a817cd3c534f4089b3948bad1c37ed75/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:28.158720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f0d38-5a92-4057-b293-7b391c04dd60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=657140f6249e40b685211cc602392c54, user_id=a817cd3c534f4089b3948bad1c37ed75, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:28.165959 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f0d38-5a92-4057-b293-7b391c04dd60 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:28.195290 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 807/1608] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:27 2022] PUT /identity/v3/projects/657140f6249e40b685211cc602392c54/users/a817cd3c534f4089b3948bad1c37ed75/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:28.195290 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f0d38-5a92-4057-b293-7b391c04dd60 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:28.197189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 802/1609] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Sep 27 17:23:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:28.198312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf14dd-ba6c-4308-83b9-77febfda34d3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:28.268523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf14dd-ba6c-4308-83b9-77febfda34d3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:28.344135 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f0d38-5a92-4057-b293-7b391c04dd60 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:28.360241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaaebf-3a82-4b87-9c01-656dbead0d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:28.360505 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaaebf-3a82-4b87-9c01-656dbead0d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:28.360749 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaaebf-3a82-4b87-9c01-656dbead0d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:28.361100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaaebf-3a82-4b87-9c01-656dbead0d39 admin admin] PATH_INFO: `/v3/projects/d10b70d718744a3c99f8a859ef2de494/users/19f5565494964b36846b2e81447951a7/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:28.383457 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963d189-369b-4370-91bc-883444060f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:28.384368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d189-369b-4370-91bc-883444060f16 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:28.384724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d189-369b-4370-91bc-883444060f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:28.385108 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d189-369b-4370-91bc-883444060f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:28.392721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aaaebf-3a82-4b87-9c01-656dbead0d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10b70d718744a3c99f8a859ef2de494, user_id=19f5565494964b36846b2e81447951a7, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:28.397608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963d189-369b-4370-91bc-883444060f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:28.399218 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963d189-369b-4370-91bc-883444060f16 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:28.400259 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aaaebf-3a82-4b87-9c01-656dbead0d39 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:28.412344 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 803/1610] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:28.413454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963d189-369b-4370-91bc-883444060f16 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:28.425599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963d189-369b-4370-91bc-883444060f16 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:28.434399 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 808/1611] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:28 2022] PUT /identity/v3/projects/d10b70d718744a3c99f8a859ef2de494/users/19f5565494964b36846b2e81447951a7/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:28.436788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c771c-d126-4930-8a55-7de96648c07f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:28.439650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c771c-d126-4930-8a55-7de96648c07f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:28.439943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c771c-d126-4930-8a55-7de96648c07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:28.502708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8e3c771c-d126-4930-8a55-7de96648c07f None None] MFA Rules not processed for user `440627e1d7e542039a3cee9d057e78e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:28.504294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8e3c771c-d126-4930-8a55-7de96648c07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:28.523871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b3edc-2132-4011-bdac-8ab1c5159638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:28.524573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b3edc-2132-4011-bdac-8ab1c5159638 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:28.524858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b3edc-2132-4011-bdac-8ab1c5159638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:28.525138 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b3edc-2132-4011-bdac-8ab1c5159638 admin admin] PATH_INFO: `/v3/projects/082426bff6d947319c061a364fe933af/users/95ea4163f4434f1b8227653a0534dc1f/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:28.547725 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b3edc-2132-4011-bdac-8ab1c5159638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=082426bff6d947319c061a364fe933af, user_id=95ea4163f4434f1b8227653a0534dc1f, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:28.550452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b3edc-2132-4011-bdac-8ab1c5159638 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:28.553452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:28.568602 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 804/1612] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:28 2022] PUT /identity/v3/projects/082426bff6d947319c061a364fe933af/users/95ea4163f4434f1b8227653a0534dc1f/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:28.570162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e66e97-85f8-43ce-8084-eaa74c4d66db None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:28.570451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e66e97-85f8-43ce-8084-eaa74c4d66db None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:28.570775 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e66e97-85f8-43ce-8084-eaa74c4d66db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:28.613039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-93e66e97-85f8-43ce-8084-eaa74c4d66db None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:28.617348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-93e66e97-85f8-43ce-8084-eaa74c4d66db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:28.668055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 809/1613] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:28.671224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c771c-d126-4930-8a55-7de96648c07f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:28.718349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 805/1614] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:28.718913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:28.721767 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48037252-6ef2-4d12-b72e-f795f7b3f057 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:28.722063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48037252-6ef2-4d12-b72e-f795f7b3f057 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:28.722384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48037252-6ef2-4d12-b72e-f795f7b3f057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:28.751529 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-48037252-6ef2-4d12-b72e-f795f7b3f057 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:28.752840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-48037252-6ef2-4d12-b72e-f795f7b3f057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:28.765724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 806/1615] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:28.765724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68dfa5-fbfb-43ed-8bdc-daac3a0af859 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:28.765724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68dfa5-fbfb-43ed-8bdc-daac3a0af859 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:28.765724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68dfa5-fbfb-43ed-8bdc-daac3a0af859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:28.826749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6e68dfa5-fbfb-43ed-8bdc-daac3a0af859 None None] MFA Rules not processed for user `95ea4163f4434f1b8227653a0534dc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:28.828206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6e68dfa5-fbfb-43ed-8bdc-daac3a0af859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:28.857861 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c771c-d126-4930-8a55-7de96648c07f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:28.980906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 807/1616] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:28.981846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68dfa5-fbfb-43ed-8bdc-daac3a0af859 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:28.995258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8e619-0771-467f-91f5-f715ac155208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:28.996642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68dfa5-fbfb-43ed-8bdc-daac3a0af859 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:28.997862 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8e619-0771-467f-91f5-f715ac155208 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:28.998348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8e619-0771-467f-91f5-f715ac155208 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:28.998861 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8e619-0771-467f-91f5-f715ac155208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:29.006067 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde1176-8fa6-4c9d-b310-4faeec1a5881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:29.008001 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde1176-8fa6-4c9d-b310-4faeec1a5881 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:29.008308 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde1176-8fa6-4c9d-b310-4faeec1a5881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:29.008638 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde1176-8fa6-4c9d-b310-4faeec1a5881 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:29.009296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde1176-8fa6-4c9d-b310-4faeec1a5881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:29.014849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde1176-8fa6-4c9d-b310-4faeec1a5881 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:29.073506 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 808/1617] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:28 2022] POST /identity/v3/projects => generated 405 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:29.077426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde1176-8fa6-4c9d-b310-4faeec1a5881 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:29.087743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8e619-0771-467f-91f5-f715ac155208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:29.090642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8e619-0771-467f-91f5-f715ac155208 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:29.106997 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 810/1618] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:29.188435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8e619-0771-467f-91f5-f715ac155208 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:29.190212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde1176-8fa6-4c9d-b310-4faeec1a5881 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:29.190212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512ff64-b8f6-4f79-881d-de2544ef4a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:29.190212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512ff64-b8f6-4f79-881d-de2544ef4a19 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:29.190212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512ff64-b8f6-4f79-881d-de2544ef4a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:29.191294 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512ff64-b8f6-4f79-881d-de2544ef4a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:29.226342 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:29.264260 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8e619-0771-467f-91f5-f715ac155208 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:29.282633 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de4377-dd19-4126-a1c4-fb0779b57a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:29.283900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de4377-dd19-4126-a1c4-fb0779b57a0c service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:29.284184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de4377-dd19-4126-a1c4-fb0779b57a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:29.284461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de4377-dd19-4126-a1c4-fb0779b57a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:29.298431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:29.390119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512ff64-b8f6-4f79-881d-de2544ef4a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:29.392359 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512ff64-b8f6-4f79-881d-de2544ef4a19 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:29.417409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de4377-dd19-4126-a1c4-fb0779b57a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:29.418974 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de4377-dd19-4126-a1c4-fb0779b57a0c service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:29.421539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 809/1619] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:29.421928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512ff64-b8f6-4f79-881d-de2544ef4a19 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:29.432965 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 811/1620] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:29.433421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de4377-dd19-4126-a1c4-fb0779b57a0c service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:29.445977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de4377-dd19-4126-a1c4-fb0779b57a0c service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:29.453377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90245a2a-2e21-4b36-b645-44222335c2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:29.454037 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90245a2a-2e21-4b36-b645-44222335c2cd admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:29.454318 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90245a2a-2e21-4b36-b645-44222335c2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:29.454590 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90245a2a-2e21-4b36-b645-44222335c2cd admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:29.455230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90245a2a-2e21-4b36-b645-44222335c2cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:29.458937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90245a2a-2e21-4b36-b645-44222335c2cd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:29.495032 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 812/1621] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:29 2022] POST /identity/v3/users => generated 309 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:29.498180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90245a2a-2e21-4b36-b645-44222335c2cd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:29.522521 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512ff64-b8f6-4f79-881d-de2544ef4a19 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:29.522809 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90245a2a-2e21-4b36-b645-44222335c2cd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:29.526688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22a6fc-7923-42cf-94a9-2823cafbb844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:29.527306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22a6fc-7923-42cf-94a9-2823cafbb844 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:29.527583 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22a6fc-7923-42cf-94a9-2823cafbb844 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:29.528893 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22a6fc-7923-42cf-94a9-2823cafbb844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:29.540641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9eaac-9d5a-40ee-abf0-afb00ca5974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:29.541284 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9eaac-9d5a-40ee-abf0-afb00ca5974e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:29.541567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9eaac-9d5a-40ee-abf0-afb00ca5974e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:29.541894 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9eaac-9d5a-40ee-abf0-afb00ca5974e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:29.542819 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9eaac-9d5a-40ee-abf0-afb00ca5974e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:29.546522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9eaac-9d5a-40ee-abf0-afb00ca5974e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:29.579177 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 813/1622] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:29.586228 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9eaac-9d5a-40ee-abf0-afb00ca5974e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:29.605032 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9eaac-9d5a-40ee-abf0-afb00ca5974e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:29.622745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31636799-75a9-4da6-9643-8767621de9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:29.623753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31636799-75a9-4da6-9643-8767621de9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:29.624044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31636799-75a9-4da6-9643-8767621de9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:29.624327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31636799-75a9-4da6-9643-8767621de9c9 admin admin] PATH_INFO: `/v3/projects/6ff7f39096b74432833b7debd339a4de/users/c953a60161f5442a822cca6e197f1356/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:29.668272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22a6fc-7923-42cf-94a9-2823cafbb844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:29.670432 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22a6fc-7923-42cf-94a9-2823cafbb844 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:29.670803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31636799-75a9-4da6-9643-8767621de9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff7f39096b74432833b7debd339a4de, user_id=c953a60161f5442a822cca6e197f1356, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:29.673500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31636799-75a9-4da6-9643-8767621de9c9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:29.686800 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 810/1623] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:29.710090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 814/1624] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:29 2022] PUT /identity/v3/projects/6ff7f39096b74432833b7debd339a4de/users/c953a60161f5442a822cca6e197f1356/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:29.714668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22a6fc-7923-42cf-94a9-2823cafbb844 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:29.737734 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22a6fc-7923-42cf-94a9-2823cafbb844 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:29.755759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ee075-290c-4c15-99bb-2fff1b2532dd None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:29.756071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ee075-290c-4c15-99bb-2fff1b2532dd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:29.756351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ee075-290c-4c15-99bb-2fff1b2532dd None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:29.758155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 815/1625] 10.222.0.57 () {54 vars in 912 bytes} [Tue Sep 27 17:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:23:29.763649 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8762a-284e-44cc-8504-fbd9473e284b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:29.763931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8762a-284e-44cc-8504-fbd9473e284b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:29.764207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8762a-284e-44cc-8504-fbd9473e284b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:29.819995 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fef8762a-284e-44cc-8504-fbd9473e284b None None] MFA Rules not processed for user `e75b03fde75e411bace8d406237a7e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:29.821261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fef8762a-284e-44cc-8504-fbd9473e284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:29.907629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d44e49-c141-488f-83e7-8d2e6ce113b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:29.908272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d44e49-c141-488f-83e7-8d2e6ce113b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:29.908595 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d44e49-c141-488f-83e7-8d2e6ce113b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:29.908873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d44e49-c141-488f-83e7-8d2e6ce113b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:29.909530 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d44e49-c141-488f-83e7-8d2e6ce113b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:29.921137 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d44e49-c141-488f-83e7-8d2e6ce113b5 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:29.925299 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:29.956914 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 811/1626] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:29.957870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d44e49-c141-488f-83e7-8d2e6ce113b5 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:29.980312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d44e49-c141-488f-83e7-8d2e6ce113b5 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:29.994755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca34a6-4d42-456d-99dd-95e4b182b8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:29.995722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca34a6-4d42-456d-99dd-95e4b182b8d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:29.996845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca34a6-4d42-456d-99dd-95e4b182b8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:29.998372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca34a6-4d42-456d-99dd-95e4b182b8d7 admin admin] PATH_INFO: `/v3/projects/6ff7f39096b74432833b7debd339a4de/users/c953a60161f5442a822cca6e197f1356/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:30.002226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca34a6-4d42-456d-99dd-95e4b182b8d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff7f39096b74432833b7debd339a4de, user_id=c953a60161f5442a822cca6e197f1356, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:30.005760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca34a6-4d42-456d-99dd-95e4b182b8d7 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:30.021774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 816/1627] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Sep 27 17:23:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:30.040118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8762a-284e-44cc-8504-fbd9473e284b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:30.056928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 812/1628] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:29 2022] PUT /identity/v3/projects/6ff7f39096b74432833b7debd339a4de/users/c953a60161f5442a822cca6e197f1356/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:30.066993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5048449-bd2b-4c3d-bb0a-e1b2f476f4d8 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:30.067514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5048449-bd2b-4c3d-bb0a-e1b2f476f4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:30.068777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5048449-bd2b-4c3d-bb0a-e1b2f476f4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:30.160990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:30.196564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f5048449-bd2b-4c3d-bb0a-e1b2f476f4d8 None None] MFA Rules not processed for user `c953a60161f5442a822cca6e197f1356`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:30.203928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f5048449-bd2b-4c3d-bb0a-e1b2f476f4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:30.218184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8762a-284e-44cc-8504-fbd9473e284b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:30.321754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52a2e2-2378-4028-be04-a63438f148f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:30.322384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52a2e2-2378-4028-be04-a63438f148f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:30.322665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52a2e2-2378-4028-be04-a63438f148f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:30.322938 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52a2e2-2378-4028-be04-a63438f148f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:30.472197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 813/1629] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:30 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:30.487659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52a2e2-2378-4028-be04-a63438f148f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:30.489133 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52a2e2-2378-4028-be04-a63438f148f4 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:30.528186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 817/1630] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:30.785668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5048449-bd2b-4c3d-bb0a-e1b2f476f4d8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:30.797901 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5048449-bd2b-4c3d-bb0a-e1b2f476f4d8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:30.805269 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc01f5-847b-4f3a-bca7-ea2b6adc0754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:30.806821 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc01f5-847b-4f3a-bca7-ea2b6adc0754 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:30.810660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc01f5-847b-4f3a-bca7-ea2b6adc0754 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:30.811075 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc01f5-847b-4f3a-bca7-ea2b6adc0754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:30.834579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc01f5-847b-4f3a-bca7-ea2b6adc0754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:30.840711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc01f5-847b-4f3a-bca7-ea2b6adc0754 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:30.863260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 814/1631] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:30 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:31.491165 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52a2e2-2378-4028-be04-a63438f148f4 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:31.635286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52a2e2-2378-4028-be04-a63438f148f4 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:31.648770 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c52cd-2b3b-4123-af85-cdca9666be6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:31.651574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c52cd-2b3b-4123-af85-cdca9666be6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:31.651574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c52cd-2b3b-4123-af85-cdca9666be6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:31.651797 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c52cd-2b3b-4123-af85-cdca9666be6a admin admin] PATH_INFO: `/v3/users/440627e1d7e542039a3cee9d057e78e9` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:31.668380 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c52cd-2b3b-4123-af85-cdca9666be6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=440627e1d7e542039a3cee9d057e78e9)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:31.705677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c52cd-2b3b-4123-af85-cdca9666be6a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:31.816080 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:31.818982 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3a3c52cd-2b3b-4123-af85-cdca9666be6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440627e1d7e542039a3cee9d057e78e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:31.833879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3a3c52cd-2b3b-4123-af85-cdca9666be6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440627e1d7e542039a3cee9d057e78e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:31.887252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3a3c52cd-2b3b-4123-af85-cdca9666be6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440627e1d7e542039a3cee9d057e78e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:31.919448 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3a3c52cd-2b3b-4123-af85-cdca9666be6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440627e1d7e542039a3cee9d057e78e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:31.922439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3a3c52cd-2b3b-4123-af85-cdca9666be6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440627e1d7e542039a3cee9d057e78e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:31.945312 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 818/1632] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:23:31 2022] DELETE /identity/v3/users/440627e1d7e542039a3cee9d057e78e9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:31.949879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29f235-d386-4a9b-b92d-1b18c5203c39 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:31.950368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29f235-d386-4a9b-b92d-1b18c5203c39 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:31.950368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29f235-d386-4a9b-b92d-1b18c5203c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:32.000391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ab29f235-d386-4a9b-b92d-1b18c5203c39 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:32.006255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ab29f235-d386-4a9b-b92d-1b18c5203c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:32.225528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 815/1633] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:32.259705 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c52cd-2b3b-4123-af85-cdca9666be6a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:32.261563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3a3c52cd-2b3b-4123-af85-cdca9666be6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:32.332856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54649e-6c0e-4b7c-bf28-27dce8360926 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:32.333510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54649e-6c0e-4b7c-bf28-27dce8360926 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:32.334052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54649e-6c0e-4b7c-bf28-27dce8360926 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:32.337178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 816/1634] 10.222.0.57 () {54 vars in 961 bytes} [Tue Sep 27 17:23:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:23:32.368851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789bc4-98fa-4966-af31-d5c320145498 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:32.369379 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789bc4-98fa-4966-af31-d5c320145498 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:32.369878 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789bc4-98fa-4966-af31-d5c320145498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:32.418944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-34789bc4-98fa-4966-af31-d5c320145498 None None] MFA Rules not processed for user `e75b03fde75e411bace8d406237a7e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:32.421084 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-34789bc4-98fa-4966-af31-d5c320145498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:32.444227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c52cd-2b3b-4123-af85-cdca9666be6a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:32.453973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e16ab-6c9c-425c-80d2-7f552f297925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:32.454835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e16ab-6c9c-425c-80d2-7f552f297925 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:32.455379 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e16ab-6c9c-425c-80d2-7f552f297925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:32.455818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e16ab-6c9c-425c-80d2-7f552f297925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:32.476858 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e16ab-6c9c-425c-80d2-7f552f297925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:32.479793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e16ab-6c9c-425c-80d2-7f552f297925 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:32.505378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 819/1635] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:32.516557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:32.581156 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 817/1636] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Sep 27 17:23:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:23:32.587912 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b27595-62ba-4acf-b82e-95615ea647af None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:32.588365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b27595-62ba-4acf-b82e-95615ea647af None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:32.588646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b27595-62ba-4acf-b82e-95615ea647af None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:32.590408 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 820/1637] 10.222.0.57 () {54 vars in 912 bytes} [Tue Sep 27 17:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:23:32.595514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fdfc3-c6ea-4944-bd35-b77c98374a6a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:32.596429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fdfc3-c6ea-4944-bd35-b77c98374a6a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:32.597263 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fdfc3-c6ea-4944-bd35-b77c98374a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:32.623839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d43fdfc3-c6ea-4944-bd35-b77c98374a6a None None] MFA Rules not processed for user `e75b03fde75e411bace8d406237a7e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:32.626166 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d43fdfc3-c6ea-4944-bd35-b77c98374a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:32.641539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 818/1638] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Sep 27 17:23:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:32.654636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b27595-62ba-4acf-b82e-95615ea647af None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:32.658549 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a3b27595-62ba-4acf-b82e-95615ea647af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:32.764745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b27595-62ba-4acf-b82e-95615ea647af None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:32.771424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a06cdd-42c5-4344-8bc4-125bf5da89ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:32.772241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a06cdd-42c5-4344-8bc4-125bf5da89ea service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:32.772814 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a06cdd-42c5-4344-8bc4-125bf5da89ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:32.774315 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a06cdd-42c5-4344-8bc4-125bf5da89ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:32.793562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a06cdd-42c5-4344-8bc4-125bf5da89ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:32.795367 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a06cdd-42c5-4344-8bc4-125bf5da89ea service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:32.826083 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 821/1639] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:34.956714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fdfc3-c6ea-4944-bd35-b77c98374a6a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:34.958707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d43fdfc3-c6ea-4944-bd35-b77c98374a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:34.981305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fdfc3-c6ea-4944-bd35-b77c98374a6a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:34.995749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1c268-832e-4775-ba67-45371160cb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:34.996634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1c268-832e-4775-ba67-45371160cb7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:34.997081 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1c268-832e-4775-ba67-45371160cb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:35.001058 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1c268-832e-4775-ba67-45371160cb7d admin admin] PATH_INFO: `/v3/users/e3a27cdca85d4af8aa4028cd045969f1` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:35.003224 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1c268-832e-4775-ba67-45371160cb7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a27cdca85d4af8aa4028cd045969f1)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:35.004420 dv-cinder-849143-8-smb devstack@keystone.service[81378]: WARNING py.warnings [None req-90e1c268-832e-4775-ba67-45371160cb7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 17:23:35.004420 dv-cinder-849143-8-smb devstack@keystone.service[81378]: warnings.warn(msg) Sep 27 17:23:35.004420 dv-cinder-849143-8-smb devstack@keystone.service[81378]: Sep 27 17:23:35.009648 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1c268-832e-4775-ba67-45371160cb7d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:35.022648 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a06cdd-42c5-4344-8bc4-125bf5da89ea service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:35.024116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c7a06cdd-42c5-4344-8bc4-125bf5da89ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:35.050680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a06cdd-42c5-4344-8bc4-125bf5da89ea service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:35.065882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:35.066479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:35.066761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:35.067039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] PATH_INFO: `/v3/projects/104aa7d64f794f75a200c20283b7aa87` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:35.069220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] RBAC: Authorizing `identity:delete_project(project_id=104aa7d64f794f75a200c20283b7aa87)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:35.070273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 17:23:35.070273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: warnings.warn(msg) Sep 27 17:23:35.070273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: Sep 27 17:23:35.071508 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:35.184731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-90e1c268-832e-4775-ba67-45371160cb7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a27cdca85d4af8aa4028cd045969f1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:35.187803 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-90e1c268-832e-4775-ba67-45371160cb7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a27cdca85d4af8aa4028cd045969f1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:35.212024 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-90e1c268-832e-4775-ba67-45371160cb7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a27cdca85d4af8aa4028cd045969f1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:35.234772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104aa7d64f794f75a200c20283b7aa87', 'request_id': 'req-0c6d100a-32ff-4cf0-8161-f485baa0093e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:35.243330 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:35.245156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104aa7d64f794f75a200c20283b7aa87', 'request_id': 'req-0c6d100a-32ff-4cf0-8161-f485baa0093e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:35.274849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104aa7d64f794f75a200c20283b7aa87', 'request_id': 'req-0c6d100a-32ff-4cf0-8161-f485baa0093e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:35.294775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] The token cache is being invalidate because project 104aa7d64f794f75a200c20283b7aa87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:23:35.295381 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:35.296363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:35.298537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 822/1640] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:23:35 2022] DELETE /identity/v3/projects/104aa7d64f794f75a200c20283b7aa87 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:23:35.302925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:35.305582 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:35.306097 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-90e1c268-832e-4775-ba67-45371160cb7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a27cdca85d4af8aa4028cd045969f1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:35.349222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-90e1c268-832e-4775-ba67-45371160cb7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a27cdca85d4af8aa4028cd045969f1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:35.384817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 819/1641] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:23:34 2022] DELETE /identity/v3/users/e3a27cdca85d4af8aa4028cd045969f1 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:35.386945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ea92a-64ba-4eab-bb8f-570a667d5606 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:35.387233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ea92a-64ba-4eab-bb8f-570a667d5606 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:35.387506 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ea92a-64ba-4eab-bb8f-570a667d5606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:35.443352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d100a-32ff-4cf0-8161-f485baa0093e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:35.457620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-815ea92a-64ba-4eab-bb8f-570a667d5606 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:35.462536 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-815ea92a-64ba-4eab-bb8f-570a667d5606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:35.606669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feefebb-2703-4859-b6d0-307e7631d5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:35.610578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feefebb-2703-4859-b6d0-307e7631d5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:35.612269 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feefebb-2703-4859-b6d0-307e7631d5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:35.612627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feefebb-2703-4859-b6d0-307e7631d5c6 admin admin] PATH_INFO: `/v3/users/c953a60161f5442a822cca6e197f1356` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:35.615407 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feefebb-2703-4859-b6d0-307e7631d5c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c953a60161f5442a822cca6e197f1356)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:35.618121 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feefebb-2703-4859-b6d0-307e7631d5c6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:35.658501 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 820/1642] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:35.705077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ea92a-64ba-4eab-bb8f-570a667d5606 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:35.706688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-815ea92a-64ba-4eab-bb8f-570a667d5606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:35.735799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9feefebb-2703-4859-b6d0-307e7631d5c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c953a60161f5442a822cca6e197f1356'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:35.756220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9feefebb-2703-4859-b6d0-307e7631d5c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c953a60161f5442a822cca6e197f1356'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:35.782626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9feefebb-2703-4859-b6d0-307e7631d5c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c953a60161f5442a822cca6e197f1356'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:35.816392 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9feefebb-2703-4859-b6d0-307e7631d5c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c953a60161f5442a822cca6e197f1356'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:35.818291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9feefebb-2703-4859-b6d0-307e7631d5c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c953a60161f5442a822cca6e197f1356'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:35.834010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 823/1643] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:23:35 2022] DELETE /identity/v3/users/c953a60161f5442a822cca6e197f1356 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:35.856277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ea92a-64ba-4eab-bb8f-570a667d5606 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:35.863235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:35.984996 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6113f7-3ede-494b-8baa-de82b9ceb974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:35.985631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6113f7-3ede-494b-8baa-de82b9ceb974 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:35.985933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6113f7-3ede-494b-8baa-de82b9ceb974 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:35.986207 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6113f7-3ede-494b-8baa-de82b9ceb974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:35.994450 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6a6113f7-3ede-494b-8baa-de82b9ceb974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:36.165159 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6113f7-3ede-494b-8baa-de82b9ceb974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:36.166764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6113f7-3ede-494b-8baa-de82b9ceb974 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:36.187652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 821/1644] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:37.029517 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbfc3d-a24e-4c51-b909-1da4a7e8a4ab None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:37.030757 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbfc3d-a24e-4c51-b909-1da4a7e8a4ab None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:37.031252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbfc3d-a24e-4c51-b909-1da4a7e8a4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:37.097131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:37.113395 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2dcbfc3d-a24e-4c51-b909-1da4a7e8a4ab None None] MFA Rules not processed for user `41d1e8b097a14cba91218e7a9b32f6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:37.120317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2dcbfc3d-a24e-4c51-b909-1da4a7e8a4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:37.199151 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6113f7-3ede-494b-8baa-de82b9ceb974 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:37.201198 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6a6113f7-3ede-494b-8baa-de82b9ceb974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:37.238388 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6113f7-3ede-494b-8baa-de82b9ceb974 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:37.249417 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b8291-9429-4b89-9682-edbb7cf8cd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:37.250347 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b8291-9429-4b89-9682-edbb7cf8cd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:37.250841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b8291-9429-4b89-9682-edbb7cf8cd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:37.251398 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b8291-9429-4b89-9682-edbb7cf8cd87 admin admin] PATH_INFO: `/v3/projects/6ff7f39096b74432833b7debd339a4de` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:37.253838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b8291-9429-4b89-9682-edbb7cf8cd87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff7f39096b74432833b7debd339a4de)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:37.258370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b8291-9429-4b89-9682-edbb7cf8cd87 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:37.310533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 824/1645] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:37.328215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbfc3d-a24e-4c51-b909-1da4a7e8a4ab None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:37.329744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2dcbfc3d-a24e-4c51-b909-1da4a7e8a4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:37.367717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-738b8291-9429-4b89-9682-edbb7cf8cd87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff7f39096b74432833b7debd339a4de', 'request_id': 'req-738b8291-9429-4b89-9682-edbb7cf8cd87'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:37.384514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-738b8291-9429-4b89-9682-edbb7cf8cd87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff7f39096b74432833b7debd339a4de', 'request_id': 'req-738b8291-9429-4b89-9682-edbb7cf8cd87'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:37.405329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-738b8291-9429-4b89-9682-edbb7cf8cd87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff7f39096b74432833b7debd339a4de', 'request_id': 'req-738b8291-9429-4b89-9682-edbb7cf8cd87'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:37.447553 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-738b8291-9429-4b89-9682-edbb7cf8cd87 admin admin] The token cache is being invalidate because project 6ff7f39096b74432833b7debd339a4de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:23:37.447894 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-738b8291-9429-4b89-9682-edbb7cf8cd87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:37.448629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-738b8291-9429-4b89-9682-edbb7cf8cd87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:37.450418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 822/1646] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:23:37 2022] DELETE /identity/v3/projects/6ff7f39096b74432833b7debd339a4de => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:37.455533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abf208-bbf7-41d7-aca7-658f5b589d10 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:37.455817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abf208-bbf7-41d7-aca7-658f5b589d10 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:37.456155 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abf208-bbf7-41d7-aca7-658f5b589d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:37.480628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-91abf208-bbf7-41d7-aca7-658f5b589d10 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:37.481905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-91abf208-bbf7-41d7-aca7-658f5b589d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:37.571118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:37.608510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 823/1647] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:37.611516 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3185a-2db1-4f73-848a-1d094bdbc1de None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:37.611934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3185a-2db1-4f73-848a-1d094bdbc1de None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:37.612220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3185a-2db1-4f73-848a-1d094bdbc1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:37.621717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbfc3d-a24e-4c51-b909-1da4a7e8a4ab None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:37.668555 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-19d3185a-2db1-4f73-848a-1d094bdbc1de None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:37.670804 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-19d3185a-2db1-4f73-848a-1d094bdbc1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:37.700333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 824/1648] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:37.701106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3185a-2db1-4f73-848a-1d094bdbc1de None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:37.731833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3185a-2db1-4f73-848a-1d094bdbc1de None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:37.745449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65950f5-cad6-4809-be9d-18f8397d2afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:37.747058 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65950f5-cad6-4809-be9d-18f8397d2afb admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:37.747442 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65950f5-cad6-4809-be9d-18f8397d2afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:37.747605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65950f5-cad6-4809-be9d-18f8397d2afb admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:37.749546 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65950f5-cad6-4809-be9d-18f8397d2afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:23:37.749897 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65950f5-cad6-4809-be9d-18f8397d2afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:37.754402 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65950f5-cad6-4809-be9d-18f8397d2afb admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:37.789057 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 825/1649] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:23:37.790729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65950f5-cad6-4809-be9d-18f8397d2afb admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:37.812664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65950f5-cad6-4809-be9d-18f8397d2afb admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:37.827343 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c95d2c-3628-48e1-b9c8-979f3035e1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:37.828617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c95d2c-3628-48e1-b9c8-979f3035e1cf admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:37.828897 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c95d2c-3628-48e1-b9c8-979f3035e1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:37.829169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c95d2c-3628-48e1-b9c8-979f3035e1cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:37.829837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c95d2c-3628-48e1-b9c8-979f3035e1cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:37.835193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c95d2c-3628-48e1-b9c8-979f3035e1cf admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:37.872495 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b2bf1-9ac7-4d6c-8ebc-12e26f8bde6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:37.873030 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b2bf1-9ac7-4d6c-8ebc-12e26f8bde6a service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:37.873313 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b2bf1-9ac7-4d6c-8ebc-12e26f8bde6a service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:37.873614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b2bf1-9ac7-4d6c-8ebc-12e26f8bde6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:37.879846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-959b2bf1-9ac7-4d6c-8ebc-12e26f8bde6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:37.904053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 826/1650] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:37 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:37.911827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c95d2c-3628-48e1-b9c8-979f3035e1cf admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:38.002652 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:38.090609 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b2bf1-9ac7-4d6c-8ebc-12e26f8bde6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:38.093100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b2bf1-9ac7-4d6c-8ebc-12e26f8bde6a service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:38.116690 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 825/1651] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 789 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:23:38.215127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c95d2c-3628-48e1-b9c8-979f3035e1cf admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:38.249314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6b1e8-02bc-484e-b4d6-c0c74ff24987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:38.251183 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6b1e8-02bc-484e-b4d6-c0c74ff24987 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:38.251483 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6b1e8-02bc-484e-b4d6-c0c74ff24987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:38.251761 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6b1e8-02bc-484e-b4d6-c0c74ff24987 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:38.252419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6b1e8-02bc-484e-b4d6-c0c74ff24987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:38.260971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6b1e8-02bc-484e-b4d6-c0c74ff24987 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:38.341896 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 827/1652] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:37 2022] POST /identity/v3/users => generated 283 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:38.344805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b2bf1-9ac7-4d6c-8ebc-12e26f8bde6a service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:38.360170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b2bf1-9ac7-4d6c-8ebc-12e26f8bde6a service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:38.369926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86cac-1570-45e0-a846-17eedade3686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:38.370694 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86cac-1570-45e0-a846-17eedade3686 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:38.371133 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86cac-1570-45e0-a846-17eedade3686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:38.373539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86cac-1570-45e0-a846-17eedade3686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:38.374568 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f86cac-1570-45e0-a846-17eedade3686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:38.376884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f86cac-1570-45e0-a846-17eedade3686 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:38.405817 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 826/1653] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:23:38.405960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6b1e8-02bc-484e-b4d6-c0c74ff24987 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:38.427557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6b1e8-02bc-484e-b4d6-c0c74ff24987 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:38.445475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8479d3-bf5f-4690-addd-5350f3181048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:38.446348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8479d3-bf5f-4690-addd-5350f3181048 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:38.446787 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8479d3-bf5f-4690-addd-5350f3181048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:38.447216 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8479d3-bf5f-4690-addd-5350f3181048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:38.448148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8479d3-bf5f-4690-addd-5350f3181048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:38.449950 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8479d3-bf5f-4690-addd-5350f3181048 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:38.481351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 828/1654] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:23:38.487625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86cac-1570-45e0-a846-17eedade3686 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:38.508982 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86cac-1570-45e0-a846-17eedade3686 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:38.517415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5729e-76ba-4fed-a1d6-ae54a533667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:38.518177 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5729e-76ba-4fed-a1d6-ae54a533667d admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:38.519695 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5729e-76ba-4fed-a1d6-ae54a533667d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:38.519917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5729e-76ba-4fed-a1d6-ae54a533667d admin admin] PATH_INFO: `/v3/projects/d50729446dab4355bf48ca729c8f20b0/users/8329cb4e319c40d28eb9753a02a5ce2c/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:38.568233 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5729e-76ba-4fed-a1d6-ae54a533667d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50729446dab4355bf48ca729c8f20b0, user_id=8329cb4e319c40d28eb9753a02a5ce2c, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:38.574810 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5729e-76ba-4fed-a1d6-ae54a533667d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:38.623102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 827/1655] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:38 2022] PUT /identity/v3/projects/d50729446dab4355bf48ca729c8f20b0/users/8329cb4e319c40d28eb9753a02a5ce2c/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:38.627629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf644f1c-6b3e-4507-95ea-640fbdf61614 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:38.627957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf644f1c-6b3e-4507-95ea-640fbdf61614 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:38.628240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf644f1c-6b3e-4507-95ea-640fbdf61614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:38.683325 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-cf644f1c-6b3e-4507-95ea-640fbdf61614 None None] MFA Rules not processed for user `8329cb4e319c40d28eb9753a02a5ce2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:38.684530 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cf644f1c-6b3e-4507-95ea-640fbdf61614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:38.851798 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 829/1656] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:38.856122 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5729e-76ba-4fed-a1d6-ae54a533667d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:39.010994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5729e-76ba-4fed-a1d6-ae54a533667d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:39.018063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95853213-f59d-441f-a78f-8b556d2cdac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:39.018709 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95853213-f59d-441f-a78f-8b556d2cdac4 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:39.018980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95853213-f59d-441f-a78f-8b556d2cdac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:39.019253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95853213-f59d-441f-a78f-8b556d2cdac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:39.019977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95853213-f59d-441f-a78f-8b556d2cdac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:39.022156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95853213-f59d-441f-a78f-8b556d2cdac4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:39.069156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 828/1657] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:38 2022] POST /identity/v3/projects => generated 365 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:39.072986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf644f1c-6b3e-4507-95ea-640fbdf61614 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:39.093612 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf644f1c-6b3e-4507-95ea-640fbdf61614 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:39.104754 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:39.112161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95853213-f59d-441f-a78f-8b556d2cdac4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:39.114140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-95853213-f59d-441f-a78f-8b556d2cdac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:39.248335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c082538-1232-4390-8153-1c6d0f895c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:39.249856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c082538-1232-4390-8153-1c6d0f895c79 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:39.253989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c082538-1232-4390-8153-1c6d0f895c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:39.254752 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c082538-1232-4390-8153-1c6d0f895c79 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:39.259065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c082538-1232-4390-8153-1c6d0f895c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:39.262816 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c082538-1232-4390-8153-1c6d0f895c79 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:39.281624 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95853213-f59d-441f-a78f-8b556d2cdac4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:39.293616 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43701cb1-3bb5-487e-ba8d-748157bf953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:39.295049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43701cb1-3bb5-487e-ba8d-748157bf953d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:39.295681 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43701cb1-3bb5-487e-ba8d-748157bf953d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:39.296181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43701cb1-3bb5-487e-ba8d-748157bf953d admin admin] PATH_INFO: `/v3/projects/f2a0e09b11e34588bb78f236a0428fe9` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:39.309401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43701cb1-3bb5-487e-ba8d-748157bf953d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a0e09b11e34588bb78f236a0428fe9)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:39.313632 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 830/1658] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:39 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:39.315162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43701cb1-3bb5-487e-ba8d-748157bf953d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:39.331121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c082538-1232-4390-8153-1c6d0f895c79 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:39.347249 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c082538-1232-4390-8153-1c6d0f895c79 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:39.353144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98831144-e816-4f66-952c-77a831c1fc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:39.354107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98831144-e816-4f66-952c-77a831c1fc41 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:39.354392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98831144-e816-4f66-952c-77a831c1fc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:39.354705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98831144-e816-4f66-952c-77a831c1fc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:39.355439 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98831144-e816-4f66-952c-77a831c1fc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:39.357986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98831144-e816-4f66-952c-77a831c1fc41 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:39.377190 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 831/1659] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:39.378100 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98831144-e816-4f66-952c-77a831c1fc41 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:39.387851 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:39.397292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98831144-e816-4f66-952c-77a831c1fc41 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:39.422900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-43701cb1-3bb5-487e-ba8d-748157bf953d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a0e09b11e34588bb78f236a0428fe9', 'request_id': 'req-43701cb1-3bb5-487e-ba8d-748157bf953d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:39.434889 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-43701cb1-3bb5-487e-ba8d-748157bf953d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a0e09b11e34588bb78f236a0428fe9', 'request_id': 'req-43701cb1-3bb5-487e-ba8d-748157bf953d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:39.444604 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-43701cb1-3bb5-487e-ba8d-748157bf953d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a0e09b11e34588bb78f236a0428fe9', 'request_id': 'req-43701cb1-3bb5-487e-ba8d-748157bf953d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:39.467083 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-43701cb1-3bb5-487e-ba8d-748157bf953d admin admin] The token cache is being invalidate because project f2a0e09b11e34588bb78f236a0428fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:23:39.467437 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-43701cb1-3bb5-487e-ba8d-748157bf953d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:39.468591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-43701cb1-3bb5-487e-ba8d-748157bf953d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:39.470473 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 829/1660] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:23:39 2022] DELETE /identity/v3/projects/f2a0e09b11e34588bb78f236a0428fe9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:39.477055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94a9d6-1472-446e-8ad5-90aff05302d0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:39.478394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94a9d6-1472-446e-8ad5-90aff05302d0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:39.479126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94a9d6-1472-446e-8ad5-90aff05302d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:39.506054 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3f94a9d6-1472-446e-8ad5-90aff05302d0 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:39.507283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3f94a9d6-1472-446e-8ad5-90aff05302d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:39.551313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9bf05-e48b-4394-872a-409ca056bca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:39.558554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9bf05-e48b-4394-872a-409ca056bca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:39.558835 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9bf05-e48b-4394-872a-409ca056bca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:39.559243 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9bf05-e48b-4394-872a-409ca056bca6 admin admin] PATH_INFO: `/v3/projects/ac1a6da7298d43d2be49213b3dcf9957/users/378a7ec97bac438ebff3b6db5d00539d/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:39.602720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9bf05-e48b-4394-872a-409ca056bca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1a6da7298d43d2be49213b3dcf9957, user_id=378a7ec97bac438ebff3b6db5d00539d, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:39.607506 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9bf05-e48b-4394-872a-409ca056bca6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:39.637738 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 832/1661] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:39 2022] PUT /identity/v3/projects/ac1a6da7298d43d2be49213b3dcf9957/users/378a7ec97bac438ebff3b6db5d00539d/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:39.640578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 830/1662] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:39.648598 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9bf05-e48b-4394-872a-409ca056bca6 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:39.649827 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85889e3a-a5be-4cb6-bcfa-d1674420804d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:39.650143 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85889e3a-a5be-4cb6-bcfa-d1674420804d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:39.650258 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7ed9bf05-e48b-4394-872a-409ca056bca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:39.650648 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85889e3a-a5be-4cb6-bcfa-d1674420804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:39.706538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-85889e3a-a5be-4cb6-bcfa-d1674420804d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:39.710587 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-85889e3a-a5be-4cb6-bcfa-d1674420804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:39.835806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9bf05-e48b-4394-872a-409ca056bca6 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:39.846852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd21731-d26d-48f7-ac9d-82b4f0ce357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:39.850544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd21731-d26d-48f7-ac9d-82b4f0ce357c admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:39.850999 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd21731-d26d-48f7-ac9d-82b4f0ce357c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:39.851994 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd21731-d26d-48f7-ac9d-82b4f0ce357c admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:39.854471 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd21731-d26d-48f7-ac9d-82b4f0ce357c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:39.857178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd21731-d26d-48f7-ac9d-82b4f0ce357c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:39.873743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 831/1663] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:39.877436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85889e3a-a5be-4cb6-bcfa-d1674420804d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:39.890233 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85889e3a-a5be-4cb6-bcfa-d1674420804d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:39.900359 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bad958-df4b-41a6-9d3a-0698eb00d961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:39.901431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bad958-df4b-41a6-9d3a-0698eb00d961 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:39.902090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bad958-df4b-41a6-9d3a-0698eb00d961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:39.902766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bad958-df4b-41a6-9d3a-0698eb00d961 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:39.903681 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bad958-df4b-41a6-9d3a-0698eb00d961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:23:39.904315 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bad958-df4b-41a6-9d3a-0698eb00d961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:39.906120 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bad958-df4b-41a6-9d3a-0698eb00d961 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:39.909960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 833/1664] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:39.913139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd21731-d26d-48f7-ac9d-82b4f0ce357c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:39.935925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 832/1665] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:23:39.943873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bad958-df4b-41a6-9d3a-0698eb00d961 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:39.948271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd21731-d26d-48f7-ac9d-82b4f0ce357c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:39.960587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dccb2-7f78-4a8b-bf16-c3ef2ca50585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:39.961595 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dccb2-7f78-4a8b-bf16-c3ef2ca50585 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:39.962459 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dccb2-7f78-4a8b-bf16-c3ef2ca50585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:39.962919 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dccb2-7f78-4a8b-bf16-c3ef2ca50585 admin admin] PATH_INFO: `/v3/projects/ac1a6da7298d43d2be49213b3dcf9957/users/378a7ec97bac438ebff3b6db5d00539d/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:39.965510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bad958-df4b-41a6-9d3a-0698eb00d961 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:39.965739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dccb2-7f78-4a8b-bf16-c3ef2ca50585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1a6da7298d43d2be49213b3dcf9957, user_id=378a7ec97bac438ebff3b6db5d00539d, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:39.970615 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dccb2-7f78-4a8b-bf16-c3ef2ca50585 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:39.974296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:39.976826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70e83b-fbdc-497d-be2a-ea991498b318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:39.977812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70e83b-fbdc-497d-be2a-ea991498b318 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:39.978796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70e83b-fbdc-497d-be2a-ea991498b318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:39.979460 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70e83b-fbdc-497d-be2a-ea991498b318 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:39.980806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70e83b-fbdc-497d-be2a-ea991498b318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:39.986004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70e83b-fbdc-497d-be2a-ea991498b318 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:40.002174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 834/1666] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:39 2022] PUT /identity/v3/projects/ac1a6da7298d43d2be49213b3dcf9957/users/378a7ec97bac438ebff3b6db5d00539d/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:23:40.004123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a1a59-4ce8-4781-a85e-a4c9a6dc68b6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:40.004413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a1a59-4ce8-4781-a85e-a4c9a6dc68b6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:40.009170 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a1a59-4ce8-4781-a85e-a4c9a6dc68b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:40.063294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 833/1667] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:39 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:40.068538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70e83b-fbdc-497d-be2a-ea991498b318 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:40.090009 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-361a1a59-4ce8-4781-a85e-a4c9a6dc68b6 None None] MFA Rules not processed for user `378a7ec97bac438ebff3b6db5d00539d`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:40.092900 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-361a1a59-4ce8-4781-a85e-a4c9a6dc68b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:40.131571 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:40.232517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 835/1668] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:40.245003 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a1a59-4ce8-4781-a85e-a4c9a6dc68b6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:40.246527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70e83b-fbdc-497d-be2a-ea991498b318 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:40.246806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-361a1a59-4ce8-4781-a85e-a4c9a6dc68b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:40.259575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a9aeb-8ba8-44c7-b83e-d23f82f83bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:40.260651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a9aeb-8ba8-44c7-b83e-d23f82f83bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:40.261182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a9aeb-8ba8-44c7-b83e-d23f82f83bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:40.261717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a9aeb-8ba8-44c7-b83e-d23f82f83bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:40.262742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a9aeb-8ba8-44c7-b83e-d23f82f83bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:40.265596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a9aeb-8ba8-44c7-b83e-d23f82f83bc7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:40.325748 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 834/1669] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:40 2022] POST /identity/v3/users => generated 303 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:40.330926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a9aeb-8ba8-44c7-b83e-d23f82f83bc7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:40.345107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a1a59-4ce8-4781-a85e-a4c9a6dc68b6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:40.352904 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca2db7-04e5-487c-a285-7e1abd8820aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:40.353174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca2db7-04e5-487c-a285-7e1abd8820aa service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:40.354202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca2db7-04e5-487c-a285-7e1abd8820aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:40.354202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca2db7-04e5-487c-a285-7e1abd8820aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:40.368568 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca2db7-04e5-487c-a285-7e1abd8820aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:40.371364 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca2db7-04e5-487c-a285-7e1abd8820aa service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:40.389320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 836/1670] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:40.409268 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a9aeb-8ba8-44c7-b83e-d23f82f83bc7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:40.440166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05fb7d-45a1-476a-899f-f105916bdf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:40.441074 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05fb7d-45a1-476a-899f-f105916bdf09 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:40.444428 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05fb7d-45a1-476a-899f-f105916bdf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:40.444608 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05fb7d-45a1-476a-899f-f105916bdf09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:40.445482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05fb7d-45a1-476a-899f-f105916bdf09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:40.447608 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05fb7d-45a1-476a-899f-f105916bdf09 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:40.491625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 835/1671] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:40.496118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca2db7-04e5-487c-a285-7e1abd8820aa service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:40.515905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca2db7-04e5-487c-a285-7e1abd8820aa service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:40.533294 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67c2a2-74f3-4200-ae72-0292bbbdbbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:40.534184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67c2a2-74f3-4200-ae72-0292bbbdbbae admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:40.534547 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67c2a2-74f3-4200-ae72-0292bbbdbbae admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:40.537982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67c2a2-74f3-4200-ae72-0292bbbdbbae admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:40.538761 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67c2a2-74f3-4200-ae72-0292bbbdbbae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:40.540617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67c2a2-74f3-4200-ae72-0292bbbdbbae admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:40.591638 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 837/1672] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:40.595063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05fb7d-45a1-476a-899f-f105916bdf09 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:40.613800 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67c2a2-74f3-4200-ae72-0292bbbdbbae admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:40.644901 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05fb7d-45a1-476a-899f-f105916bdf09 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:40.653965 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67c2a2-74f3-4200-ae72-0292bbbdbbae admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:40.666212 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4ee29-1d13-4cce-94c6-50aaf0df5555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:40.667276 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4ee29-1d13-4cce-94c6-50aaf0df5555 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:40.668751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2411a1-6fdf-486a-b477-d864012dae8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:40.669654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2411a1-6fdf-486a-b477-d864012dae8e service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:40.670217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4ee29-1d13-4cce-94c6-50aaf0df5555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:40.670998 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2411a1-6fdf-486a-b477-d864012dae8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:40.671193 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4ee29-1d13-4cce-94c6-50aaf0df5555 admin admin] PATH_INFO: `/v3/projects/17103dce1cb94a6cbfda089d2b6b9954/users/79f421f5a27b4202ab5d425d09482c03/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:40.672590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2411a1-6fdf-486a-b477-d864012dae8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:40.680915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cb2411a1-6fdf-486a-b477-d864012dae8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:40.717720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4ee29-1d13-4cce-94c6-50aaf0df5555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17103dce1cb94a6cbfda089d2b6b9954, user_id=79f421f5a27b4202ab5d425d09482c03, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:40.725112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4ee29-1d13-4cce-94c6-50aaf0df5555 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:40.760311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 836/1673] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:40 2022] PUT /identity/v3/projects/17103dce1cb94a6cbfda089d2b6b9954/users/79f421f5a27b4202ab5d425d09482c03/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:40.765553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54aade-9114-40a2-95f7-25a50a7df568 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:40.766298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54aade-9114-40a2-95f7-25a50a7df568 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:40.766581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54aade-9114-40a2-95f7-25a50a7df568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:40.874098 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7f54aade-9114-40a2-95f7-25a50a7df568 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:40.876545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7f54aade-9114-40a2-95f7-25a50a7df568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:40.922621 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2411a1-6fdf-486a-b477-d864012dae8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:40.924322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2411a1-6fdf-486a-b477-d864012dae8e service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:40.961575 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 838/1674] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:41.122488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 837/1675] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:41.472379 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2411a1-6fdf-486a-b477-d864012dae8e service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:41.474419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cb2411a1-6fdf-486a-b477-d864012dae8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:41.493967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:41.653164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2411a1-6fdf-486a-b477-d864012dae8e service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:41.731709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae7c7f-5e30-443d-a187-2418d1704ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:41.736055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae7c7f-5e30-443d-a187-2418d1704ded service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:41.736420 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae7c7f-5e30-443d-a187-2418d1704ded service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:41.741951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae7c7f-5e30-443d-a187-2418d1704ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:41.753362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae7c7f-5e30-443d-a187-2418d1704ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:41.755311 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae7c7f-5e30-443d-a187-2418d1704ded service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:41.771631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 839/1676] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:42.336059 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54aade-9114-40a2-95f7-25a50a7df568 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:42.337510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7f54aade-9114-40a2-95f7-25a50a7df568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:42.361200 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54aade-9114-40a2-95f7-25a50a7df568 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:42.374320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6fa73-cbf3-4a72-9992-8698da2ef092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:42.374994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fa73-cbf3-4a72-9992-8698da2ef092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:42.375281 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fa73-cbf3-4a72-9992-8698da2ef092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:42.375559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6fa73-cbf3-4a72-9992-8698da2ef092 admin admin] PATH_INFO: `/v3/users/95ea4163f4434f1b8227653a0534dc1f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:42.379190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6fa73-cbf3-4a72-9992-8698da2ef092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ea4163f4434f1b8227653a0534dc1f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:42.383523 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6fa73-cbf3-4a72-9992-8698da2ef092 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:42.543142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b3f6fa73-cbf3-4a72-9992-8698da2ef092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ea4163f4434f1b8227653a0534dc1f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:42.574050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b3f6fa73-cbf3-4a72-9992-8698da2ef092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ea4163f4434f1b8227653a0534dc1f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:42.629715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b3f6fa73-cbf3-4a72-9992-8698da2ef092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ea4163f4434f1b8227653a0534dc1f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:42.635760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:42.653009 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b3f6fa73-cbf3-4a72-9992-8698da2ef092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ea4163f4434f1b8227653a0534dc1f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:42.655628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b3f6fa73-cbf3-4a72-9992-8698da2ef092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ea4163f4434f1b8227653a0534dc1f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:42.680308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 838/1677] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:23:42 2022] DELETE /identity/v3/users/95ea4163f4434f1b8227653a0534dc1f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:42.681958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea294cf-43e3-46b8-baaf-9d169a62bdad None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:42.682857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea294cf-43e3-46b8-baaf-9d169a62bdad None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:42.685150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea294cf-43e3-46b8-baaf-9d169a62bdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:42.787728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0ea294cf-43e3-46b8-baaf-9d169a62bdad None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:42.790914 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0ea294cf-43e3-46b8-baaf-9d169a62bdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:42.981754 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 840/1678] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:43.042871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6fa73-cbf3-4a72-9992-8698da2ef092 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:43.045144 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b3f6fa73-cbf3-4a72-9992-8698da2ef092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:43.218039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6fa73-cbf3-4a72-9992-8698da2ef092 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:43.236720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3300-c259-42c4-b034-6d07fa9b3313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:43.236720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3300-c259-42c4-b034-6d07fa9b3313 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:43.236720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3300-c259-42c4-b034-6d07fa9b3313 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:43.236720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e3300-c259-42c4-b034-6d07fa9b3313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:43.280144 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e3300-c259-42c4-b034-6d07fa9b3313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:43.281868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e3300-c259-42c4-b034-6d07fa9b3313 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:43.320020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 839/1679] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:44.629373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24ba02-d373-451d-9bf6-33d4a7e15120 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:44.629373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24ba02-d373-451d-9bf6-33d4a7e15120 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:44.629373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24ba02-d373-451d-9bf6-33d4a7e15120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:44.707835 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-cc24ba02-d373-451d-9bf6-33d4a7e15120 None None] MFA Rules not processed for user `28c03fdc58424a9793e3df8579a8f78b`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:44.710257 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cc24ba02-d373-451d-9bf6-33d4a7e15120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:44.927615 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:44.944619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 841/1680] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:44.959806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3300-c259-42c4-b034-6d07fa9b3313 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:44.962538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ec8e3300-c259-42c4-b034-6d07fa9b3313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:45.069272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24ba02-d373-451d-9bf6-33d4a7e15120 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:45.070993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cc24ba02-d373-451d-9bf6-33d4a7e15120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:45.098192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24ba02-d373-451d-9bf6-33d4a7e15120 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:45.113974 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1390dce-8949-4b91-a063-e3ac93cf368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:45.115286 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1390dce-8949-4b91-a063-e3ac93cf368a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:45.115714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1390dce-8949-4b91-a063-e3ac93cf368a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:45.116102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1390dce-8949-4b91-a063-e3ac93cf368a admin admin] PATH_INFO: `/v3/users/8329cb4e319c40d28eb9753a02a5ce2c` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:45.117479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1390dce-8949-4b91-a063-e3ac93cf368a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8329cb4e319c40d28eb9753a02a5ce2c)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:45.123009 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1390dce-8949-4b91-a063-e3ac93cf368a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:45.176088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e3300-c259-42c4-b034-6d07fa9b3313 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:45.193846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255b1fd-a437-4a15-abf0-4b9e2730c664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:45.194465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255b1fd-a437-4a15-abf0-4b9e2730c664 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:45.197071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255b1fd-a437-4a15-abf0-4b9e2730c664 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:45.197444 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255b1fd-a437-4a15-abf0-4b9e2730c664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:45.217602 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255b1fd-a437-4a15-abf0-4b9e2730c664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:45.223237 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255b1fd-a437-4a15-abf0-4b9e2730c664 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:45.239580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c1390dce-8949-4b91-a063-e3ac93cf368a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8329cb4e319c40d28eb9753a02a5ce2c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:45.240536 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c1390dce-8949-4b91-a063-e3ac93cf368a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8329cb4e319c40d28eb9753a02a5ce2c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:45.262988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 840/1681] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:45.269770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c1390dce-8949-4b91-a063-e3ac93cf368a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8329cb4e319c40d28eb9753a02a5ce2c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:45.302426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c1390dce-8949-4b91-a063-e3ac93cf368a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8329cb4e319c40d28eb9753a02a5ce2c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:45.321639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c1390dce-8949-4b91-a063-e3ac93cf368a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8329cb4e319c40d28eb9753a02a5ce2c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:45.332075 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 842/1682] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:23:45 2022] DELETE /identity/v3/users/8329cb4e319c40d28eb9753a02a5ce2c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:45.337800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23df058-f8b0-4dae-ab54-3f8f36375f7e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:45.338290 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23df058-f8b0-4dae-ab54-3f8f36375f7e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:45.338604 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23df058-f8b0-4dae-ab54-3f8f36375f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:45.391186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e23df058-f8b0-4dae-ab54-3f8f36375f7e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:45.398011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e23df058-f8b0-4dae-ab54-3f8f36375f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:45.532829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 841/1683] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:45.558135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1390dce-8949-4b91-a063-e3ac93cf368a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:45.559499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c1390dce-8949-4b91-a063-e3ac93cf368a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:45.718126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1390dce-8949-4b91-a063-e3ac93cf368a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:45.729929 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13194668-240b-4c8e-b38d-fb0e29642cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:45.730893 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13194668-240b-4c8e-b38d-fb0e29642cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:45.731607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13194668-240b-4c8e-b38d-fb0e29642cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:45.731992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13194668-240b-4c8e-b38d-fb0e29642cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:45.747518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13194668-240b-4c8e-b38d-fb0e29642cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:45.751817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13194668-240b-4c8e-b38d-fb0e29642cf6 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:45.775787 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 843/1684] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:46.520497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ec3f8-cc66-45ea-bae9-8a2cac8885a7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:46.521888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ec3f8-cc66-45ea-bae9-8a2cac8885a7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:46.522377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ec3f8-cc66-45ea-bae9-8a2cac8885a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:46.568041 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-720ec3f8-cc66-45ea-bae9-8a2cac8885a7 None None] MFA Rules not processed for user `79f421f5a27b4202ab5d425d09482c03`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:46.572390 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-720ec3f8-cc66-45ea-bae9-8a2cac8885a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:46.584666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:46.767224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 842/1685] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:46 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:46.773348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13194668-240b-4c8e-b38d-fb0e29642cf6 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:46.775383 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-13194668-240b-4c8e-b38d-fb0e29642cf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:46.799268 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13194668-240b-4c8e-b38d-fb0e29642cf6 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:46.814597 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c906a-5e49-45bf-b60b-d65b917da3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:46.815246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c906a-5e49-45bf-b60b-d65b917da3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:46.815533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c906a-5e49-45bf-b60b-d65b917da3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:46.815810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c906a-5e49-45bf-b60b-d65b917da3e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:46.816456 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c906a-5e49-45bf-b60b-d65b917da3e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:46.819138 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c906a-5e49-45bf-b60b-d65b917da3e5 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:46.898557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 844/1686] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:46 2022] POST /identity/v3/projects => generated 405 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:46.900307 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ec3f8-cc66-45ea-bae9-8a2cac8885a7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:46.919727 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ec3f8-cc66-45ea-bae9-8a2cac8885a7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:47.092112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c906a-5e49-45bf-b60b-d65b917da3e5 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:47.094009 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-532c906a-5e49-45bf-b60b-d65b917da3e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:47.106501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6920567-9654-4607-a697-1d94f0d34e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:47.107146 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6920567-9654-4607-a697-1d94f0d34e14 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:47.107434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6920567-9654-4607-a697-1d94f0d34e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:47.107714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6920567-9654-4607-a697-1d94f0d34e14 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:47.108933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6920567-9654-4607-a697-1d94f0d34e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:47.110374 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6920567-9654-4607-a697-1d94f0d34e14 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:47.114841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c906a-5e49-45bf-b60b-d65b917da3e5 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:47.137917 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214c07-35c0-40a5-96c8-86aae0f8f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:47.139120 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214c07-35c0-40a5-96c8-86aae0f8f22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:47.139626 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214c07-35c0-40a5-96c8-86aae0f8f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:47.140119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214c07-35c0-40a5-96c8-86aae0f8f22a admin admin] PATH_INFO: `/v3/projects/d50729446dab4355bf48ca729c8f20b0` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:47.144904 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10214c07-35c0-40a5-96c8-86aae0f8f22a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50729446dab4355bf48ca729c8f20b0)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:47.158051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10214c07-35c0-40a5-96c8-86aae0f8f22a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:47.175323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 843/1687] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:46 2022] POST /identity/v3/users => generated 309 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:47.177194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bda9f5-e685-45e4-946f-40eecf2cdd2b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:47.177463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bda9f5-e685-45e4-946f-40eecf2cdd2b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:47.177784 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bda9f5-e685-45e4-946f-40eecf2cdd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:47.244475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b1bda9f5-e685-45e4-946f-40eecf2cdd2b None None] MFA Rules not processed for user `19f5565494964b36846b2e81447951a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:47.245763 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b1bda9f5-e685-45e4-946f-40eecf2cdd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:47.285349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:47.290819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-10214c07-35c0-40a5-96c8-86aae0f8f22a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50729446dab4355bf48ca729c8f20b0', 'request_id': 'req-10214c07-35c0-40a5-96c8-86aae0f8f22a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:47.310119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-10214c07-35c0-40a5-96c8-86aae0f8f22a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50729446dab4355bf48ca729c8f20b0', 'request_id': 'req-10214c07-35c0-40a5-96c8-86aae0f8f22a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:47.327092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-10214c07-35c0-40a5-96c8-86aae0f8f22a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50729446dab4355bf48ca729c8f20b0', 'request_id': 'req-10214c07-35c0-40a5-96c8-86aae0f8f22a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:47.349907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-10214c07-35c0-40a5-96c8-86aae0f8f22a admin admin] The token cache is being invalidate because project d50729446dab4355bf48ca729c8f20b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:23:47.349907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-10214c07-35c0-40a5-96c8-86aae0f8f22a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:47.353825 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-10214c07-35c0-40a5-96c8-86aae0f8f22a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:47.356217 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 845/1688] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:23:47 2022] DELETE /identity/v3/projects/d50729446dab4355bf48ca729c8f20b0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:23:47.359858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214c07-35c0-40a5-96c8-86aae0f8f22a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:47.363149 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-10214c07-35c0-40a5-96c8-86aae0f8f22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:47.402261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 844/1689] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:47.405652 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bda9f5-e685-45e4-946f-40eecf2cdd2b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:47.407635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b1bda9f5-e685-45e4-946f-40eecf2cdd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:47.443492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bda9f5-e685-45e4-946f-40eecf2cdd2b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:47.472831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:47.511965 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261128c8-89d0-46a0-b3d8-c475ab9a3154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:47.513079 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261128c8-89d0-46a0-b3d8-c475ab9a3154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:47.513437 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261128c8-89d0-46a0-b3d8-c475ab9a3154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:47.513835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261128c8-89d0-46a0-b3d8-c475ab9a3154 admin admin] PATH_INFO: `/v3/users/378a7ec97bac438ebff3b6db5d00539d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:47.517205 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214c07-35c0-40a5-96c8-86aae0f8f22a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:47.522168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261128c8-89d0-46a0-b3d8-c475ab9a3154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=378a7ec97bac438ebff3b6db5d00539d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:47.524318 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261128c8-89d0-46a0-b3d8-c475ab9a3154 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:47.524947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079a7ff-129b-42d7-80a8-75764004ffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:47.525588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079a7ff-129b-42d7-80a8-75764004ffd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:47.526443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079a7ff-129b-42d7-80a8-75764004ffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:47.526729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079a7ff-129b-42d7-80a8-75764004ffd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:47.527525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079a7ff-129b-42d7-80a8-75764004ffd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:47.529251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079a7ff-129b-42d7-80a8-75764004ffd3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:47.557585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 846/1690] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:47.561607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bad5a-4c2e-4faf-9384-62c0145ac2e7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:47.561932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bad5a-4c2e-4faf-9384-62c0145ac2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:47.562210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bad5a-4c2e-4faf-9384-62c0145ac2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:47.590308 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-349bad5a-4c2e-4faf-9384-62c0145ac2e7 None None] MFA Rules not processed for user `19f5565494964b36846b2e81447951a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:47.591554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-349bad5a-4c2e-4faf-9384-62c0145ac2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:47.624273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-261128c8-89d0-46a0-b3d8-c475ab9a3154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378a7ec97bac438ebff3b6db5d00539d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:47.639994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-261128c8-89d0-46a0-b3d8-c475ab9a3154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378a7ec97bac438ebff3b6db5d00539d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:47.669727 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-261128c8-89d0-46a0-b3d8-c475ab9a3154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378a7ec97bac438ebff3b6db5d00539d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:47.691812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-261128c8-89d0-46a0-b3d8-c475ab9a3154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378a7ec97bac438ebff3b6db5d00539d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:47.695629 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-261128c8-89d0-46a0-b3d8-c475ab9a3154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378a7ec97bac438ebff3b6db5d00539d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:47.707189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 845/1691] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:23:47 2022] DELETE /identity/v3/users/378a7ec97bac438ebff3b6db5d00539d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:47.707800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261128c8-89d0-46a0-b3d8-c475ab9a3154 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:47.717570 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-261128c8-89d0-46a0-b3d8-c475ab9a3154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:47.750696 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 847/1692] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:47.751791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bad5a-4c2e-4faf-9384-62c0145ac2e7 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:47.757997 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-349bad5a-4c2e-4faf-9384-62c0145ac2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:47.819456 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bad5a-4c2e-4faf-9384-62c0145ac2e7 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:47.865148 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261128c8-89d0-46a0-b3d8-c475ab9a3154 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:47.879024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaae8d6-5f57-4dcc-a390-71919993324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:47.881403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaae8d6-5f57-4dcc-a390-71919993324c admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:47.882103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaae8d6-5f57-4dcc-a390-71919993324c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:47.883750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaae8d6-5f57-4dcc-a390-71919993324c admin admin] PATH_INFO: `/v3/projects/aca5263a44d14c5d9be5706178e33cc0/users/386a4da149b846a082f5f23a47d872f3/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:47.922263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaae8d6-5f57-4dcc-a390-71919993324c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca5263a44d14c5d9be5706178e33cc0, user_id=386a4da149b846a082f5f23a47d872f3, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:47.933455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaae8d6-5f57-4dcc-a390-71919993324c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:47.970321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 846/1693] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:47 2022] PUT /identity/v3/projects/aca5263a44d14c5d9be5706178e33cc0/users/386a4da149b846a082f5f23a47d872f3/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:47.972262 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaae8d6-5f57-4dcc-a390-71919993324c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:47.976985 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7aaae8d6-5f57-4dcc-a390-71919993324c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:47.979733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09381610-f8bc-4034-a5ff-999d0fe96bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:47.980527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09381610-f8bc-4034-a5ff-999d0fe96bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:47.981409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09381610-f8bc-4034-a5ff-999d0fe96bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:47.982451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09381610-f8bc-4034-a5ff-999d0fe96bbc admin admin] PATH_INFO: `/v3/projects/082426bff6d947319c061a364fe933af` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:47.985044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09381610-f8bc-4034-a5ff-999d0fe96bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=082426bff6d947319c061a364fe933af)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:47.991229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09381610-f8bc-4034-a5ff-999d0fe96bbc admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:48.033398 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:48.067797 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:48.139682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-09381610-f8bc-4034-a5ff-999d0fe96bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082426bff6d947319c061a364fe933af', 'request_id': 'req-09381610-f8bc-4034-a5ff-999d0fe96bbc'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:48.149226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-09381610-f8bc-4034-a5ff-999d0fe96bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082426bff6d947319c061a364fe933af', 'request_id': 'req-09381610-f8bc-4034-a5ff-999d0fe96bbc'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:48.156010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaae8d6-5f57-4dcc-a390-71919993324c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:48.160520 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-09381610-f8bc-4034-a5ff-999d0fe96bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082426bff6d947319c061a364fe933af', 'request_id': 'req-09381610-f8bc-4034-a5ff-999d0fe96bbc'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:48.190836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-09381610-f8bc-4034-a5ff-999d0fe96bbc admin admin] The token cache is being invalidate because project 082426bff6d947319c061a364fe933af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:23:48.194153 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-09381610-f8bc-4034-a5ff-999d0fe96bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:48.196785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-09381610-f8bc-4034-a5ff-999d0fe96bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:48.202642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 848/1694] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:23:47 2022] DELETE /identity/v3/projects/082426bff6d947319c061a364fe933af => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:48.202642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09381610-f8bc-4034-a5ff-999d0fe96bbc admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:48.205584 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-09381610-f8bc-4034-a5ff-999d0fe96bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:48.341648 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e617d0-4b66-4ab9-ac70-b3f17bfcfbcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:48.348347 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e617d0-4b66-4ab9-ac70-b3f17bfcfbcf service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:48.349951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e617d0-4b66-4ab9-ac70-b3f17bfcfbcf service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:48.350457 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09381610-f8bc-4034-a5ff-999d0fe96bbc admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:48.350843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e617d0-4b66-4ab9-ac70-b3f17bfcfbcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:48.357554 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-82e617d0-4b66-4ab9-ac70-b3f17bfcfbcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:48.364106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba5212-a8d2-4287-b6e2-bcfb9fce7563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:48.366187 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba5212-a8d2-4287-b6e2-bcfb9fce7563 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:48.366704 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba5212-a8d2-4287-b6e2-bcfb9fce7563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:48.367158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba5212-a8d2-4287-b6e2-bcfb9fce7563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:48.368145 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba5212-a8d2-4287-b6e2-bcfb9fce7563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:48.370569 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba5212-a8d2-4287-b6e2-bcfb9fce7563 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:48.389809 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 849/1695] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:48.392218 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd40260-f643-4b37-b894-1389dc7010f3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:48.393505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd40260-f643-4b37-b894-1389dc7010f3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:48.394369 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd40260-f643-4b37-b894-1389dc7010f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:48.449900 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2fd40260-f643-4b37-b894-1389dc7010f3 None None] MFA Rules not processed for user `0b41c6ab73144570a7291dc674d95e66`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:48.455572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2fd40260-f643-4b37-b894-1389dc7010f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:48.486202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e617d0-4b66-4ab9-ac70-b3f17bfcfbcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:48.487918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e617d0-4b66-4ab9-ac70-b3f17bfcfbcf service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:48.501242 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 847/1696] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:48.503384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5731a8-57a8-4648-81fc-ab1142fbe8cf None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:48.503384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5731a8-57a8-4648-81fc-ab1142fbe8cf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:48.503857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5731a8-57a8-4648-81fc-ab1142fbe8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:48.535074 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ab5731a8-57a8-4648-81fc-ab1142fbe8cf None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:48.537533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ab5731a8-57a8-4648-81fc-ab1142fbe8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:48.592353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 848/1697] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:48.593117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5731a8-57a8-4648-81fc-ab1142fbe8cf None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:48.634930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5731a8-57a8-4648-81fc-ab1142fbe8cf None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:48.657656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b6056-dd0d-4c7b-8b57-64c026a9ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:48.657656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b6056-dd0d-4c7b-8b57-64c026a9ff1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:48.657656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b6056-dd0d-4c7b-8b57-64c026a9ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:48.657656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b6056-dd0d-4c7b-8b57-64c026a9ff1d admin admin] PATH_INFO: `/v3/projects/aca5263a44d14c5d9be5706178e33cc0/users/386a4da149b846a082f5f23a47d872f3/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:48.661864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b6056-dd0d-4c7b-8b57-64c026a9ff1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca5263a44d14c5d9be5706178e33cc0, user_id=386a4da149b846a082f5f23a47d872f3, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:48.665017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b6056-dd0d-4c7b-8b57-64c026a9ff1d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:48.711494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 849/1698] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:48 2022] PUT /identity/v3/projects/aca5263a44d14c5d9be5706178e33cc0/users/386a4da149b846a082f5f23a47d872f3/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:48.711494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162db692-11b7-4074-964b-e498f04c42ab None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:48.711494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162db692-11b7-4074-964b-e498f04c42ab None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:48.712645 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162db692-11b7-4074-964b-e498f04c42ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:48.743331 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-162db692-11b7-4074-964b-e498f04c42ab None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:48.744683 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-162db692-11b7-4074-964b-e498f04c42ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:48.761168 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 850/1699] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:48.773304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd40260-f643-4b37-b894-1389dc7010f3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:48.774959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2fd40260-f643-4b37-b894-1389dc7010f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:48.794123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd40260-f643-4b37-b894-1389dc7010f3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:48.849491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:48.858459 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:48.908328 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 850/1700] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:48.913133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be047f-5ffa-4589-962d-500b8c5a3de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:48.913995 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be047f-5ffa-4589-962d-500b8c5a3de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:48.914341 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be047f-5ffa-4589-962d-500b8c5a3de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:48.914731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be047f-5ffa-4589-962d-500b8c5a3de6 admin admin] PATH_INFO: `/v3/projects/ac1a6da7298d43d2be49213b3dcf9957` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:48.916039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd434901-64c9-4950-bd11-be9ac5403cb2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:48.916147 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be047f-5ffa-4589-962d-500b8c5a3de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1a6da7298d43d2be49213b3dcf9957)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:48.916591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd434901-64c9-4950-bd11-be9ac5403cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:48.917801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd434901-64c9-4950-bd11-be9ac5403cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:48.919456 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be047f-5ffa-4589-962d-500b8c5a3de6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:48.949381 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-dd434901-64c9-4950-bd11-be9ac5403cb2 None None] MFA Rules not processed for user `0b41c6ab73144570a7291dc674d95e66`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:48.951324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-dd434901-64c9-4950-bd11-be9ac5403cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:49.024679 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-21be047f-5ffa-4589-962d-500b8c5a3de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1a6da7298d43d2be49213b3dcf9957', 'request_id': 'req-21be047f-5ffa-4589-962d-500b8c5a3de6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:49.051644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-21be047f-5ffa-4589-962d-500b8c5a3de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1a6da7298d43d2be49213b3dcf9957', 'request_id': 'req-21be047f-5ffa-4589-962d-500b8c5a3de6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:49.071969 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-21be047f-5ffa-4589-962d-500b8c5a3de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1a6da7298d43d2be49213b3dcf9957', 'request_id': 'req-21be047f-5ffa-4589-962d-500b8c5a3de6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:49.119565 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-21be047f-5ffa-4589-962d-500b8c5a3de6 admin admin] The token cache is being invalidate because project ac1a6da7298d43d2be49213b3dcf9957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:23:49.120651 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-21be047f-5ffa-4589-962d-500b8c5a3de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:49.123206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-21be047f-5ffa-4589-962d-500b8c5a3de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:49.140281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 851/1701] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:23:48 2022] DELETE /identity/v3/projects/ac1a6da7298d43d2be49213b3dcf9957 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:49.140281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be047f-5ffa-4589-962d-500b8c5a3de6 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:49.143672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-21be047f-5ffa-4589-962d-500b8c5a3de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:49.151097 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 851/1702] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:49.152657 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50145555-3fbd-4bf2-851e-9ffe036b3b0c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:49.152972 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50145555-3fbd-4bf2-851e-9ffe036b3b0c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:49.162786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50145555-3fbd-4bf2-851e-9ffe036b3b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:49.254454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-50145555-3fbd-4bf2-851e-9ffe036b3b0c None None] MFA Rules not processed for user `41d1e8b097a14cba91218e7a9b32f6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:49.256383 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-50145555-3fbd-4bf2-851e-9ffe036b3b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:49.430037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be047f-5ffa-4589-962d-500b8c5a3de6 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:49.441733 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 852/1703] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:49.443871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee97d6-045b-43c1-a90d-2df1539aa524 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:49.444162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee97d6-045b-43c1-a90d-2df1539aa524 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:49.444437 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee97d6-045b-43c1-a90d-2df1539aa524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:49.450352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce5451-1363-40a5-ad1e-166f2b44e6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:49.450785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce5451-1363-40a5-ad1e-166f2b44e6bb admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:49.451075 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce5451-1363-40a5-ad1e-166f2b44e6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:49.451356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce5451-1363-40a5-ad1e-166f2b44e6bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:49.452029 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce5451-1363-40a5-ad1e-166f2b44e6bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:23:49.452339 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce5451-1363-40a5-ad1e-166f2b44e6bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:49.454512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce5451-1363-40a5-ad1e-166f2b44e6bb admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:49.512511 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c9ee97d6-045b-43c1-a90d-2df1539aa524 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:49.513792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c9ee97d6-045b-43c1-a90d-2df1539aa524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:49.517207 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 852/1704] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:23:49.521026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce5451-1363-40a5-ad1e-166f2b44e6bb admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:49.525425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-01ce5451-1363-40a5-ad1e-166f2b44e6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:49.553884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 853/1705] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:49.555750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee97d6-045b-43c1-a90d-2df1539aa524 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:49.575402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee97d6-045b-43c1-a90d-2df1539aa524 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:49.580538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e539ab3-bad3-4f04-a12a-4e36eb8ac015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:49.581555 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e539ab3-bad3-4f04-a12a-4e36eb8ac015 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:49.582076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e539ab3-bad3-4f04-a12a-4e36eb8ac015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:49.582835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e539ab3-bad3-4f04-a12a-4e36eb8ac015 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:49.583813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e539ab3-bad3-4f04-a12a-4e36eb8ac015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:49.586008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e539ab3-bad3-4f04-a12a-4e36eb8ac015 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:49.665950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 854/1706] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:49 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:49.665950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602b123-af8c-4a71-9e96-53e013f9d15f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:49.665950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602b123-af8c-4a71-9e96-53e013f9d15f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:49.666349 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602b123-af8c-4a71-9e96-53e013f9d15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:49.699496 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:49.708867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5602b123-af8c-4a71-9e96-53e013f9d15f None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:49.716525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5602b123-af8c-4a71-9e96-53e013f9d15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:49.753462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce5451-1363-40a5-ad1e-166f2b44e6bb admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:49.867212 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 855/1707] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:49.868358 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602b123-af8c-4a71-9e96-53e013f9d15f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:49.882578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602b123-af8c-4a71-9e96-53e013f9d15f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:49.892192 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e2759-7f83-4b26-aeb1-314694a26549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:49.892923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e2759-7f83-4b26-aeb1-314694a26549 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:49.893297 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e2759-7f83-4b26-aeb1-314694a26549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:49.893642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e2759-7f83-4b26-aeb1-314694a26549 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:49.895049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e2759-7f83-4b26-aeb1-314694a26549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:49.899478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e2759-7f83-4b26-aeb1-314694a26549 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:49.912078 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:49.923346 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cc0d5-4321-48ee-8a18-ef068b5c0eee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:49.924288 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cc0d5-4321-48ee-8a18-ef068b5c0eee service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:49.924703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cc0d5-4321-48ee-8a18-ef068b5c0eee service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:49.925043 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cc0d5-4321-48ee-8a18-ef068b5c0eee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:49.928804 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-887cc0d5-4321-48ee-8a18-ef068b5c0eee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:49.938573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 856/1708] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:49 2022] POST /identity/v3/users => generated 288 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:49.941094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb6c90-8146-4b07-86a2-2c02aba6c988 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:49.942047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb6c90-8146-4b07-86a2-2c02aba6c988 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:49.943447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb6c90-8146-4b07-86a2-2c02aba6c988 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:49.945332 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 857/1709] 10.222.0.57 () {54 vars in 912 bytes} [Tue Sep 27 17:23:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:23:49.946839 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc268f-cdaa-4234-ae04-ea849f7478c6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:49.947165 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc268f-cdaa-4234-ae04-ea849f7478c6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:49.947535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc268f-cdaa-4234-ae04-ea849f7478c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:50.002233 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3bcc268f-cdaa-4234-ae04-ea849f7478c6 None None] MFA Rules not processed for user `a817cd3c534f4089b3948bad1c37ed75`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:50.003549 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3bcc268f-cdaa-4234-ae04-ea849f7478c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:50.042090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cc0d5-4321-48ee-8a18-ef068b5c0eee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:50.044991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cc0d5-4321-48ee-8a18-ef068b5c0eee service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:50.082702 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 853/1710] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:50.084145 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cc0d5-4321-48ee-8a18-ef068b5c0eee service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:50.115107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cc0d5-4321-48ee-8a18-ef068b5c0eee service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:50.120083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e471f9-80aa-492c-81e4-dfeb68cd4b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:50.120711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e471f9-80aa-492c-81e4-dfeb68cd4b3c admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:50.120992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e471f9-80aa-492c-81e4-dfeb68cd4b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:50.121267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e471f9-80aa-492c-81e4-dfeb68cd4b3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:50.121945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e471f9-80aa-492c-81e4-dfeb68cd4b3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:23:50.122251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e471f9-80aa-492c-81e4-dfeb68cd4b3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:50.123866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e471f9-80aa-492c-81e4-dfeb68cd4b3c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:50.151903 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 858/1711] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:50.153913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc268f-cdaa-4234-ae04-ea849f7478c6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:50.162573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 854/1712] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:23:50.163936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f032b-eabf-4af2-b1d9-56b356f7b9ae None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:50.164229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f032b-eabf-4af2-b1d9-56b356f7b9ae None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:50.164503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f032b-eabf-4af2-b1d9-56b356f7b9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:50.172220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc268f-cdaa-4234-ae04-ea849f7478c6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:50.180255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778c50e-9d14-4492-b3a9-b5ce9a5c3d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:50.181772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778c50e-9d14-4492-b3a9-b5ce9a5c3d89 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:50.181772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778c50e-9d14-4492-b3a9-b5ce9a5c3d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:50.181772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778c50e-9d14-4492-b3a9-b5ce9a5c3d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:50.183482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778c50e-9d14-4492-b3a9-b5ce9a5c3d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:50.187511 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778c50e-9d14-4492-b3a9-b5ce9a5c3d89 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:50.210423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 859/1713] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:50.213146 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778c50e-9d14-4492-b3a9-b5ce9a5c3d89 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:50.255596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778c50e-9d14-4492-b3a9-b5ce9a5c3d89 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:50.266100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbdc2a-eb37-4c64-9779-7dcdd75030f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:50.266774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbdc2a-eb37-4c64-9779-7dcdd75030f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:50.267063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbdc2a-eb37-4c64-9779-7dcdd75030f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:50.267340 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbdc2a-eb37-4c64-9779-7dcdd75030f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:50.268054 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbdc2a-eb37-4c64-9779-7dcdd75030f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:50.275577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbdc2a-eb37-4c64-9779-7dcdd75030f3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:50.275770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0c3f032b-eabf-4af2-b1d9-56b356f7b9ae None None] MFA Rules not processed for user `008cfc0b27d7448b9c84f8087c969e55`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:50.276078 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0c3f032b-eabf-4af2-b1d9-56b356f7b9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:50.346665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 860/1714] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:50 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:50.349846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbdc2a-eb37-4c64-9779-7dcdd75030f3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:50.428767 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 855/1715] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Sep 27 17:23:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:50.429993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f032b-eabf-4af2-b1d9-56b356f7b9ae None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:50.461285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f032b-eabf-4af2-b1d9-56b356f7b9ae None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:50.474374 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:50.544832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbdc2a-eb37-4c64-9779-7dcdd75030f3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:50.551785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32af8c-1fab-4088-ae2c-d0ee87862c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:50.552483 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35857023-7332-4693-8489-758eaeb183af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:50.553067 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32af8c-1fab-4088-ae2c-d0ee87862c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:50.553321 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35857023-7332-4693-8489-758eaeb183af admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:50.553636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32af8c-1fab-4088-ae2c-d0ee87862c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:50.553870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35857023-7332-4693-8489-758eaeb183af admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:50.554219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32af8c-1fab-4088-ae2c-d0ee87862c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:50.554672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35857023-7332-4693-8489-758eaeb183af admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:50.555235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35857023-7332-4693-8489-758eaeb183af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:50.555598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32af8c-1fab-4088-ae2c-d0ee87862c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:50.557322 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32af8c-1fab-4088-ae2c-d0ee87862c5d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:50.558837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35857023-7332-4693-8489-758eaeb183af admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:50.574405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 861/1716] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:50.575581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32af8c-1fab-4088-ae2c-d0ee87862c5d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:50.579332 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7b32af8c-1fab-4088-ae2c-d0ee87862c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:50.615322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 856/1717] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:50 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:50.616354 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35857023-7332-4693-8489-758eaeb183af admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:50.631257 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35857023-7332-4693-8489-758eaeb183af admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:50.640671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be094f-3101-43d5-85a6-039ff2de4504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:50.641575 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be094f-3101-43d5-85a6-039ff2de4504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:50.642011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be094f-3101-43d5-85a6-039ff2de4504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:50.642849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be094f-3101-43d5-85a6-039ff2de4504 admin admin] PATH_INFO: `/v3/projects/cfc6bf53a65f4e6185da11e3c10abd72/users/08ad5052be40480b98960673a0bc3c58/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:50.678442 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be094f-3101-43d5-85a6-039ff2de4504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc6bf53a65f4e6185da11e3c10abd72, user_id=08ad5052be40480b98960673a0bc3c58, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:50.687351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:50.690026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be094f-3101-43d5-85a6-039ff2de4504 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:50.709593 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32af8c-1fab-4088-ae2c-d0ee87862c5d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:50.722724 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a7e33-b9b5-4db8-a18e-d530605f80b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:50.725364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7e33-b9b5-4db8-a18e-d530605f80b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:50.729178 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7e33-b9b5-4db8-a18e-d530605f80b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:50.729178 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7e33-b9b5-4db8-a18e-d530605f80b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:50.741476 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 857/1718] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:50 2022] PUT /identity/v3/projects/cfc6bf53a65f4e6185da11e3c10abd72/users/08ad5052be40480b98960673a0bc3c58/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:50.743019 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be094f-3101-43d5-85a6-039ff2de4504 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:50.760244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a7e33-b9b5-4db8-a18e-d530605f80b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:50.764462 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a7e33-b9b5-4db8-a18e-d530605f80b7 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:50.789901 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 862/1719] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:50.791666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa757a4-ecf9-4e2f-a3f6-552a3d8a465a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:50.792322 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa757a4-ecf9-4e2f-a3f6-552a3d8a465a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:50.792771 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa757a4-ecf9-4e2f-a3f6-552a3d8a465a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:50.853145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1fa757a4-ecf9-4e2f-a3f6-552a3d8a465a None None] MFA Rules not processed for user `08ad5052be40480b98960673a0bc3c58`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:50.854402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1fa757a4-ecf9-4e2f-a3f6-552a3d8a465a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:50.877795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be094f-3101-43d5-85a6-039ff2de4504 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:50.889165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a00f6-4ce0-42c1-9060-78984c13876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:50.890725 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a00f6-4ce0-42c1-9060-78984c13876f admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:50.891275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a00f6-4ce0-42c1-9060-78984c13876f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:50.893117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a00f6-4ce0-42c1-9060-78984c13876f admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:50.894486 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a00f6-4ce0-42c1-9060-78984c13876f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:50.896736 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a00f6-4ce0-42c1-9060-78984c13876f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:50.911142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 858/1720] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:50.915216 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a00f6-4ce0-42c1-9060-78984c13876f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:50.932241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a00f6-4ce0-42c1-9060-78984c13876f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:50.938438 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cecff-13e0-4b84-91a5-7ad746c9a0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:50.940311 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cecff-13e0-4b84-91a5-7ad746c9a0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:50.940707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cecff-13e0-4b84-91a5-7ad746c9a0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:50.941096 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cecff-13e0-4b84-91a5-7ad746c9a0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:50.941899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023cecff-13e0-4b84-91a5-7ad746c9a0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:50.945132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023cecff-13e0-4b84-91a5-7ad746c9a0d9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:50.965823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 859/1721] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:50.965823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8930878-0c08-4347-8d1a-f044b111ab45 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:50.965823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8930878-0c08-4347-8d1a-f044b111ab45 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:50.965823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8930878-0c08-4347-8d1a-f044b111ab45 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:50.971758 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 860/1722] 10.222.0.57 () {54 vars in 912 bytes} [Tue Sep 27 17:23:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:23:50.972794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8930878-0c08-4347-8d1a-f044b111ab45 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:50.983946 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 863/1723] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:50.985208 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe3632-b4b5-4ac4-86bd-6e8ff7ab8c99 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:50.985496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe3632-b4b5-4ac4-86bd-6e8ff7ab8c99 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:50.985797 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe3632-b4b5-4ac4-86bd-6e8ff7ab8c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:50.995564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8930878-0c08-4347-8d1a-f044b111ab45 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:51.004795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab4f9a-c306-469c-9e1e-af6c0e47e60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:51.005592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab4f9a-c306-469c-9e1e-af6c0e47e60e admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:51.005983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab4f9a-c306-469c-9e1e-af6c0e47e60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:51.006335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab4f9a-c306-469c-9e1e-af6c0e47e60e admin admin] PATH_INFO: `/v3/projects/0d8e2bc0ab4f42c5b51b6d46e165a21e/users/12fcd67774164dffbd687b5dcc9498cb/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:51.026129 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab4f9a-c306-469c-9e1e-af6c0e47e60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8e2bc0ab4f42c5b51b6d46e165a21e, user_id=12fcd67774164dffbd687b5dcc9498cb, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:51.028323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4dbe3632-b4b5-4ac4-86bd-6e8ff7ab8c99 None None] MFA Rules not processed for user `008cfc0b27d7448b9c84f8087c969e55`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:51.029560 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4dbe3632-b4b5-4ac4-86bd-6e8ff7ab8c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:51.030725 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab4f9a-c306-469c-9e1e-af6c0e47e60e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:51.066944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 861/1724] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:50 2022] PUT /identity/v3/projects/0d8e2bc0ab4f42c5b51b6d46e165a21e/users/12fcd67774164dffbd687b5dcc9498cb/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:51.078720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725caac5-ce57-4fec-a0aa-6bb9f5d011d4 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:51.079065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725caac5-ce57-4fec-a0aa-6bb9f5d011d4 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:51.084788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725caac5-ce57-4fec-a0aa-6bb9f5d011d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:51.174986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-725caac5-ce57-4fec-a0aa-6bb9f5d011d4 None None] MFA Rules not processed for user `12fcd67774164dffbd687b5dcc9498cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:51.176546 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-725caac5-ce57-4fec-a0aa-6bb9f5d011d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:51.195962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 864/1725] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Sep 27 17:23:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:51.233446 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:51.245520 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe3632-b4b5-4ac4-86bd-6e8ff7ab8c99 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:51.247186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4dbe3632-b4b5-4ac4-86bd-6e8ff7ab8c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:51.269488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe3632-b4b5-4ac4-86bd-6e8ff7ab8c99 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:51.282791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c2d15-e82a-4f03-aac1-e8884eac160a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:51.284284 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c2d15-e82a-4f03-aac1-e8884eac160a service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:51.284800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c2d15-e82a-4f03-aac1-e8884eac160a service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:51.284916 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c2d15-e82a-4f03-aac1-e8884eac160a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:51.294202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 862/1726] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:51.299101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725caac5-ce57-4fec-a0aa-6bb9f5d011d4 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:51.311446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c2d15-e82a-4f03-aac1-e8884eac160a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:51.315898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c2d15-e82a-4f03-aac1-e8884eac160a service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:51.328766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 865/1727] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:23:51.404828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725caac5-ce57-4fec-a0aa-6bb9f5d011d4 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:51.409960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6d470-68ef-46f3-a6ec-1cd04c8392d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:51.410994 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6d470-68ef-46f3-a6ec-1cd04c8392d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:51.411464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6d470-68ef-46f3-a6ec-1cd04c8392d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:51.411928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6d470-68ef-46f3-a6ec-1cd04c8392d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:51.415776 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6d470-68ef-46f3-a6ec-1cd04c8392d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:51.418309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6d470-68ef-46f3-a6ec-1cd04c8392d2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:51.502547 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 863/1728] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:23:51 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:51.505201 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c2d15-e82a-4f03-aac1-e8884eac160a service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:51.527721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c2d15-e82a-4f03-aac1-e8884eac160a service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:51.551533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac699b4-ec39-43b2-9d57-0e41c7b693f2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:51.552129 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac699b4-ec39-43b2-9d57-0e41c7b693f2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:51.552735 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac699b4-ec39-43b2-9d57-0e41c7b693f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:51.597365 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-1ac699b4-ec39-43b2-9d57-0e41c7b693f2 None None] MFA Rules not processed for user `28c03fdc58424a9793e3df8579a8f78b`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:51.599081 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1ac699b4-ec39-43b2-9d57-0e41c7b693f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:51.636425 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e370f-4713-4945-9f9f-b01bdcc35935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:51.637835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e370f-4713-4945-9f9f-b01bdcc35935 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:51.638126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e370f-4713-4945-9f9f-b01bdcc35935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:51.638398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e370f-4713-4945-9f9f-b01bdcc35935 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:51.639528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e370f-4713-4945-9f9f-b01bdcc35935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:51.641695 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e370f-4713-4945-9f9f-b01bdcc35935 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:51.666833 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:51.678551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 866/1729] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:23:51 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:23:51.679707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e370f-4713-4945-9f9f-b01bdcc35935 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:51.697204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e370f-4713-4945-9f9f-b01bdcc35935 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:51.704181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e2b3b-5259-48ff-9b6d-10e3bdd32c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:51.705084 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2b3b-5259-48ff-9b6d-10e3bdd32c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:51.705504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2b3b-5259-48ff-9b6d-10e3bdd32c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:51.706058 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e2b3b-5259-48ff-9b6d-10e3bdd32c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:51.706841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e2b3b-5259-48ff-9b6d-10e3bdd32c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:51.709598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e2b3b-5259-48ff-9b6d-10e3bdd32c0a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:51.727666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 867/1730] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:23:51.729601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e2b3b-5259-48ff-9b6d-10e3bdd32c0a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:51.742664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 864/1731] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:23:51.744387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e2b3b-5259-48ff-9b6d-10e3bdd32c0a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:51.751882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d7c86-e2b9-45b8-ac20-aa5c86998eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:51.753277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d7c86-e2b9-45b8-ac20-aa5c86998eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:51.753778 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d7c86-e2b9-45b8-ac20-aa5c86998eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:51.754447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d7c86-e2b9-45b8-ac20-aa5c86998eb1 admin admin] PATH_INFO: `/v3/projects/69175f84d30249fbab0693bce166c48e/users/34115aedc7114add8ee6adcfd13095c0/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:51.776524 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d7c86-e2b9-45b8-ac20-aa5c86998eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69175f84d30249fbab0693bce166c48e, user_id=34115aedc7114add8ee6adcfd13095c0, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:51.780035 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d7c86-e2b9-45b8-ac20-aa5c86998eb1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:51.810096 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 868/1732] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:51 2022] PUT /identity/v3/projects/69175f84d30249fbab0693bce166c48e/users/34115aedc7114add8ee6adcfd13095c0/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:51.811605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac699b4-ec39-43b2-9d57-0e41c7b693f2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:51.838752 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac699b4-ec39-43b2-9d57-0e41c7b693f2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:51.931781 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa5b42-9020-44f9-8a97-3c13616f4fb1 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:51.932089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa5b42-9020-44f9-8a97-3c13616f4fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:51.932493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa5b42-9020-44f9-8a97-3c13616f4fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:51.963109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f2e49-e11a-4a5b-8d5f-3c169a8285c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:51.963787 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f2e49-e11a-4a5b-8d5f-3c169a8285c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:51.964080 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f2e49-e11a-4a5b-8d5f-3c169a8285c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:51.964358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f2e49-e11a-4a5b-8d5f-3c169a8285c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:51.965120 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f2e49-e11a-4a5b-8d5f-3c169a8285c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:51.966985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f2e49-e11a-4a5b-8d5f-3c169a8285c2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:51.968528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:51.982240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 865/1733] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:23:51.983223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f2e49-e11a-4a5b-8d5f-3c169a8285c2 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:51.985641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-745f2e49-e11a-4a5b-8d5f-3c169a8285c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:52.010998 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c6aa5b42-9020-44f9-8a97-3c13616f4fb1 None None] MFA Rules not processed for user `386a4da149b846a082f5f23a47d872f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:52.015673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c6aa5b42-9020-44f9-8a97-3c13616f4fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:52.091199 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f2e49-e11a-4a5b-8d5f-3c169a8285c2 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:52.100974 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b8b77-d9ac-4d56-8853-0031171e2b75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cedb97f3c84faeaeef2b3209356842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:52.101819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b8b77-d9ac-4d56-8853-0031171e2b75 service placement] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:52.102259 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b8b77-d9ac-4d56-8853-0031171e2b75 service placement] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:52.102675 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b8b77-d9ac-4d56-8853-0031171e2b75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:52.106536 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b71b8b77-d9ac-4d56-8853-0031171e2b75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:52.131777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b8b77-d9ac-4d56-8853-0031171e2b75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:52.135493 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b8b77-d9ac-4d56-8853-0031171e2b75 service placement] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:52.177296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 866/1734] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:52.178383 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b8b77-d9ac-4d56-8853-0031171e2b75 service placement] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:52.205925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 869/1735] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:51 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:23:52.224705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b8b77-d9ac-4d56-8853-0031171e2b75 service placement] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:52.238873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfa391-103a-4c86-8b00-1dbce7fb3145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:52.240296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfa391-103a-4c86-8b00-1dbce7fb3145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:52.240774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfa391-103a-4c86-8b00-1dbce7fb3145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:52.241149 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfa391-103a-4c86-8b00-1dbce7fb3145 admin admin] PATH_INFO: `/v3/projects/69175f84d30249fbab0693bce166c48e/users/34115aedc7114add8ee6adcfd13095c0/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:52.248277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfa391-103a-4c86-8b00-1dbce7fb3145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69175f84d30249fbab0693bce166c48e, user_id=34115aedc7114add8ee6adcfd13095c0, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:52.251551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfa391-103a-4c86-8b00-1dbce7fb3145 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:52.292690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 867/1736] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:23:52 2022] PUT /identity/v3/projects/69175f84d30249fbab0693bce166c48e/users/34115aedc7114add8ee6adcfd13095c0/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:52.296345 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26c998-e3c8-4838-a394-68091aaaaa88 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:52.296878 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26c998-e3c8-4838-a394-68091aaaaa88 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:52.297314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26c998-e3c8-4838-a394-68091aaaaa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:52.346078 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5a26c998-e3c8-4838-a394-68091aaaaa88 None None] MFA Rules not processed for user `34115aedc7114add8ee6adcfd13095c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:52.359416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5a26c998-e3c8-4838-a394-68091aaaaa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:52.381397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfa391-103a-4c86-8b00-1dbce7fb3145 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:52.599795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfa391-103a-4c86-8b00-1dbce7fb3145 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:52.618364 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1402f8-b173-4e2b-9210-e66ccbaad4cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:52.619007 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1402f8-b173-4e2b-9210-e66ccbaad4cc service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:52.619292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1402f8-b173-4e2b-9210-e66ccbaad4cc service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:52.619631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1402f8-b173-4e2b-9210-e66ccbaad4cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:52.639152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 870/1737] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:52.650051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26c998-e3c8-4838-a394-68091aaaaa88 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:52.652330 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5a26c998-e3c8-4838-a394-68091aaaaa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:52.755833 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:52.803166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26c998-e3c8-4838-a394-68091aaaaa88 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:52.813626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e13c3-1344-4bb2-8da0-c00de9ce4de4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:52.814284 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e13c3-1344-4bb2-8da0-c00de9ce4de4 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:52.814569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e13c3-1344-4bb2-8da0-c00de9ce4de4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:52.815193 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e13c3-1344-4bb2-8da0-c00de9ce4de4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:52.836846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e13c3-1344-4bb2-8da0-c00de9ce4de4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:52.839742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e13c3-1344-4bb2-8da0-c00de9ce4de4 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:52.858210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1402f8-b173-4e2b-9210-e66ccbaad4cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:52.859889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1402f8-b173-4e2b-9210-e66ccbaad4cc service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:52.890968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 868/1738] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:23:52.896844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 871/1739] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:52.932386 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1402f8-b173-4e2b-9210-e66ccbaad4cc service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:52.944373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:53.097191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1402f8-b173-4e2b-9210-e66ccbaad4cc service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:53.124277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e13c3-1344-4bb2-8da0-c00de9ce4de4 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:53.137074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5b4a2-6dec-49bf-b401-4bbcb5cceb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:53.137967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b4a2-6dec-49bf-b401-4bbcb5cceb19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:53.138284 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b4a2-6dec-49bf-b401-4bbcb5cceb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:53.138561 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b4a2-6dec-49bf-b401-4bbcb5cceb19 admin admin] PATH_INFO: `/v3/users/12fcd67774164dffbd687b5dcc9498cb` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:53.142629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5b4a2-6dec-49bf-b401-4bbcb5cceb19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12fcd67774164dffbd687b5dcc9498cb)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:53.144206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5b4a2-6dec-49bf-b401-4bbcb5cceb19 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:53.194250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e13c3-1344-4bb2-8da0-c00de9ce4de4 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:53.235463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade5f99-dd63-4c33-a2ed-a2a4e2faa671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:53.239661 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade5f99-dd63-4c33-a2ed-a2a4e2faa671 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:53.241851 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade5f99-dd63-4c33-a2ed-a2a4e2faa671 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:53.243839 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade5f99-dd63-4c33-a2ed-a2a4e2faa671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:53.262253 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9e5b4a2-6dec-49bf-b401-4bbcb5cceb19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12fcd67774164dffbd687b5dcc9498cb'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:53.263477 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9e5b4a2-6dec-49bf-b401-4bbcb5cceb19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12fcd67774164dffbd687b5dcc9498cb'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:53.279066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9e5b4a2-6dec-49bf-b401-4bbcb5cceb19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12fcd67774164dffbd687b5dcc9498cb'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:53.320744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9e5b4a2-6dec-49bf-b401-4bbcb5cceb19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12fcd67774164dffbd687b5dcc9498cb'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:53.339674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9e5b4a2-6dec-49bf-b401-4bbcb5cceb19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12fcd67774164dffbd687b5dcc9498cb'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:53.354804 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 869/1740] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:23:52 2022] DELETE /identity/v3/users/12fcd67774164dffbd687b5dcc9498cb => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:53.359436 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db3b99-cfde-434e-9653-cfeca1654ed6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:53.359851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db3b99-cfde-434e-9653-cfeca1654ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:53.360248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db3b99-cfde-434e-9653-cfeca1654ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:53.430034 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b6db3b99-cfde-434e-9653-cfeca1654ed6 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:53.431882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b6db3b99-cfde-434e-9653-cfeca1654ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:53.529342 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade5f99-dd63-4c33-a2ed-a2a4e2faa671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:53.534977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade5f99-dd63-4c33-a2ed-a2a4e2faa671 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:53.569731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 872/1741] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:23:53.646307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 870/1742] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:23:53.683274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade5f99-dd63-4c33-a2ed-a2a4e2faa671 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:53.870151 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade5f99-dd63-4c33-a2ed-a2a4e2faa671 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:54.011835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02deb8-cb5d-4019-a89e-6bc3fb0732dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:54.013665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02deb8-cb5d-4019-a89e-6bc3fb0732dd service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:54.015369 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02deb8-cb5d-4019-a89e-6bc3fb0732dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:54.015993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02deb8-cb5d-4019-a89e-6bc3fb0732dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:54.040642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02deb8-cb5d-4019-a89e-6bc3fb0732dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:54.044156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02deb8-cb5d-4019-a89e-6bc3fb0732dd service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:54.062503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 873/1743] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:54.252549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd292641-c818-4551-91ac-72ae411fc021 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:54.253432 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd292641-c818-4551-91ac-72ae411fc021 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:54.253729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd292641-c818-4551-91ac-72ae411fc021 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:54.256105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 871/1744] 10.222.0.57 () {54 vars in 921 bytes} [Tue Sep 27 17:23:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:23:54.287708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d6462-b093-4205-be6d-840a31a371fd None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:54.289641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d6462-b093-4205-be6d-840a31a371fd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:54.290374 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d6462-b093-4205-be6d-840a31a371fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:54.421425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba1dec-44fd-4131-8781-4f362620b5cb None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:54.423956 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba1dec-44fd-4131-8781-4f362620b5cb None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:54.424251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba1dec-44fd-4131-8781-4f362620b5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:54.446859 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e87d6462-b093-4205-be6d-840a31a371fd None None] MFA Rules not processed for user `08cedb97f3c84faeaeef2b3209356842`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:54.459795 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e87d6462-b093-4205-be6d-840a31a371fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:54.483910 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2eba1dec-44fd-4131-8781-4f362620b5cb None None] MFA Rules not processed for user `0b41c6ab73144570a7291dc674d95e66`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:54.492060 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2eba1dec-44fd-4131-8781-4f362620b5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:54.553988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:54.596554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:54.651970 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 874/1745] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Sep 27 17:23:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:54.685483 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d6462-b093-4205-be6d-840a31a371fd None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:54.687600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e87d6462-b093-4205-be6d-840a31a371fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:54.716483 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d6462-b093-4205-be6d-840a31a371fd None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:54.740998 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c820d-654a-4db0-ba19-a9092eccf85e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cedb97f3c84faeaeef2b3209356842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:54.741302 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 872/1746] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:54.746182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c820d-654a-4db0-ba19-a9092eccf85e service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:54.746399 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c820d-654a-4db0-ba19-a9092eccf85e service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:54.747327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c820d-654a-4db0-ba19-a9092eccf85e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:54.770900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c820d-654a-4db0-ba19-a9092eccf85e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:54.774485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c820d-654a-4db0-ba19-a9092eccf85e service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:54.807750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 875/1747] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:23:55.339621 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba1dec-44fd-4131-8781-4f362620b5cb None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:55.341723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2eba1dec-44fd-4131-8781-4f362620b5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:55.370277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba1dec-44fd-4131-8781-4f362620b5cb None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:55.376187 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43cfb0-4339-465f-8e80-6409a89f1e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:55.389204 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43cfb0-4339-465f-8e80-6409a89f1e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:55.390602 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43cfb0-4339-465f-8e80-6409a89f1e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:55.393105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43cfb0-4339-465f-8e80-6409a89f1e2e admin admin] PATH_INFO: `/v3/projects/0d8e2bc0ab4f42c5b51b6d46e165a21e` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:55.396967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43cfb0-4339-465f-8e80-6409a89f1e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8e2bc0ab4f42c5b51b6d46e165a21e)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:55.402497 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43cfb0-4339-465f-8e80-6409a89f1e2e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:55.476929 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ad43cfb0-4339-465f-8e80-6409a89f1e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8e2bc0ab4f42c5b51b6d46e165a21e', 'request_id': 'req-ad43cfb0-4339-465f-8e80-6409a89f1e2e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:55.484536 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ad43cfb0-4339-465f-8e80-6409a89f1e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8e2bc0ab4f42c5b51b6d46e165a21e', 'request_id': 'req-ad43cfb0-4339-465f-8e80-6409a89f1e2e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:55.497531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ad43cfb0-4339-465f-8e80-6409a89f1e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8e2bc0ab4f42c5b51b6d46e165a21e', 'request_id': 'req-ad43cfb0-4339-465f-8e80-6409a89f1e2e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:55.529062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ad43cfb0-4339-465f-8e80-6409a89f1e2e admin admin] The token cache is being invalidate because project 0d8e2bc0ab4f42c5b51b6d46e165a21e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:23:55.529704 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ad43cfb0-4339-465f-8e80-6409a89f1e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:55.531504 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ad43cfb0-4339-465f-8e80-6409a89f1e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:55.535328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 873/1748] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:23:55 2022] DELETE /identity/v3/projects/0d8e2bc0ab4f42c5b51b6d46e165a21e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:55.539692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c820d-654a-4db0-ba19-a9092eccf85e service placement] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:55.582136 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c820d-654a-4db0-ba19-a9092eccf85e service placement] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:55.733184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfe4fb-605e-4e46-a56a-d6231d6493b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:55.733983 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfe4fb-605e-4e46-a56a-d6231d6493b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:55.734266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfe4fb-605e-4e46-a56a-d6231d6493b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:55.734541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfe4fb-605e-4e46-a56a-d6231d6493b8 admin admin] PATH_INFO: `/v3/users/34115aedc7114add8ee6adcfd13095c0` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:55.745375 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfe4fb-605e-4e46-a56a-d6231d6493b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34115aedc7114add8ee6adcfd13095c0)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:55.749105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfe4fb-605e-4e46-a56a-d6231d6493b8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:55.866662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-02dfe4fb-605e-4e46-a56a-d6231d6493b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34115aedc7114add8ee6adcfd13095c0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:55.885080 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-02dfe4fb-605e-4e46-a56a-d6231d6493b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34115aedc7114add8ee6adcfd13095c0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:55.929639 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-02dfe4fb-605e-4e46-a56a-d6231d6493b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34115aedc7114add8ee6adcfd13095c0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:55.967219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-02dfe4fb-605e-4e46-a56a-d6231d6493b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34115aedc7114add8ee6adcfd13095c0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:55.967993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-02dfe4fb-605e-4e46-a56a-d6231d6493b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34115aedc7114add8ee6adcfd13095c0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:55.987822 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 876/1749] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:23:55 2022] DELETE /identity/v3/users/34115aedc7114add8ee6adcfd13095c0 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:56.876862 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43cfb0-4339-465f-8e80-6409a89f1e2e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:56.878566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ad43cfb0-4339-465f-8e80-6409a89f1e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:56.897958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43cfb0-4339-465f-8e80-6409a89f1e2e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:56.905137 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3163a-6860-4d66-9f0f-00bce5284940 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:56.906115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3163a-6860-4d66-9f0f-00bce5284940 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:56.906600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3163a-6860-4d66-9f0f-00bce5284940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:57.007193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f248d-496e-4f4f-941b-21d5fc2b50be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:57.016549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f248d-496e-4f4f-941b-21d5fc2b50be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:57.017117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f248d-496e-4f4f-941b-21d5fc2b50be admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:57.017828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f248d-496e-4f4f-941b-21d5fc2b50be admin admin] PATH_INFO: `/v3/users/08ad5052be40480b98960673a0bc3c58` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:57.021401 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f248d-496e-4f4f-941b-21d5fc2b50be admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ad5052be40480b98960673a0bc3c58)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:57.028730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f248d-496e-4f4f-941b-21d5fc2b50be admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:57.101443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-26f3163a-6860-4d66-9f0f-00bce5284940 None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:57.108089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-26f3163a-6860-4d66-9f0f-00bce5284940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:57.136203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:57.194791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef4f248d-496e-4f4f-941b-21d5fc2b50be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ad5052be40480b98960673a0bc3c58'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:57.196475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef4f248d-496e-4f4f-941b-21d5fc2b50be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ad5052be40480b98960673a0bc3c58'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:57.222752 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef4f248d-496e-4f4f-941b-21d5fc2b50be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ad5052be40480b98960673a0bc3c58'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:57.257453 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:57.304206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef4f248d-496e-4f4f-941b-21d5fc2b50be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ad5052be40480b98960673a0bc3c58'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:57.359938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef4f248d-496e-4f4f-941b-21d5fc2b50be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ad5052be40480b98960673a0bc3c58'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:57.390902 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 874/1750] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:23:56 2022] DELETE /identity/v3/users/08ad5052be40480b98960673a0bc3c58 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:23:57.395959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fee31a-a62a-45f3-ac15-a9554d41cd2a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:57.396637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fee31a-a62a-45f3-ac15-a9554d41cd2a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:57.397069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fee31a-a62a-45f3-ac15-a9554d41cd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:57.426470 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 877/1751] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Sep 27 17:23:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 522 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:23:57.476460 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e1fee31a-a62a-45f3-ac15-a9554d41cd2a None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:57.492724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e1fee31a-a62a-45f3-ac15-a9554d41cd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:57.621605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 875/1752] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:23:57.673578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3163a-6860-4d66-9f0f-00bce5284940 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:57.675749 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-26f3163a-6860-4d66-9f0f-00bce5284940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:57.762267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fee31a-a62a-45f3-ac15-a9554d41cd2a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:57.763774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e1fee31a-a62a-45f3-ac15-a9554d41cd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:57.831654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3163a-6860-4d66-9f0f-00bce5284940 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:57.977658 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7bcaa-dccb-4727-b848-3fa8d90f1273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:57.979140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7bcaa-dccb-4727-b848-3fa8d90f1273 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:57.979634 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7bcaa-dccb-4727-b848-3fa8d90f1273 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:57.980126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7bcaa-dccb-4727-b848-3fa8d90f1273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:58.025308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7bcaa-dccb-4727-b848-3fa8d90f1273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:58.027108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7bcaa-dccb-4727-b848-3fa8d90f1273 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:58.050060 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fee31a-a62a-45f3-ac15-a9554d41cd2a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:58.052587 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 878/1753] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:58.078295 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae1847-139d-423b-bdc9-f2884cec2717 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:58.078578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae1847-139d-423b-bdc9-f2884cec2717 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:58.078852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae1847-139d-423b-bdc9-f2884cec2717 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:58.080190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 879/1754] 10.222.0.57 () {54 vars in 921 bytes} [Tue Sep 27 17:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:23:58.080328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3c825-a625-48d1-a972-538de5b6c1d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:58.081005 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3c825-a625-48d1-a972-538de5b6c1d6 service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:58.081674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3c825-a625-48d1-a972-538de5b6c1d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:58.083393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3c825-a625-48d1-a972-538de5b6c1d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:58.110168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb988f-65a0-4d56-98ed-95f4ae16cc07 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:58.110452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb988f-65a0-4d56-98ed-95f4ae16cc07 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:58.110724 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb988f-65a0-4d56-98ed-95f4ae16cc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:58.164922 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a2bb988f-65a0-4d56-98ed-95f4ae16cc07 None None] MFA Rules not processed for user `08cedb97f3c84faeaeef2b3209356842`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:58.166258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a2bb988f-65a0-4d56-98ed-95f4ae16cc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:58.282118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3c825-a625-48d1-a972-538de5b6c1d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:58.289352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3c825-a625-48d1-a972-538de5b6c1d6 service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:58.297313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:58.317987 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 876/1755] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:23:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 17:23:58.341361 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 880/1756] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Sep 27 17:23:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:58.452824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0bb7a-a798-4b95-8b77-6caf260edfb8 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:58.453116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0bb7a-a798-4b95-8b77-6caf260edfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:58.453401 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0bb7a-a798-4b95-8b77-6caf260edfb8 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:58.454898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 877/1757] 10.222.0.57 () {54 vars in 961 bytes} [Tue Sep 27 17:23:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:23:58.462044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f2fd0-e000-43b0-80ea-4cc941e1d708 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:58.462328 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f2fd0-e000-43b0-80ea-4cc941e1d708 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:58.462601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f2fd0-e000-43b0-80ea-4cc941e1d708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:58.502442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:58.554633 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-490f2fd0-e000-43b0-80ea-4cc941e1d708 None None] MFA Rules not processed for user `08cedb97f3c84faeaeef2b3209356842`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:23:58.567334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-490f2fd0-e000-43b0-80ea-4cc941e1d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:58.599452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 881/1758] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Sep 27 17:23:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:23:58.608391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0bb7a-a798-4b95-8b77-6caf260edfb8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:58.641812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f2fd0-e000-43b0-80ea-4cc941e1d708 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:23:58.647210 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-490f2fd0-e000-43b0-80ea-4cc941e1d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:23:58.652151 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0bb7a-a798-4b95-8b77-6caf260edfb8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:58.669109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ab8bf-fa05-4da0-a50a-d868e3f411d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cedb97f3c84faeaeef2b3209356842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:58.669643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ab8bf-fa05-4da0-a50a-d868e3f411d1 service placement] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:58.669959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ab8bf-fa05-4da0-a50a-d868e3f411d1 service placement] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:58.670238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ab8bf-fa05-4da0-a50a-d868e3f411d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:58.714496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f2fd0-e000-43b0-80ea-4cc941e1d708 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:23:58.727392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ab8bf-fa05-4da0-a50a-d868e3f411d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:58.729012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ab8bf-fa05-4da0-a50a-d868e3f411d1 service placement] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:58.739536 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718af7fd-8ba0-46c1-ba35-af864d7fc1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:23:58.750214 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718af7fd-8ba0-46c1-ba35-af864d7fc1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:23:58.751474 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718af7fd-8ba0-46c1-ba35-af864d7fc1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:23:58.752723 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718af7fd-8ba0-46c1-ba35-af864d7fc1b1 admin admin] PATH_INFO: `/v3/users/79f421f5a27b4202ab5d425d09482c03` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:23:58.757928 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718af7fd-8ba0-46c1-ba35-af864d7fc1b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f421f5a27b4202ab5d425d09482c03)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:23:58.766328 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718af7fd-8ba0-46c1-ba35-af864d7fc1b1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:23:58.781788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 878/1759] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:23:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:23:59.039224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-718af7fd-8ba0-46c1-ba35-af864d7fc1b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f421f5a27b4202ab5d425d09482c03'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:59.067653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-718af7fd-8ba0-46c1-ba35-af864d7fc1b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f421f5a27b4202ab5d425d09482c03'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:59.133671 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-718af7fd-8ba0-46c1-ba35-af864d7fc1b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f421f5a27b4202ab5d425d09482c03'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:59.163599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-718af7fd-8ba0-46c1-ba35-af864d7fc1b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f421f5a27b4202ab5d425d09482c03'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:59.165340 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-718af7fd-8ba0-46c1-ba35-af864d7fc1b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f421f5a27b4202ab5d425d09482c03'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:23:59.188936 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 882/1760] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:23:58 2022] DELETE /identity/v3/users/79f421f5a27b4202ab5d425d09482c03 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:00.209413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ab8bf-fa05-4da0-a50a-d868e3f411d1 service placement] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:00.212339 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4a0ab8bf-fa05-4da0-a50a-d868e3f411d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:00.243360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ab8bf-fa05-4da0-a50a-d868e3f411d1 service placement] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:00.457085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19258fbe-2be5-4f0c-8088-8f689bb14707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:00.459185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19258fbe-2be5-4f0c-8088-8f689bb14707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:00.459715 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19258fbe-2be5-4f0c-8088-8f689bb14707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:00.460505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19258fbe-2be5-4f0c-8088-8f689bb14707 admin admin] PATH_INFO: `/v3/projects/69175f84d30249fbab0693bce166c48e` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:00.464454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19258fbe-2be5-4f0c-8088-8f689bb14707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69175f84d30249fbab0693bce166c48e)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:00.466884 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19258fbe-2be5-4f0c-8088-8f689bb14707 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:00.606532 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-19258fbe-2be5-4f0c-8088-8f689bb14707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69175f84d30249fbab0693bce166c48e', 'request_id': 'req-19258fbe-2be5-4f0c-8088-8f689bb14707'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:00.616154 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-19258fbe-2be5-4f0c-8088-8f689bb14707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69175f84d30249fbab0693bce166c48e', 'request_id': 'req-19258fbe-2be5-4f0c-8088-8f689bb14707'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:00.624965 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-19258fbe-2be5-4f0c-8088-8f689bb14707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69175f84d30249fbab0693bce166c48e', 'request_id': 'req-19258fbe-2be5-4f0c-8088-8f689bb14707'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:00.644449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-19258fbe-2be5-4f0c-8088-8f689bb14707 admin admin] The token cache is being invalidate because project 69175f84d30249fbab0693bce166c48e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:00.644750 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-19258fbe-2be5-4f0c-8088-8f689bb14707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:00.646113 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-19258fbe-2be5-4f0c-8088-8f689bb14707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:00.652062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 879/1761] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:00 2022] DELETE /identity/v3/projects/69175f84d30249fbab0693bce166c48e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:00.655456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b385d-fc9f-45b5-a142-e5cffdf70447 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:00.656032 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b385d-fc9f-45b5-a142-e5cffdf70447 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:00.656032 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b385d-fc9f-45b5-a142-e5cffdf70447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:00.735921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b18b385d-fc9f-45b5-a142-e5cffdf70447 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:00.737242 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b18b385d-fc9f-45b5-a142-e5cffdf70447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:00.940040 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 883/1762] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:00.948189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3b460-ec41-4b51-aa6d-fc0fda33be87 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:00.948508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3b460-ec41-4b51-aa6d-fc0fda33be87 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:00.949386 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3b460-ec41-4b51-aa6d-fc0fda33be87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:01.051169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ffd3b460-ec41-4b51-aa6d-fc0fda33be87 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:01.058577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ffd3b460-ec41-4b51-aa6d-fc0fda33be87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:01.093180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 880/1763] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:01.097785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b385d-fc9f-45b5-a142-e5cffdf70447 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:01.114670 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b385d-fc9f-45b5-a142-e5cffdf70447 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:01.130557 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bdbad-c3e0-4ca0-8d2a-0ba7ee504be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:01.131282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bdbad-c3e0-4ca0-8d2a-0ba7ee504be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:01.131566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bdbad-c3e0-4ca0-8d2a-0ba7ee504be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:01.131973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bdbad-c3e0-4ca0-8d2a-0ba7ee504be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:01.132650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bdbad-c3e0-4ca0-8d2a-0ba7ee504be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:01.132978 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bdbad-c3e0-4ca0-8d2a-0ba7ee504be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:01.138780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bdbad-c3e0-4ca0-8d2a-0ba7ee504be3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:01.170528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 884/1764] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:24:01.174822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3b460-ec41-4b51-aa6d-fc0fda33be87 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:01.190325 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3b460-ec41-4b51-aa6d-fc0fda33be87 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:01.201431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de8266-57a6-48af-aba0-ccff54c39a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:01.202117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de8266-57a6-48af-aba0-ccff54c39a1d admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:01.202400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de8266-57a6-48af-aba0-ccff54c39a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:01.202702 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de8266-57a6-48af-aba0-ccff54c39a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:01.203419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de8266-57a6-48af-aba0-ccff54c39a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:01.209679 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de8266-57a6-48af-aba0-ccff54c39a1d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:01.267162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05df1b9-88c2-4f41-aebb-8647c058d5d3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:01.267476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05df1b9-88c2-4f41-aebb-8647c058d5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:01.267718 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05df1b9-88c2-4f41-aebb-8647c058d5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:01.341641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b05df1b9-88c2-4f41-aebb-8647c058d5d3 None None] MFA Rules not processed for user `008cfc0b27d7448b9c84f8087c969e55`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:01.343227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b05df1b9-88c2-4f41-aebb-8647c058d5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:01.344353 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 881/1765] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:01 2022] POST /identity/v3/projects => generated 391 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:01.345322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de8266-57a6-48af-aba0-ccff54c39a1d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:01.559456 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:01.580505 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 885/1766] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Sep 27 17:24:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:01.603311 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de8266-57a6-48af-aba0-ccff54c39a1d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:01.607852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05df1b9-88c2-4f41-aebb-8647c058d5d3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:01.609427 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b05df1b9-88c2-4f41-aebb-8647c058d5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:01.623014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05df1b9-88c2-4f41-aebb-8647c058d5d3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:01.626169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090190f8-b19a-4771-adec-2873d7367e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:01.626815 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090190f8-b19a-4771-adec-2873d7367e7b admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:01.627101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090190f8-b19a-4771-adec-2873d7367e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:01.627379 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090190f8-b19a-4771-adec-2873d7367e7b admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:01.628040 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090190f8-b19a-4771-adec-2873d7367e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:01.633725 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090190f8-b19a-4771-adec-2873d7367e7b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:01.647488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0410c-0e2b-404d-9a22-4e4c997e7e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:01.650540 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0410c-0e2b-404d-9a22-4e4c997e7e73 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:01.651063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0410c-0e2b-404d-9a22-4e4c997e7e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:01.651535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0410c-0e2b-404d-9a22-4e4c997e7e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:01.657166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:01.668248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0410c-0e2b-404d-9a22-4e4c997e7e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:01.672277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0410c-0e2b-404d-9a22-4e4c997e7e73 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:01.683735 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 886/1767] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:24:01.720445 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 882/1768] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:01 2022] POST /identity/v3/users => generated 296 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:01.720767 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0410c-0e2b-404d-9a22-4e4c997e7e73 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:01.781917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0410c-0e2b-404d-9a22-4e4c997e7e73 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:01.803036 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624badc-05df-40cb-991c-3a0734e6f704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:01.803773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624badc-05df-40cb-991c-3a0734e6f704 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:01.804493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624badc-05df-40cb-991c-3a0734e6f704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:01.804801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624badc-05df-40cb-991c-3a0734e6f704 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:01.805592 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624badc-05df-40cb-991c-3a0734e6f704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:01.812147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624badc-05df-40cb-991c-3a0734e6f704 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:01.832282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 887/1769] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:01.835229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090190f8-b19a-4771-adec-2873d7367e7b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:01.850925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090190f8-b19a-4771-adec-2873d7367e7b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:01.867282 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bec5d-85b7-4027-81b0-4215392a7a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:01.867954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bec5d-85b7-4027-81b0-4215392a7a25 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:01.868186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bec5d-85b7-4027-81b0-4215392a7a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:01.868462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bec5d-85b7-4027-81b0-4215392a7a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:01.869119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bec5d-85b7-4027-81b0-4215392a7a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:01.870773 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bec5d-85b7-4027-81b0-4215392a7a25 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:01.902559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 883/1770] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:01.908296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624badc-05df-40cb-991c-3a0734e6f704 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:01.960492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624badc-05df-40cb-991c-3a0734e6f704 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:01.978660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09344c44-f65f-4b2e-9ccb-d8959a00bf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:01.994893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09344c44-f65f-4b2e-9ccb-d8959a00bf92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:01.995458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09344c44-f65f-4b2e-9ccb-d8959a00bf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:01.995890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09344c44-f65f-4b2e-9ccb-d8959a00bf92 admin admin] PATH_INFO: `/v3/projects/9b5ff4b4d15941daaf256e2343287ddf/users/72ea957643c2496888cc403ad0d7ee67/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:02.060864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09344c44-f65f-4b2e-9ccb-d8959a00bf92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5ff4b4d15941daaf256e2343287ddf, user_id=72ea957643c2496888cc403ad0d7ee67, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:02.063705 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09344c44-f65f-4b2e-9ccb-d8959a00bf92 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:02.110622 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 888/1771] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:01 2022] PUT /identity/v3/projects/9b5ff4b4d15941daaf256e2343287ddf/users/72ea957643c2496888cc403ad0d7ee67/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:02.121162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75d27e-0e0a-40c4-9d9b-f9baf1735d6f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:02.121453 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75d27e-0e0a-40c4-9d9b-f9baf1735d6f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:02.121758 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75d27e-0e0a-40c4-9d9b-f9baf1735d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:02.222540 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-3d75d27e-0e0a-40c4-9d9b-f9baf1735d6f None None] MFA Rules not processed for user `72ea957643c2496888cc403ad0d7ee67`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:02.224371 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3d75d27e-0e0a-40c4-9d9b-f9baf1735d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:02.448072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 884/1772] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:02.452736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09344c44-f65f-4b2e-9ccb-d8959a00bf92 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:02.610658 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09344c44-f65f-4b2e-9ccb-d8959a00bf92 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:02.648501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4841b4e-1140-451d-8781-942af88a4cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:02.648501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4841b4e-1140-451d-8781-942af88a4cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:02.648501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4841b4e-1140-451d-8781-942af88a4cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:02.648901 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4841b4e-1140-451d-8781-942af88a4cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:02.651501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4841b4e-1140-451d-8781-942af88a4cd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:02.655890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4841b4e-1140-451d-8781-942af88a4cd3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:02.766811 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 889/1773] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:02 2022] POST /identity/v3/projects => generated 391 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:02.774305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75d27e-0e0a-40c4-9d9b-f9baf1735d6f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:02.796630 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75d27e-0e0a-40c4-9d9b-f9baf1735d6f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:02.826776 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4841b4e-1140-451d-8781-942af88a4cd3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:02.828447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f4841b4e-1140-451d-8781-942af88a4cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:03.050013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4841b4e-1140-451d-8781-942af88a4cd3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:03.069528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cf6b7-059e-4026-8549-4faafe747009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:03.070083 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cf6b7-059e-4026-8549-4faafe747009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:03.072548 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cf6b7-059e-4026-8549-4faafe747009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:03.072807 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cf6b7-059e-4026-8549-4faafe747009 admin admin] PATH_INFO: `/v3/projects/cfc6bf53a65f4e6185da11e3c10abd72` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:03.076690 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cf6b7-059e-4026-8549-4faafe747009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc6bf53a65f4e6185da11e3c10abd72)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:03.078737 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cf6b7-059e-4026-8549-4faafe747009 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:03.146399 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4bbaf-ef70-4295-b494-44a5ba9d04cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:03.148967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4bbaf-ef70-4295-b494-44a5ba9d04cc admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:03.152153 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4bbaf-ef70-4295-b494-44a5ba9d04cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:03.152868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4bbaf-ef70-4295-b494-44a5ba9d04cc admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:03.155110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4bbaf-ef70-4295-b494-44a5ba9d04cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:03.163359 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4bbaf-ef70-4295-b494-44a5ba9d04cc admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:03.224697 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:03.246375 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ce8cf6b7-059e-4026-8549-4faafe747009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc6bf53a65f4e6185da11e3c10abd72', 'request_id': 'req-ce8cf6b7-059e-4026-8549-4faafe747009'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:03.258193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 885/1774] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:02 2022] POST /identity/v3/users => generated 302 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:03.260405 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42261a-33e8-4466-b879-9e06fb9f5b78 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:03.269499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42261a-33e8-4466-b879-9e06fb9f5b78 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:03.270643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42261a-33e8-4466-b879-9e06fb9f5b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:03.271913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ce8cf6b7-059e-4026-8549-4faafe747009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc6bf53a65f4e6185da11e3c10abd72', 'request_id': 'req-ce8cf6b7-059e-4026-8549-4faafe747009'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:03.294773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ce8cf6b7-059e-4026-8549-4faafe747009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc6bf53a65f4e6185da11e3c10abd72', 'request_id': 'req-ce8cf6b7-059e-4026-8549-4faafe747009'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:03.330086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ce8cf6b7-059e-4026-8549-4faafe747009 admin admin] The token cache is being invalidate because project cfc6bf53a65f4e6185da11e3c10abd72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:03.330382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ce8cf6b7-059e-4026-8549-4faafe747009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:03.335255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ce8cf6b7-059e-4026-8549-4faafe747009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:03.338644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 890/1775] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:02 2022] DELETE /identity/v3/projects/cfc6bf53a65f4e6185da11e3c10abd72 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:03.339433 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cf6b7-059e-4026-8549-4faafe747009 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:03.353746 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ce8cf6b7-059e-4026-8549-4faafe747009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:03.354012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0d42261a-33e8-4466-b879-9e06fb9f5b78 None None] MFA Rules not processed for user `a817cd3c534f4089b3948bad1c37ed75`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:03.355417 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0d42261a-33e8-4466-b879-9e06fb9f5b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:03.454037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:03.500788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 886/1776] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:03.502266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795ef9f-674c-4ed0-98ee-793bb98da608 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:03.504044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795ef9f-674c-4ed0-98ee-793bb98da608 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:03.508153 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795ef9f-674c-4ed0-98ee-793bb98da608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:03.536824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cf6b7-059e-4026-8549-4faafe747009 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:03.561791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15811d9a-dfda-41bf-af37-4fd85862bef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:03.562447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15811d9a-dfda-41bf-af37-4fd85862bef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:03.562734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15811d9a-dfda-41bf-af37-4fd85862bef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:03.563013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15811d9a-dfda-41bf-af37-4fd85862bef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:03.563668 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15811d9a-dfda-41bf-af37-4fd85862bef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:03.565286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15811d9a-dfda-41bf-af37-4fd85862bef7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:03.602283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 891/1777] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:03.606677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15811d9a-dfda-41bf-af37-4fd85862bef7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:03.624464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f795ef9f-674c-4ed0-98ee-793bb98da608 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:03.630730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f795ef9f-674c-4ed0-98ee-793bb98da608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:03.633961 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15811d9a-dfda-41bf-af37-4fd85862bef7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:03.646391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 887/1778] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:03.652271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935453ff-1c66-482a-b64c-e088bd12a9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:03.653490 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935453ff-1c66-482a-b64c-e088bd12a9db admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:03.654004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935453ff-1c66-482a-b64c-e088bd12a9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:03.654465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935453ff-1c66-482a-b64c-e088bd12a9db admin admin] PATH_INFO: `/v3/projects/95d69a12d2214e4ebadb0c72cd1aee64/users/9330836d840d44139cf696b0d739d405/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:03.665450 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44306ce-659a-428b-b389-3d29d33afdf7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:03.666163 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44306ce-659a-428b-b389-3d29d33afdf7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:03.666663 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44306ce-659a-428b-b389-3d29d33afdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:03.698788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935453ff-1c66-482a-b64c-e088bd12a9db admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d69a12d2214e4ebadb0c72cd1aee64, user_id=9330836d840d44139cf696b0d739d405, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:03.701536 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935453ff-1c66-482a-b64c-e088bd12a9db admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:03.715931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e44306ce-659a-428b-b389-3d29d33afdf7 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:03.719820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e44306ce-659a-428b-b389-3d29d33afdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:03.727498 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 892/1779] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:03 2022] PUT /identity/v3/projects/95d69a12d2214e4ebadb0c72cd1aee64/users/9330836d840d44139cf696b0d739d405/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:03.728498 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935453ff-1c66-482a-b64c-e088bd12a9db admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:03.884846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 888/1780] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:03.888485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44306ce-659a-428b-b389-3d29d33afdf7 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:03.905596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44306ce-659a-428b-b389-3d29d33afdf7 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:03.920143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b595a2-ba64-4f89-99b0-43caa3ed7775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:03.920947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b595a2-ba64-4f89-99b0-43caa3ed7775 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:03.921362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b595a2-ba64-4f89-99b0-43caa3ed7775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:03.921829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b595a2-ba64-4f89-99b0-43caa3ed7775 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:03.922678 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b595a2-ba64-4f89-99b0-43caa3ed7775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:03.923059 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b595a2-ba64-4f89-99b0-43caa3ed7775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:03.925011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b595a2-ba64-4f89-99b0-43caa3ed7775 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:03.946858 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935453ff-1c66-482a-b64c-e088bd12a9db admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:03.953792 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 889/1781] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:24:03.959043 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b595a2-ba64-4f89-99b0-43caa3ed7775 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:03.972612 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a795a-58db-476a-b871-0b4f9fa722fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:03.973328 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a795a-58db-476a-b871-0b4f9fa722fb admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:03.974512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a795a-58db-476a-b871-0b4f9fa722fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:03.975004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a795a-58db-476a-b871-0b4f9fa722fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:03.975719 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a795a-58db-476a-b871-0b4f9fa722fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:03.978993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b595a2-ba64-4f89-99b0-43caa3ed7775 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:03.982018 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a795a-58db-476a-b871-0b4f9fa722fb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:03.995454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056142f-6165-4a2b-aa78-7b6eeeca0f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:03.996170 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056142f-6165-4a2b-aa78-7b6eeeca0f4c admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:03.996534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056142f-6165-4a2b-aa78-7b6eeeca0f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:03.996927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056142f-6165-4a2b-aa78-7b6eeeca0f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:04.007995 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056142f-6165-4a2b-aa78-7b6eeeca0f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:04.012366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056142f-6165-4a2b-aa78-7b6eeeca0f4c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:04.015543 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 893/1782] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:04.026119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a795a-58db-476a-b871-0b4f9fa722fb admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:04.043855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cd8a795a-58db-476a-b871-0b4f9fa722fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:04.070081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a795a-58db-476a-b871-0b4f9fa722fb admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:04.077354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bf2fb-7042-4ab6-93dc-05324b835d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:04.078388 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bf2fb-7042-4ab6-93dc-05324b835d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:04.078933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bf2fb-7042-4ab6-93dc-05324b835d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:04.079310 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bf2fb-7042-4ab6-93dc-05324b835d32 admin admin] PATH_INFO: `/v3/projects/17103dce1cb94a6cbfda089d2b6b9954` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:04.081310 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bf2fb-7042-4ab6-93dc-05324b835d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17103dce1cb94a6cbfda089d2b6b9954)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:04.084487 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bf2fb-7042-4ab6-93dc-05324b835d32 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:04.111838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 890/1783] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:03 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:24:04.112353 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056142f-6165-4a2b-aa78-7b6eeeca0f4c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:04.287039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:04.345113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-547bf2fb-7042-4ab6-93dc-05324b835d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17103dce1cb94a6cbfda089d2b6b9954', 'request_id': 'req-547bf2fb-7042-4ab6-93dc-05324b835d32'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:04.354005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-547bf2fb-7042-4ab6-93dc-05324b835d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17103dce1cb94a6cbfda089d2b6b9954', 'request_id': 'req-547bf2fb-7042-4ab6-93dc-05324b835d32'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:04.363342 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-547bf2fb-7042-4ab6-93dc-05324b835d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17103dce1cb94a6cbfda089d2b6b9954', 'request_id': 'req-547bf2fb-7042-4ab6-93dc-05324b835d32'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:04.379105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056142f-6165-4a2b-aa78-7b6eeeca0f4c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:04.422264 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-547bf2fb-7042-4ab6-93dc-05324b835d32 admin admin] The token cache is being invalidate because project 17103dce1cb94a6cbfda089d2b6b9954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:04.423283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-547bf2fb-7042-4ab6-93dc-05324b835d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:04.425055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-547bf2fb-7042-4ab6-93dc-05324b835d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:04.432572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 894/1784] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:04 2022] DELETE /identity/v3/projects/17103dce1cb94a6cbfda089d2b6b9954 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:04.432572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bf2fb-7042-4ab6-93dc-05324b835d32 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:04.434538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-547bf2fb-7042-4ab6-93dc-05324b835d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:04.562780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:04.599571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866eaca-2c4e-47d4-998f-d1075011089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:04.602731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866eaca-2c4e-47d4-998f-d1075011089b admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:04.604876 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866eaca-2c4e-47d4-998f-d1075011089b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:04.605550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866eaca-2c4e-47d4-998f-d1075011089b admin admin] PATH_INFO: `/v3/projects/95d69a12d2214e4ebadb0c72cd1aee64/users/9330836d840d44139cf696b0d739d405/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:04.612977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866eaca-2c4e-47d4-998f-d1075011089b admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d69a12d2214e4ebadb0c72cd1aee64, user_id=9330836d840d44139cf696b0d739d405, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:04.618495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866eaca-2c4e-47d4-998f-d1075011089b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:04.663946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 891/1785] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:04 2022] PUT /identity/v3/projects/95d69a12d2214e4ebadb0c72cd1aee64/users/9330836d840d44139cf696b0d739d405/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:04.665065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866eaca-2c4e-47d4-998f-d1075011089b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:04.667006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c866eaca-2c4e-47d4-998f-d1075011089b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:04.694077 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bf2fb-7042-4ab6-93dc-05324b835d32 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:04.838519 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866eaca-2c4e-47d4-998f-d1075011089b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:04.862701 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55c81a-e3e1-4126-b8a2-18b7a435a2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:04.863575 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55c81a-e3e1-4126-b8a2-18b7a435a2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:04.864016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55c81a-e3e1-4126-b8a2-18b7a435a2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:04.864294 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55c81a-e3e1-4126-b8a2-18b7a435a2a9 admin admin] PATH_INFO: `/v3/users/386a4da149b846a082f5f23a47d872f3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:04.865839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55c81a-e3e1-4126-b8a2-18b7a435a2a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=386a4da149b846a082f5f23a47d872f3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:04.867956 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55c81a-e3e1-4126-b8a2-18b7a435a2a9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:04.903512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23560f93-cf32-4568-8c9c-e42ad00817f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:04.904267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23560f93-cf32-4568-8c9c-e42ad00817f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:04.904792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23560f93-cf32-4568-8c9c-e42ad00817f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:04.906020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23560f93-cf32-4568-8c9c-e42ad00817f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:04.908104 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23560f93-cf32-4568-8c9c-e42ad00817f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:04.914811 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23560f93-cf32-4568-8c9c-e42ad00817f6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:04.962208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3a55c81a-e3e1-4126-b8a2-18b7a435a2a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '386a4da149b846a082f5f23a47d872f3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:04.963665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3a55c81a-e3e1-4126-b8a2-18b7a435a2a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '386a4da149b846a082f5f23a47d872f3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:04.979981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3a55c81a-e3e1-4126-b8a2-18b7a435a2a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '386a4da149b846a082f5f23a47d872f3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:04.990040 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 895/1786] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:04 2022] POST /identity/v3/users => generated 290 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:04.991771 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26924b0f-c746-4f17-9f65-ee2b2dc5b093 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:04.992963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26924b0f-c746-4f17-9f65-ee2b2dc5b093 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:04.993241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26924b0f-c746-4f17-9f65-ee2b2dc5b093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:05.010028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3a55c81a-e3e1-4126-b8a2-18b7a435a2a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '386a4da149b846a082f5f23a47d872f3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:05.022821 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3a55c81a-e3e1-4126-b8a2-18b7a435a2a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '386a4da149b846a082f5f23a47d872f3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:05.039689 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 892/1787] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:04 2022] DELETE /identity/v3/users/386a4da149b846a082f5f23a47d872f3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:05.039689 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55c81a-e3e1-4126-b8a2-18b7a435a2a9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:05.045937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3a55c81a-e3e1-4126-b8a2-18b7a435a2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:05.093595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-26924b0f-c746-4f17-9f65-ee2b2dc5b093 None None] MFA Rules not processed for user `9330836d840d44139cf696b0d739d405`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:05.094873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-26924b0f-c746-4f17-9f65-ee2b2dc5b093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:05.237942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55c81a-e3e1-4126-b8a2-18b7a435a2a9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:05.262490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc171a-06f1-4db0-82f6-cb398244110a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:05.263879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc171a-06f1-4db0-82f6-cb398244110a admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:05.264391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc171a-06f1-4db0-82f6-cb398244110a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:05.264866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc171a-06f1-4db0-82f6-cb398244110a admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:05.266011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc171a-06f1-4db0-82f6-cb398244110a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:05.270650 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc171a-06f1-4db0-82f6-cb398244110a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:05.276304 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:05.311965 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 893/1788] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:05.313183 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc171a-06f1-4db0-82f6-cb398244110a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:05.347426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:05.352646 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc171a-06f1-4db0-82f6-cb398244110a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:05.368117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 896/1789] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:04 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:05.397917 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068e372-225e-4dd5-8789-a5eda2406546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:05.399287 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068e372-225e-4dd5-8789-a5eda2406546 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:05.399745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068e372-225e-4dd5-8789-a5eda2406546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:05.400252 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068e372-225e-4dd5-8789-a5eda2406546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:05.401163 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068e372-225e-4dd5-8789-a5eda2406546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:05.403645 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068e372-225e-4dd5-8789-a5eda2406546 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:05.409251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26924b0f-c746-4f17-9f65-ee2b2dc5b093 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:05.415224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-26924b0f-c746-4f17-9f65-ee2b2dc5b093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:05.439571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 894/1790] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:05.440478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068e372-225e-4dd5-8789-a5eda2406546 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:05.462553 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068e372-225e-4dd5-8789-a5eda2406546 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:05.479510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30b78a-28fb-4fb1-85ad-29dec118e2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:05.480570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30b78a-28fb-4fb1-85ad-29dec118e2db admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:05.482326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30b78a-28fb-4fb1-85ad-29dec118e2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:05.482842 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30b78a-28fb-4fb1-85ad-29dec118e2db admin admin] PATH_INFO: `/v3/projects/354e4e09b1ed482c86ed7b256ed108c1/users/6951e42106ea4ff1bd315bde36e1c1c1/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:05.542603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30b78a-28fb-4fb1-85ad-29dec118e2db admin admin] RBAC: Authorizing `identity:create_grant(project_id=354e4e09b1ed482c86ed7b256ed108c1, user_id=6951e42106ea4ff1bd315bde36e1c1c1, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:05.551805 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30b78a-28fb-4fb1-85ad-29dec118e2db admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:05.580193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 895/1791] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:05 2022] PUT /identity/v3/projects/354e4e09b1ed482c86ed7b256ed108c1/users/6951e42106ea4ff1bd315bde36e1c1c1/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:05.593164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b918dd-4830-4887-860d-e20b5f2e120f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:05.593573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b918dd-4830-4887-860d-e20b5f2e120f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:05.594216 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b918dd-4830-4887-860d-e20b5f2e120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:05.606082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26924b0f-c746-4f17-9f65-ee2b2dc5b093 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:05.684440 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5ed93-73a1-40c9-aa17-d8eb1190345e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:05.685080 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5ed93-73a1-40c9-aa17-d8eb1190345e service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:05.685364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5ed93-73a1-40c9-aa17-d8eb1190345e service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:05.689374 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5ed93-73a1-40c9-aa17-d8eb1190345e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:05.701961 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-17b918dd-4830-4887-860d-e20b5f2e120f None None] MFA Rules not processed for user `6951e42106ea4ff1bd315bde36e1c1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:05.704225 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-17b918dd-4830-4887-860d-e20b5f2e120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:05.781457 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5ed93-73a1-40c9-aa17-d8eb1190345e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:05.784115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5ed93-73a1-40c9-aa17-d8eb1190345e service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:05.807620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 897/1792] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:05 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:05.955559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 896/1793] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:05.960427 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5ed93-73a1-40c9-aa17-d8eb1190345e service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:06.001088 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b918dd-4830-4887-860d-e20b5f2e120f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:06.003783 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-17b918dd-4830-4887-860d-e20b5f2e120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:06.029010 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b918dd-4830-4887-860d-e20b5f2e120f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:06.046033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd40d91-155f-49bc-b443-a4374a39fdb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:06.046784 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd40d91-155f-49bc-b443-a4374a39fdb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:06.048669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd40d91-155f-49bc-b443-a4374a39fdb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:06.049796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd40d91-155f-49bc-b443-a4374a39fdb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:06.057644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5bd40d91-155f-49bc-b443-a4374a39fdb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:06.107365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:06.120820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5ed93-73a1-40c9-aa17-d8eb1190345e service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:06.126718 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940300b-55a2-41da-bc1b-717ec0ecb84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:06.127541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940300b-55a2-41da-bc1b-717ec0ecb84d admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:06.127869 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940300b-55a2-41da-bc1b-717ec0ecb84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:06.128271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940300b-55a2-41da-bc1b-717ec0ecb84d admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:06.129301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940300b-55a2-41da-bc1b-717ec0ecb84d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:06.132786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940300b-55a2-41da-bc1b-717ec0ecb84d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:06.190143 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 898/1794] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:05 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:06.191427 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940300b-55a2-41da-bc1b-717ec0ecb84d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:06.263282 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd40d91-155f-49bc-b443-a4374a39fdb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:06.267152 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd40d91-155f-49bc-b443-a4374a39fdb8 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:06.284042 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 897/1795] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:06.388441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940300b-55a2-41da-bc1b-717ec0ecb84d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:06.394750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b21c3-de72-4241-a1a5-4ccbe8bb5196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:06.398858 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b21c3-de72-4241-a1a5-4ccbe8bb5196 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:06.399351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b21c3-de72-4241-a1a5-4ccbe8bb5196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:06.399827 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b21c3-de72-4241-a1a5-4ccbe8bb5196 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:06.401073 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b21c3-de72-4241-a1a5-4ccbe8bb5196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:06.403763 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b21c3-de72-4241-a1a5-4ccbe8bb5196 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:06.463719 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 899/1796] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:06 2022] POST /identity/v3/users => generated 296 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:06.465511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd40d91-155f-49bc-b443-a4374a39fdb8 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:06.482821 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd40d91-155f-49bc-b443-a4374a39fdb8 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:06.489999 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f0b58-13e0-488f-b510-f86981ff91d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:06.490708 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f0b58-13e0-488f-b510-f86981ff91d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:06.491037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f0b58-13e0-488f-b510-f86981ff91d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:06.491317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f0b58-13e0-488f-b510-f86981ff91d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:06.491971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f0b58-13e0-488f-b510-f86981ff91d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:06.494919 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f0b58-13e0-488f-b510-f86981ff91d6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:06.530430 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 898/1797] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:06.531325 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b21c3-de72-4241-a1a5-4ccbe8bb5196 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:06.550084 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b21c3-de72-4241-a1a5-4ccbe8bb5196 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:06.565873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd07642-f83f-441f-8e4b-a9dc236ab0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:06.568025 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd07642-f83f-441f-8e4b-a9dc236ab0cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:06.568025 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd07642-f83f-441f-8e4b-a9dc236ab0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:06.568350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd07642-f83f-441f-8e4b-a9dc236ab0cf admin admin] PATH_INFO: `/v3/projects/7d2ac3abd5844a73ad5975d2b393445a/users/24f55549434b48a6a416dacf04d0db13/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:06.608298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71d2f1-c095-4ca7-a5ec-36d1263049e5 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:06.608439 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71d2f1-c095-4ca7-a5ec-36d1263049e5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:06.608659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71d2f1-c095-4ca7-a5ec-36d1263049e5 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:06.610717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 899/1798] 10.222.0.57 () {54 vars in 921 bytes} [Tue Sep 27 17:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 17:24:06.623419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd07642-f83f-441f-8e4b-a9dc236ab0cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2ac3abd5844a73ad5975d2b393445a, user_id=24f55549434b48a6a416dacf04d0db13, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:06.634564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a105-727d-4884-830f-562d7a77acc7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:06.634876 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a105-727d-4884-830f-562d7a77acc7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:06.635206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186a105-727d-4884-830f-562d7a77acc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:06.649116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd07642-f83f-441f-8e4b-a9dc236ab0cf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:06.683478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-1186a105-727d-4884-830f-562d7a77acc7 None None] MFA Rules not processed for user `e75b03fde75e411bace8d406237a7e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:06.697574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 900/1799] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:06 2022] PUT /identity/v3/projects/7d2ac3abd5844a73ad5975d2b393445a/users/24f55549434b48a6a416dacf04d0db13/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:06.698550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd07642-f83f-441f-8e4b-a9dc236ab0cf admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:06.700911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1186a105-727d-4884-830f-562d7a77acc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:06.866325 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:06.956759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd07642-f83f-441f-8e4b-a9dc236ab0cf admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:06.979526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb5c14-503b-4780-94dd-f496718f7f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:06.980304 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb5c14-503b-4780-94dd-f496718f7f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:06.980594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb5c14-503b-4780-94dd-f496718f7f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:06.982922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 900/1800] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Sep 27 17:24:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:06.997715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb5c14-503b-4780-94dd-f496718f7f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:06.997715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb5c14-503b-4780-94dd-f496718f7f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:06.997715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb5c14-503b-4780-94dd-f496718f7f69 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:07.025128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186a105-727d-4884-830f-562d7a77acc7 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:07.034712 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 901/1801] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:07.044264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186a105-727d-4884-830f-562d7a77acc7 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:07.057326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ae107-46d0-4ab2-acb9-38f9bae96924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:07.058271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ae107-46d0-4ab2-acb9-38f9bae96924 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:07.058604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ae107-46d0-4ab2-acb9-38f9bae96924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:07.058932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ae107-46d0-4ab2-acb9-38f9bae96924 admin admin] PATH_INFO: `/v3/projects/7d2ac3abd5844a73ad5975d2b393445a/users/24f55549434b48a6a416dacf04d0db13/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:07.064950 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ae107-46d0-4ab2-acb9-38f9bae96924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2ac3abd5844a73ad5975d2b393445a, user_id=24f55549434b48a6a416dacf04d0db13, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:07.074820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ae107-46d0-4ab2-acb9-38f9bae96924 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:07.102716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 901/1802] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:07 2022] PUT /identity/v3/projects/7d2ac3abd5844a73ad5975d2b393445a/users/24f55549434b48a6a416dacf04d0db13/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:07.115553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97698485-baef-4916-8cf1-a7146ce72dc4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:07.116151 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97698485-baef-4916-8cf1-a7146ce72dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:07.116234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97698485-baef-4916-8cf1-a7146ce72dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:07.224925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-97698485-baef-4916-8cf1-a7146ce72dc4 None None] MFA Rules not processed for user `24f55549434b48a6a416dacf04d0db13`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:07.229500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-97698485-baef-4916-8cf1-a7146ce72dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:07.277495 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:07.369644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 902/1803] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:07.378490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ae107-46d0-4ab2-acb9-38f9bae96924 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:07.468780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ae107-46d0-4ab2-acb9-38f9bae96924 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:07.475511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98187932-bd03-445e-8a55-03098cb13f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:07.476602 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98187932-bd03-445e-8a55-03098cb13f6c service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:07.477045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98187932-bd03-445e-8a55-03098cb13f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:07.477463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98187932-bd03-445e-8a55-03098cb13f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:07.660080 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98187932-bd03-445e-8a55-03098cb13f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:07.661849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98187932-bd03-445e-8a55-03098cb13f6c service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:07.684606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 902/1804] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:24:08.248379 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97698485-baef-4916-8cf1-a7146ce72dc4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:08.250721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-97698485-baef-4916-8cf1-a7146ce72dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:08.538190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97698485-baef-4916-8cf1-a7146ce72dc4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:08.569364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f3b8e-5cbb-4e98-a07d-02ccaf45b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:08.570254 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f3b8e-5cbb-4e98-a07d-02ccaf45b88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:08.570562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f3b8e-5cbb-4e98-a07d-02ccaf45b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:08.571532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f3b8e-5cbb-4e98-a07d-02ccaf45b88f admin admin] PATH_INFO: `/v3/projects/aca5263a44d14c5d9be5706178e33cc0` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:08.578699 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f3b8e-5cbb-4e98-a07d-02ccaf45b88f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aca5263a44d14c5d9be5706178e33cc0)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:08.580760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f3b8e-5cbb-4e98-a07d-02ccaf45b88f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:08.731786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c32f3b8e-5cbb-4e98-a07d-02ccaf45b88f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca5263a44d14c5d9be5706178e33cc0', 'request_id': 'req-c32f3b8e-5cbb-4e98-a07d-02ccaf45b88f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:08.754532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c32f3b8e-5cbb-4e98-a07d-02ccaf45b88f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca5263a44d14c5d9be5706178e33cc0', 'request_id': 'req-c32f3b8e-5cbb-4e98-a07d-02ccaf45b88f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:08.769649 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c32f3b8e-5cbb-4e98-a07d-02ccaf45b88f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca5263a44d14c5d9be5706178e33cc0', 'request_id': 'req-c32f3b8e-5cbb-4e98-a07d-02ccaf45b88f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:08.810107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c32f3b8e-5cbb-4e98-a07d-02ccaf45b88f admin admin] The token cache is being invalidate because project aca5263a44d14c5d9be5706178e33cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:08.810697 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c32f3b8e-5cbb-4e98-a07d-02ccaf45b88f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:08.811787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c32f3b8e-5cbb-4e98-a07d-02ccaf45b88f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:08.817291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 903/1805] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:08 2022] DELETE /identity/v3/projects/aca5263a44d14c5d9be5706178e33cc0 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:08.819534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367048e-6041-4fdd-bb25-94f485e87d6a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:08.820105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367048e-6041-4fdd-bb25-94f485e87d6a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:08.820105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367048e-6041-4fdd-bb25-94f485e87d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:08.878549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-1367048e-6041-4fdd-bb25-94f485e87d6a None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:08.883383 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1367048e-6041-4fdd-bb25-94f485e87d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:09.118333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320a44-72d6-484c-8e7f-f8295c9f9f17 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:09.118333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320a44-72d6-484c-8e7f-f8295c9f9f17 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:09.118724 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320a44-72d6-484c-8e7f-f8295c9f9f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:09.122223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 903/1806] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:24:09.154746 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-bc320a44-72d6-484c-8e7f-f8295c9f9f17 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:09.160263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bc320a44-72d6-484c-8e7f-f8295c9f9f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:09.188701 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367048e-6041-4fdd-bb25-94f485e87d6a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:09.202136 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 904/1807] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:09.204350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367048e-6041-4fdd-bb25-94f485e87d6a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:09.217350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc321d-11e8-4ccd-ae2d-a64911561401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:09.220040 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc321d-11e8-4ccd-ae2d-a64911561401 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:09.220329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc321d-11e8-4ccd-ae2d-a64911561401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:09.220603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc321d-11e8-4ccd-ae2d-a64911561401 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:09.221272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc321d-11e8-4ccd-ae2d-a64911561401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:09.226142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc321d-11e8-4ccd-ae2d-a64911561401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:09.227843 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc321d-11e8-4ccd-ae2d-a64911561401 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:09.268059 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 904/1808] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:24:09.278331 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc320a44-72d6-484c-8e7f-f8295c9f9f17 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:09.292697 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc320a44-72d6-484c-8e7f-f8295c9f9f17 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:09.314943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f013c-2317-4062-b042-f33a8719afe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:09.315716 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f013c-2317-4062-b042-f33a8719afe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:09.315994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f013c-2317-4062-b042-f33a8719afe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:09.316267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f013c-2317-4062-b042-f33a8719afe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:09.321487 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f013c-2317-4062-b042-f33a8719afe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:09.323200 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f013c-2317-4062-b042-f33a8719afe7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:09.375490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc321d-11e8-4ccd-ae2d-a64911561401 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:09.377407 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-40fc321d-11e8-4ccd-ae2d-a64911561401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:09.402907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:09.461322 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 905/1809] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:09 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:09.462541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f013c-2317-4062-b042-f33a8719afe7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:09.556801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:09.597507 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc321d-11e8-4ccd-ae2d-a64911561401 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:09.656769 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f013c-2317-4062-b042-f33a8719afe7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:09.674457 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79297bd-b2bd-46ac-a3ca-8f8aa8a7363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:09.678462 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79297bd-b2bd-46ac-a3ca-8f8aa8a7363c admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:09.678744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79297bd-b2bd-46ac-a3ca-8f8aa8a7363c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:09.679023 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79297bd-b2bd-46ac-a3ca-8f8aa8a7363c admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:09.679678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79297bd-b2bd-46ac-a3ca-8f8aa8a7363c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:09.681867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79297bd-b2bd-46ac-a3ca-8f8aa8a7363c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:09.747069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 906/1810] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:09 2022] POST /identity/v3/users => generated 287 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:09.751023 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79297bd-b2bd-46ac-a3ca-8f8aa8a7363c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:09.778830 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79297bd-b2bd-46ac-a3ca-8f8aa8a7363c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:09.791568 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d88977-e2a5-4ec3-a794-96696845985a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:09.792203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d88977-e2a5-4ec3-a794-96696845985a service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:09.792476 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d88977-e2a5-4ec3-a794-96696845985a service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:09.792755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d88977-e2a5-4ec3-a794-96696845985a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:09.800342 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-46d88977-e2a5-4ec3-a794-96696845985a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:09.813312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d88977-e2a5-4ec3-a794-96696845985a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:09.815127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d88977-e2a5-4ec3-a794-96696845985a service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:09.817863 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881568a-1db0-4c62-8c4e-f8965a4afafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:09.818811 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881568a-1db0-4c62-8c4e-f8965a4afafa admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:09.822059 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881568a-1db0-4c62-8c4e-f8965a4afafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:09.823621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881568a-1db0-4c62-8c4e-f8965a4afafa admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:09.826019 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881568a-1db0-4c62-8c4e-f8965a4afafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:09.827624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 905/1811] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:09.835036 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881568a-1db0-4c62-8c4e-f8965a4afafa admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:09.886635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 907/1812] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:09.887486 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d88977-e2a5-4ec3-a794-96696845985a service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:09.927323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d88977-e2a5-4ec3-a794-96696845985a service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:09.943777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beda5d-9e20-41e8-812d-2bcb8c242e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:09.944430 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beda5d-9e20-41e8-812d-2bcb8c242e6e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:09.944678 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beda5d-9e20-41e8-812d-2bcb8c242e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:09.944955 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beda5d-9e20-41e8-812d-2bcb8c242e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:09.945813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07beda5d-9e20-41e8-812d-2bcb8c242e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:09.947449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07beda5d-9e20-41e8-812d-2bcb8c242e6e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:09.966623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881568a-1db0-4c62-8c4e-f8965a4afafa admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:09.968984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5881568a-1db0-4c62-8c4e-f8965a4afafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:09.972444 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 906/1813] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:09.977788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beda5d-9e20-41e8-812d-2bcb8c242e6e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:09.999256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beda5d-9e20-41e8-812d-2bcb8c242e6e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:10.011333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602abfcd-0f9f-422a-a50b-1b2959bb50fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:10.013256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602abfcd-0f9f-422a-a50b-1b2959bb50fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:10.013549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602abfcd-0f9f-422a-a50b-1b2959bb50fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:10.013867 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602abfcd-0f9f-422a-a50b-1b2959bb50fa admin admin] PATH_INFO: `/v3/projects/d9a0e7e568c94fcbbabde6cb735bce84/users/d8013b87d57240e187fdac16b53956f3/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:10.051162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602abfcd-0f9f-422a-a50b-1b2959bb50fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a0e7e568c94fcbbabde6cb735bce84, user_id=d8013b87d57240e187fdac16b53956f3, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:10.058915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602abfcd-0f9f-422a-a50b-1b2959bb50fa admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:10.084122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 907/1814] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:09 2022] PUT /identity/v3/projects/d9a0e7e568c94fcbbabde6cb735bce84/users/d8013b87d57240e187fdac16b53956f3/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:10.097752 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482340cd-7e54-4d13-bc5d-311a5119d222 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:10.098660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482340cd-7e54-4d13-bc5d-311a5119d222 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:10.098975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482340cd-7e54-4d13-bc5d-311a5119d222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:10.163836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881568a-1db0-4c62-8c4e-f8965a4afafa admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:10.248372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-482340cd-7e54-4d13-bc5d-311a5119d222 None None] MFA Rules not processed for user `d8013b87d57240e187fdac16b53956f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:10.259236 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-482340cd-7e54-4d13-bc5d-311a5119d222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:10.509498 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975f7c4-b821-485c-a7b1-33c3e07d6474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:10.511733 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975f7c4-b821-485c-a7b1-33c3e07d6474 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:10.512042 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975f7c4-b821-485c-a7b1-33c3e07d6474 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:10.512327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975f7c4-b821-485c-a7b1-33c3e07d6474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:10.519218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e975f7c4-b821-485c-a7b1-33c3e07d6474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:10.548053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:10.613293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 908/1815] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:10.617434 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482340cd-7e54-4d13-bc5d-311a5119d222 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:10.763636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975f7c4-b821-485c-a7b1-33c3e07d6474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:10.765362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975f7c4-b821-485c-a7b1-33c3e07d6474 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:10.801153 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 908/1816] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 835 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:24:10.871105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482340cd-7e54-4d13-bc5d-311a5119d222 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:10.886035 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36a528-bd12-4d1f-a0ef-40b25d19dfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:10.887851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36a528-bd12-4d1f-a0ef-40b25d19dfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:10.888111 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36a528-bd12-4d1f-a0ef-40b25d19dfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:10.888398 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36a528-bd12-4d1f-a0ef-40b25d19dfb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:10.895734 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36a528-bd12-4d1f-a0ef-40b25d19dfb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:10.902418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36a528-bd12-4d1f-a0ef-40b25d19dfb9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:11.017274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 909/1817] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:10 2022] POST /identity/v3/projects => generated 375 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:11.022765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975f7c4-b821-485c-a7b1-33c3e07d6474 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:11.042070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975f7c4-b821-485c-a7b1-33c3e07d6474 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:11.065428 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:11.240789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdb1e7-3ade-4976-a76e-b11ee591e495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:11.241516 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdb1e7-3ade-4976-a76e-b11ee591e495 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:11.241901 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdb1e7-3ade-4976-a76e-b11ee591e495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:11.242307 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdb1e7-3ade-4976-a76e-b11ee591e495 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:11.243743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdb1e7-3ade-4976-a76e-b11ee591e495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:11.254564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdb1e7-3ade-4976-a76e-b11ee591e495 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:11.344510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 909/1818] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:11 2022] POST /identity/v3/users => generated 294 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:11.346150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36a528-bd12-4d1f-a0ef-40b25d19dfb9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:11.366313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36a528-bd12-4d1f-a0ef-40b25d19dfb9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:11.405136 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f55bde-1f18-493d-9cfd-cda61713e133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:11.406051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f55bde-1f18-493d-9cfd-cda61713e133 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:11.406266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f55bde-1f18-493d-9cfd-cda61713e133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:11.406625 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f55bde-1f18-493d-9cfd-cda61713e133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:11.407382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f55bde-1f18-493d-9cfd-cda61713e133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:11.411979 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f55bde-1f18-493d-9cfd-cda61713e133 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:11.453772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 910/1819] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:11.453980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdb1e7-3ade-4976-a76e-b11ee591e495 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:11.475415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdb1e7-3ade-4976-a76e-b11ee591e495 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:11.529108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3f4b7-98c7-43d9-af56-fd0eb7d844e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:11.532375 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3f4b7-98c7-43d9-af56-fd0eb7d844e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:11.532686 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3f4b7-98c7-43d9-af56-fd0eb7d844e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:11.532970 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3f4b7-98c7-43d9-af56-fd0eb7d844e5 admin admin] PATH_INFO: `/v3/projects/2fb2c90876a8440fa4d3a10854cf2053/users/a295325fbd584193a451ab0c6539a437/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:11.653349 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3f4b7-98c7-43d9-af56-fd0eb7d844e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb2c90876a8440fa4d3a10854cf2053, user_id=a295325fbd584193a451ab0c6539a437, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:11.662272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3f4b7-98c7-43d9-af56-fd0eb7d844e5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:11.798516 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 910/1820] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:11 2022] PUT /identity/v3/projects/2fb2c90876a8440fa4d3a10854cf2053/users/a295325fbd584193a451ab0c6539a437/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:11.799830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f55bde-1f18-493d-9cfd-cda61713e133 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:11.814044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f55bde-1f18-493d-9cfd-cda61713e133 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:12.041536 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393b229-c192-4b99-9b8a-6f4886203b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:12.042466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393b229-c192-4b99-9b8a-6f4886203b72 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:12.042466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393b229-c192-4b99-9b8a-6f4886203b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:12.042735 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393b229-c192-4b99-9b8a-6f4886203b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:12.043393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393b229-c192-4b99-9b8a-6f4886203b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:12.045023 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393b229-c192-4b99-9b8a-6f4886203b72 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:12.077118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 911/1821] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:12.083015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3f4b7-98c7-43d9-af56-fd0eb7d844e5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:12.133360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3f4b7-98c7-43d9-af56-fd0eb7d844e5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:12.182041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2a032-ab37-49da-abd5-d254c6165589 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:12.182543 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2a032-ab37-49da-abd5-d254c6165589 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:12.182824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2a032-ab37-49da-abd5-d254c6165589 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:12.186003 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 912/1822] 10.222.0.57 () {54 vars in 921 bytes} [Tue Sep 27 17:24:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:24:12.187431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f11b01-5f8c-4506-a60c-a4c784f7ec99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:12.193771 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f11b01-5f8c-4506-a60c-a4c784f7ec99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:12.196289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f11b01-5f8c-4506-a60c-a4c784f7ec99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:12.197943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f11b01-5f8c-4506-a60c-a4c784f7ec99 admin admin] PATH_INFO: `/v3/projects/2fb2c90876a8440fa4d3a10854cf2053/users/a295325fbd584193a451ab0c6539a437/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:12.205189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f11b01-5f8c-4506-a60c-a4c784f7ec99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb2c90876a8440fa4d3a10854cf2053, user_id=a295325fbd584193a451ab0c6539a437, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:12.213983 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f11b01-5f8c-4506-a60c-a4c784f7ec99 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:12.287449 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 911/1823] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:12 2022] PUT /identity/v3/projects/2fb2c90876a8440fa4d3a10854cf2053/users/a295325fbd584193a451ab0c6539a437/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:12.289274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fc2fe-521d-433b-9717-188117a8fe08 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:12.289564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fc2fe-521d-433b-9717-188117a8fe08 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:12.289877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fc2fe-521d-433b-9717-188117a8fe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:12.335251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e345621-1abc-4b38-b22c-c32036f014c4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:12.335612 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e345621-1abc-4b38-b22c-c32036f014c4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:12.335898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e345621-1abc-4b38-b22c-c32036f014c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:12.419793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4e345621-1abc-4b38-b22c-c32036f014c4 None None] MFA Rules not processed for user `e75b03fde75e411bace8d406237a7e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:12.423846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4e345621-1abc-4b38-b22c-c32036f014c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:12.443430 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-221fc2fe-521d-433b-9717-188117a8fe08 None None] MFA Rules not processed for user `a295325fbd584193a451ab0c6539a437`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:12.448616 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-221fc2fe-521d-433b-9717-188117a8fe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:12.600443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 912/1824] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Sep 27 17:24:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:12.602856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e345621-1abc-4b38-b22c-c32036f014c4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:12.606429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4e345621-1abc-4b38-b22c-c32036f014c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:12.609310 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:12.692952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 913/1825] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:12.713611 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fc2fe-521d-433b-9717-188117a8fe08 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:12.797083 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:12.814153 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e345621-1abc-4b38-b22c-c32036f014c4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:12.840255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756629e-48aa-48ff-be8d-5977b11f93f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:12.840914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756629e-48aa-48ff-be8d-5977b11f93f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:12.841195 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756629e-48aa-48ff-be8d-5977b11f93f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:12.841476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756629e-48aa-48ff-be8d-5977b11f93f9 admin admin] PATH_INFO: `/v3/users/72ea957643c2496888cc403ad0d7ee67` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:12.843738 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756629e-48aa-48ff-be8d-5977b11f93f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ea957643c2496888cc403ad0d7ee67)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:12.845735 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756629e-48aa-48ff-be8d-5977b11f93f9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:12.851748 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fc2fe-521d-433b-9717-188117a8fe08 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:12.857271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08057e57-a419-40fd-b409-db790c7a8f3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:12.858273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08057e57-a419-40fd-b409-db790c7a8f3b service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:12.858668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08057e57-a419-40fd-b409-db790c7a8f3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:12.859046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08057e57-a419-40fd-b409-db790c7a8f3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:12.950227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f756629e-48aa-48ff-be8d-5977b11f93f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ea957643c2496888cc403ad0d7ee67'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:12.969863 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f756629e-48aa-48ff-be8d-5977b11f93f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ea957643c2496888cc403ad0d7ee67'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:12.984699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08057e57-a419-40fd-b409-db790c7a8f3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:12.986908 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08057e57-a419-40fd-b409-db790c7a8f3b service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:13.008890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f756629e-48aa-48ff-be8d-5977b11f93f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ea957643c2496888cc403ad0d7ee67'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:13.008890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f756629e-48aa-48ff-be8d-5977b11f93f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ea957643c2496888cc403ad0d7ee67'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:13.009640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f756629e-48aa-48ff-be8d-5977b11f93f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ea957643c2496888cc403ad0d7ee67'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:13.013388 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 914/1826] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:13.019181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 913/1827] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:12 2022] DELETE /identity/v3/users/72ea957643c2496888cc403ad0d7ee67 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:13.024128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be5847-0911-45aa-8e7d-57b4f6cdf827 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:13.024418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be5847-0911-45aa-8e7d-57b4f6cdf827 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:13.024694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be5847-0911-45aa-8e7d-57b4f6cdf827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:13.050283 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f5be5847-0911-45aa-8e7d-57b4f6cdf827 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:13.052759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f5be5847-0911-45aa-8e7d-57b4f6cdf827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:13.141022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 915/1828] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:13.151179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756629e-48aa-48ff-be8d-5977b11f93f9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:13.153527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f756629e-48aa-48ff-be8d-5977b11f93f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:13.273030 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756629e-48aa-48ff-be8d-5977b11f93f9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:13.282392 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c8837-9f1a-4930-ab60-caa07f635c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:13.283120 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c8837-9f1a-4930-ab60-caa07f635c4a service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:13.287908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c8837-9f1a-4930-ab60-caa07f635c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:13.288297 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c8837-9f1a-4930-ab60-caa07f635c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:13.333836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c8837-9f1a-4930-ab60-caa07f635c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:13.335638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c8837-9f1a-4930-ab60-caa07f635c4a service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:13.360628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be5847-0911-45aa-8e7d-57b4f6cdf827 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:13.362428 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f5be5847-0911-45aa-8e7d-57b4f6cdf827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:13.368650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 914/1829] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:13.443667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:13.537348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be5847-0911-45aa-8e7d-57b4f6cdf827 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:13.568162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654a292-54a2-477f-b208-8fece191eaf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:13.568979 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654a292-54a2-477f-b208-8fece191eaf4 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:13.569393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654a292-54a2-477f-b208-8fece191eaf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:13.570142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654a292-54a2-477f-b208-8fece191eaf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:13.572190 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f654a292-54a2-477f-b208-8fece191eaf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:13.600227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654a292-54a2-477f-b208-8fece191eaf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:13.602393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654a292-54a2-477f-b208-8fece191eaf4 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:13.625900 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 916/1830] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:24:13.903347 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c8837-9f1a-4930-ab60-caa07f635c4a service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:13.905663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-894c8837-9f1a-4930-ab60-caa07f635c4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:13.922152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c8837-9f1a-4930-ab60-caa07f635c4a service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:13.934803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccc462-3c7e-4a89-ad92-37bd6f35b323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:13.935461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccc462-3c7e-4a89-ad92-37bd6f35b323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:13.935747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccc462-3c7e-4a89-ad92-37bd6f35b323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:13.936123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccc462-3c7e-4a89-ad92-37bd6f35b323 admin admin] PATH_INFO: `/v3/projects/9b5ff4b4d15941daaf256e2343287ddf` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:13.938145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccc462-3c7e-4a89-ad92-37bd6f35b323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b5ff4b4d15941daaf256e2343287ddf)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:13.947052 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccc462-3c7e-4a89-ad92-37bd6f35b323 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:13.997931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-03ccc462-3c7e-4a89-ad92-37bd6f35b323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b5ff4b4d15941daaf256e2343287ddf', 'request_id': 'req-03ccc462-3c7e-4a89-ad92-37bd6f35b323'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:14.005201 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-03ccc462-3c7e-4a89-ad92-37bd6f35b323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b5ff4b4d15941daaf256e2343287ddf', 'request_id': 'req-03ccc462-3c7e-4a89-ad92-37bd6f35b323'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:14.012479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-03ccc462-3c7e-4a89-ad92-37bd6f35b323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b5ff4b4d15941daaf256e2343287ddf', 'request_id': 'req-03ccc462-3c7e-4a89-ad92-37bd6f35b323'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:14.024420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:14.029896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-03ccc462-3c7e-4a89-ad92-37bd6f35b323 admin admin] The token cache is being invalidate because project 9b5ff4b4d15941daaf256e2343287ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:14.030205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-03ccc462-3c7e-4a89-ad92-37bd6f35b323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:14.031446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-03ccc462-3c7e-4a89-ad92-37bd6f35b323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:14.033491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 915/1831] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:13 2022] DELETE /identity/v3/projects/9b5ff4b4d15941daaf256e2343287ddf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:14.038086 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654a292-54a2-477f-b208-8fece191eaf4 service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:14.048846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654a292-54a2-477f-b208-8fece191eaf4 service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:14.136207 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394bb48-2786-43b2-b1f7-ab5b5d527d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:14.137000 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394bb48-2786-43b2-b1f7-ab5b5d527d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:14.137348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394bb48-2786-43b2-b1f7-ab5b5d527d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:14.137770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394bb48-2786-43b2-b1f7-ab5b5d527d7d admin admin] PATH_INFO: `/v3/users/9330836d840d44139cf696b0d739d405` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:14.139191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394bb48-2786-43b2-b1f7-ab5b5d527d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9330836d840d44139cf696b0d739d405)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:14.141277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394bb48-2786-43b2-b1f7-ab5b5d527d7d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:14.210091 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e394bb48-2786-43b2-b1f7-ab5b5d527d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9330836d840d44139cf696b0d739d405'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:14.210817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e394bb48-2786-43b2-b1f7-ab5b5d527d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9330836d840d44139cf696b0d739d405'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:14.220492 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e394bb48-2786-43b2-b1f7-ab5b5d527d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9330836d840d44139cf696b0d739d405'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:14.241153 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e394bb48-2786-43b2-b1f7-ab5b5d527d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9330836d840d44139cf696b0d739d405'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:14.251620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e394bb48-2786-43b2-b1f7-ab5b5d527d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9330836d840d44139cf696b0d739d405'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:14.259331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 917/1832] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:14 2022] DELETE /identity/v3/users/9330836d840d44139cf696b0d739d405 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:14.823761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccc462-3c7e-4a89-ad92-37bd6f35b323 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:14.825280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-03ccc462-3c7e-4a89-ad92-37bd6f35b323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:14.858222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccc462-3c7e-4a89-ad92-37bd6f35b323 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:14.945990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17eaae5-6fb6-491d-b427-903b38d31d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:14.946900 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17eaae5-6fb6-491d-b427-903b38d31d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:14.947281 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17eaae5-6fb6-491d-b427-903b38d31d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:14.947873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17eaae5-6fb6-491d-b427-903b38d31d06 admin admin] PATH_INFO: `/v3/projects/95d69a12d2214e4ebadb0c72cd1aee64` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:14.948961 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17eaae5-6fb6-491d-b427-903b38d31d06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95d69a12d2214e4ebadb0c72cd1aee64)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:14.951773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17eaae5-6fb6-491d-b427-903b38d31d06 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:15.009428 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d17eaae5-6fb6-491d-b427-903b38d31d06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95d69a12d2214e4ebadb0c72cd1aee64', 'request_id': 'req-d17eaae5-6fb6-491d-b427-903b38d31d06'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:15.015961 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d17eaae5-6fb6-491d-b427-903b38d31d06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95d69a12d2214e4ebadb0c72cd1aee64', 'request_id': 'req-d17eaae5-6fb6-491d-b427-903b38d31d06'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:15.023649 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d17eaae5-6fb6-491d-b427-903b38d31d06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95d69a12d2214e4ebadb0c72cd1aee64', 'request_id': 'req-d17eaae5-6fb6-491d-b427-903b38d31d06'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:15.040345 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d17eaae5-6fb6-491d-b427-903b38d31d06 admin admin] The token cache is being invalidate because project 95d69a12d2214e4ebadb0c72cd1aee64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:15.040753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d17eaae5-6fb6-491d-b427-903b38d31d06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:15.041484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d17eaae5-6fb6-491d-b427-903b38d31d06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:15.043617 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 916/1833] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:14 2022] DELETE /identity/v3/projects/95d69a12d2214e4ebadb0c72cd1aee64 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:15.049410 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a12c08-427a-41df-8db1-6a828f831d8b None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:15.049815 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a12c08-427a-41df-8db1-6a828f831d8b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:15.050194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a12c08-427a-41df-8db1-6a828f831d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:15.075582 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-43a12c08-427a-41df-8db1-6a828f831d8b None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:15.076943 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-43a12c08-427a-41df-8db1-6a828f831d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:15.124309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:15.175494 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 918/1834] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:15.183718 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f20cd3-78f0-46ee-a989-a3da42fdf3b5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:15.184099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f20cd3-78f0-46ee-a989-a3da42fdf3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:15.184440 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f20cd3-78f0-46ee-a989-a3da42fdf3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:15.206947 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-96f20cd3-78f0-46ee-a989-a3da42fdf3b5 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:15.209118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-96f20cd3-78f0-46ee-a989-a3da42fdf3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:15.217568 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 917/1835] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:15.222014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a12c08-427a-41df-8db1-6a828f831d8b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:15.236243 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a12c08-427a-41df-8db1-6a828f831d8b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:15.245974 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be78bb-c27c-46a2-9848-e7fd90598b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:15.246717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be78bb-c27c-46a2-9848-e7fd90598b04 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:15.247105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be78bb-c27c-46a2-9848-e7fd90598b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:15.247841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be78bb-c27c-46a2-9848-e7fd90598b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:15.248433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be78bb-c27c-46a2-9848-e7fd90598b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:15.248962 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be78bb-c27c-46a2-9848-e7fd90598b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:15.250783 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be78bb-c27c-46a2-9848-e7fd90598b04 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:15.269316 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 919/1836] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:24:15.270821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f20cd3-78f0-46ee-a989-a3da42fdf3b5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:15.280703 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f20cd3-78f0-46ee-a989-a3da42fdf3b5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:15.292957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80890f90-00fd-4d34-8cdd-d173acafa63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:15.295072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80890f90-00fd-4d34-8cdd-d173acafa63f admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:15.295499 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80890f90-00fd-4d34-8cdd-d173acafa63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:15.295954 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80890f90-00fd-4d34-8cdd-d173acafa63f admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:15.297789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80890f90-00fd-4d34-8cdd-d173acafa63f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:15.300031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80890f90-00fd-4d34-8cdd-d173acafa63f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:15.337168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 918/1837] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:15 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:24:15.341796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be78bb-c27c-46a2-9848-e7fd90598b04 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:15.352652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be78bb-c27c-46a2-9848-e7fd90598b04 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:15.421423 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310d31d-0f2a-4d75-97d6-799294dbb4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:15.421423 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d31d-0f2a-4d75-97d6-799294dbb4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:15.421423 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d31d-0f2a-4d75-97d6-799294dbb4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:15.421423 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d31d-0f2a-4d75-97d6-799294dbb4d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:15.422135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310d31d-0f2a-4d75-97d6-799294dbb4d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:15.423939 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310d31d-0f2a-4d75-97d6-799294dbb4d0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:15.457642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 920/1838] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:15 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:15.461647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80890f90-00fd-4d34-8cdd-d173acafa63f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:15.479072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80890f90-00fd-4d34-8cdd-d173acafa63f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:15.484084 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a3eda-0384-4ef3-b2be-df4dc9e0b715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:15.485175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a3eda-0384-4ef3-b2be-df4dc9e0b715 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:15.485790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a3eda-0384-4ef3-b2be-df4dc9e0b715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:15.486133 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a3eda-0384-4ef3-b2be-df4dc9e0b715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:15.487070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a3eda-0384-4ef3-b2be-df4dc9e0b715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:15.489326 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a3eda-0384-4ef3-b2be-df4dc9e0b715 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:15.500674 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 919/1839] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:15.504591 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310d31d-0f2a-4d75-97d6-799294dbb4d0 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:15.516511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310d31d-0f2a-4d75-97d6-799294dbb4d0 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:15.521863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b921635-5669-417d-906f-20c63a8c7705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:15.522506 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b921635-5669-417d-906f-20c63a8c7705 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:15.522788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b921635-5669-417d-906f-20c63a8c7705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:15.523062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b921635-5669-417d-906f-20c63a8c7705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:15.523716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b921635-5669-417d-906f-20c63a8c7705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:15.525338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b921635-5669-417d-906f-20c63a8c7705 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:15.542909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 921/1840] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:15.544480 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a3eda-0384-4ef3-b2be-df4dc9e0b715 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:15.560856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a3eda-0384-4ef3-b2be-df4dc9e0b715 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:15.567554 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64597bde-9b4a-43c6-8695-cc935b102d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:15.568237 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64597bde-9b4a-43c6-8695-cc935b102d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:15.568522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64597bde-9b4a-43c6-8695-cc935b102d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:15.568801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64597bde-9b4a-43c6-8695-cc935b102d37 admin admin] PATH_INFO: `/v3/projects/0211bfcec4e04cb0895319cf382267d0/users/1ddee9f09e214b2ebe7edafd462c59e8/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:15.586680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64597bde-9b4a-43c6-8695-cc935b102d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0211bfcec4e04cb0895319cf382267d0, user_id=1ddee9f09e214b2ebe7edafd462c59e8, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:15.590693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64597bde-9b4a-43c6-8695-cc935b102d37 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:15.615231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 920/1841] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:15 2022] PUT /identity/v3/projects/0211bfcec4e04cb0895319cf382267d0/users/1ddee9f09e214b2ebe7edafd462c59e8/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:15.621889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b921635-5669-417d-906f-20c63a8c7705 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:15.626365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89652d3-3fc9-44c8-bba7-a99f70f29206 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:15.626769 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89652d3-3fc9-44c8-bba7-a99f70f29206 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:15.627174 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89652d3-3fc9-44c8-bba7-a99f70f29206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:15.627403 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3b921635-5669-417d-906f-20c63a8c7705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:15.649251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b921635-5669-417d-906f-20c63a8c7705 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:15.677611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d89652d3-3fc9-44c8-bba7-a99f70f29206 None None] MFA Rules not processed for user `1ddee9f09e214b2ebe7edafd462c59e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:15.678875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d89652d3-3fc9-44c8-bba7-a99f70f29206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:15.697582 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:15.755436 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51aae9-3b64-437a-8eae-54e4cc63c63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:15.756345 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51aae9-3b64-437a-8eae-54e4cc63c63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:15.756973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51aae9-3b64-437a-8eae-54e4cc63c63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:15.757485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51aae9-3b64-437a-8eae-54e4cc63c63e admin admin] PATH_INFO: `/v3/users/6951e42106ea4ff1bd315bde36e1c1c1` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:15.759457 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51aae9-3b64-437a-8eae-54e4cc63c63e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6951e42106ea4ff1bd315bde36e1c1c1)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:15.762028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51aae9-3b64-437a-8eae-54e4cc63c63e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:15.805332 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 921/1842] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:15.809659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89652d3-3fc9-44c8-bba7-a99f70f29206 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:15.824382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89652d3-3fc9-44c8-bba7-a99f70f29206 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:15.836679 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918d3ea-208b-433a-9448-a40a3fe75f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:15.837807 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918d3ea-208b-433a-9448-a40a3fe75f1e admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:15.838276 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918d3ea-208b-433a-9448-a40a3fe75f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:15.838826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918d3ea-208b-433a-9448-a40a3fe75f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:15.839825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918d3ea-208b-433a-9448-a40a3fe75f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:15.842234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918d3ea-208b-433a-9448-a40a3fe75f1e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:15.851671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ec51aae9-3b64-437a-8eae-54e4cc63c63e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6951e42106ea4ff1bd315bde36e1c1c1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:15.852673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ec51aae9-3b64-437a-8eae-54e4cc63c63e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6951e42106ea4ff1bd315bde36e1c1c1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:15.854761 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:15.866856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ec51aae9-3b64-437a-8eae-54e4cc63c63e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6951e42106ea4ff1bd315bde36e1c1c1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:15.883062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ec51aae9-3b64-437a-8eae-54e4cc63c63e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6951e42106ea4ff1bd315bde36e1c1c1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:15.887003 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 922/1843] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:15 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:15.890410 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ec51aae9-3b64-437a-8eae-54e4cc63c63e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6951e42106ea4ff1bd315bde36e1c1c1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:15.892724 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918d3ea-208b-433a-9448-a40a3fe75f1e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:15.897743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9918d3ea-208b-433a-9448-a40a3fe75f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:15.898086 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 922/1844] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:15 2022] DELETE /identity/v3/users/6951e42106ea4ff1bd315bde36e1c1c1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:15.902235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe84c64-0f3f-4b70-b74f-2d24dc7cf1bd None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:15.902845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe84c64-0f3f-4b70-b74f-2d24dc7cf1bd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:15.903142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe84c64-0f3f-4b70-b74f-2d24dc7cf1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:15.923365 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7fe84c64-0f3f-4b70-b74f-2d24dc7cf1bd None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:15.924801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7fe84c64-0f3f-4b70-b74f-2d24dc7cf1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:16.012079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 923/1845] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:16.029170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918d3ea-208b-433a-9448-a40a3fe75f1e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:16.033863 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3fded-847c-4d10-9459-ecd2a54047b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:16.034795 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3fded-847c-4d10-9459-ecd2a54047b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:16.035513 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3fded-847c-4d10-9459-ecd2a54047b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:16.036288 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3fded-847c-4d10-9459-ecd2a54047b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:16.036460 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe84c64-0f3f-4b70-b74f-2d24dc7cf1bd None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:16.037540 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3fded-847c-4d10-9459-ecd2a54047b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:16.038103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7fe84c64-0f3f-4b70-b74f-2d24dc7cf1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:16.039942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3fded-847c-4d10-9459-ecd2a54047b9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:16.091902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 923/1846] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:15 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:16.092744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3fded-847c-4d10-9459-ecd2a54047b9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:16.100135 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-97a3fded-847c-4d10-9459-ecd2a54047b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:16.113142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe84c64-0f3f-4b70-b74f-2d24dc7cf1bd None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:16.117349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82899e-3594-4f7a-99e5-8a6dcad8b6de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:16.117937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82899e-3594-4f7a-99e5-8a6dcad8b6de service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:16.118219 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82899e-3594-4f7a-99e5-8a6dcad8b6de service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:16.118490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82899e-3594-4f7a-99e5-8a6dcad8b6de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:16.120237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ae82899e-3594-4f7a-99e5-8a6dcad8b6de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:16.176104 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3fded-847c-4d10-9459-ecd2a54047b9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:16.183278 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714df46e-0b60-480d-a554-6900fbca94da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:16.184304 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714df46e-0b60-480d-a554-6900fbca94da service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:16.184600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714df46e-0b60-480d-a554-6900fbca94da service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:16.185336 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714df46e-0b60-480d-a554-6900fbca94da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:16.198822 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714df46e-0b60-480d-a554-6900fbca94da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:16.200277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714df46e-0b60-480d-a554-6900fbca94da service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:16.208413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82899e-3594-4f7a-99e5-8a6dcad8b6de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:16.210755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82899e-3594-4f7a-99e5-8a6dcad8b6de service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:16.211183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 924/1847] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:16.212038 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714df46e-0b60-480d-a554-6900fbca94da service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:16.228732 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714df46e-0b60-480d-a554-6900fbca94da service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:16.236234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 924/1848] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:24:16.249162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893eb07-5b90-4c2f-926b-f23efc12ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:16.250282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893eb07-5b90-4c2f-926b-f23efc12ff03 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:16.250800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893eb07-5b90-4c2f-926b-f23efc12ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:16.251276 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893eb07-5b90-4c2f-926b-f23efc12ff03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:16.252361 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893eb07-5b90-4c2f-926b-f23efc12ff03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:16.254763 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893eb07-5b90-4c2f-926b-f23efc12ff03 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:16.269409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 925/1849] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:16.270765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82899e-3594-4f7a-99e5-8a6dcad8b6de service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:16.284158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82899e-3594-4f7a-99e5-8a6dcad8b6de service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:16.292052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e14a60-141b-4b4a-a06a-95bf08062f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:16.292733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e14a60-141b-4b4a-a06a-95bf08062f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:16.293544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e14a60-141b-4b4a-a06a-95bf08062f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:16.293544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e14a60-141b-4b4a-a06a-95bf08062f74 admin admin] PATH_INFO: `/v3/projects/018cc994a81c408fb937af2aa2c324c5/users/0767b9930b91440a9aac27a69f9c6620/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:16.310663 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:16.317740 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e14a60-141b-4b4a-a06a-95bf08062f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=018cc994a81c408fb937af2aa2c324c5, user_id=0767b9930b91440a9aac27a69f9c6620, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:16.321032 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e14a60-141b-4b4a-a06a-95bf08062f74 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:16.348972 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 925/1850] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:16 2022] PUT /identity/v3/projects/018cc994a81c408fb937af2aa2c324c5/users/0767b9930b91440a9aac27a69f9c6620/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:16.352898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893eb07-5b90-4c2f-926b-f23efc12ff03 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:16.367861 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893eb07-5b90-4c2f-926b-f23efc12ff03 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:16.386315 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:16.570466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44bb83-fff7-4c3b-872d-ae10d20b0c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:16.571099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44bb83-fff7-4c3b-872d-ae10d20b0c9a admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:16.571382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44bb83-fff7-4c3b-872d-ae10d20b0c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:16.571659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44bb83-fff7-4c3b-872d-ae10d20b0c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:16.572315 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44bb83-fff7-4c3b-872d-ae10d20b0c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:16.574152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44bb83-fff7-4c3b-872d-ae10d20b0c9a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:16.586621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 926/1851] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:16.594055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e14a60-141b-4b4a-a06a-95bf08062f74 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:16.606017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e14a60-141b-4b4a-a06a-95bf08062f74 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:16.612461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b144b2-8d4a-408f-a5d7-0aa5d9233b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:16.612853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b144b2-8d4a-408f-a5d7-0aa5d9233b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:16.613138 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b144b2-8d4a-408f-a5d7-0aa5d9233b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:16.614165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b144b2-8d4a-408f-a5d7-0aa5d9233b6b admin admin] PATH_INFO: `/v3/projects/018cc994a81c408fb937af2aa2c324c5/users/0767b9930b91440a9aac27a69f9c6620/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:16.616813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b144b2-8d4a-408f-a5d7-0aa5d9233b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=018cc994a81c408fb937af2aa2c324c5, user_id=0767b9930b91440a9aac27a69f9c6620, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:16.620955 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b144b2-8d4a-408f-a5d7-0aa5d9233b6b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:16.640556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 926/1852] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:16 2022] PUT /identity/v3/projects/018cc994a81c408fb937af2aa2c324c5/users/0767b9930b91440a9aac27a69f9c6620/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:16.651801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c4b93-1ba6-4b62-98e6-02e0d62ee0c1 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:16.652082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c4b93-1ba6-4b62-98e6-02e0d62ee0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:16.652353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c4b93-1ba6-4b62-98e6-02e0d62ee0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:16.688951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c77c4b93-1ba6-4b62-98e6-02e0d62ee0c1 None None] MFA Rules not processed for user `0767b9930b91440a9aac27a69f9c6620`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:16.690244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c77c4b93-1ba6-4b62-98e6-02e0d62ee0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:16.833780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 927/1853] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:16.847233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b144b2-8d4a-408f-a5d7-0aa5d9233b6b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:16.925579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b144b2-8d4a-408f-a5d7-0aa5d9233b6b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:16.933360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006609b8-5fe3-408e-b600-97ed171b99c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:16.934188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006609b8-5fe3-408e-b600-97ed171b99c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:16.934584 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006609b8-5fe3-408e-b600-97ed171b99c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:16.935953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006609b8-5fe3-408e-b600-97ed171b99c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:16.947984 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006609b8-5fe3-408e-b600-97ed171b99c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:16.950133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006609b8-5fe3-408e-b600-97ed171b99c2 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:16.962158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 927/1854] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:17.100569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c4b93-1ba6-4b62-98e6-02e0d62ee0c1 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:17.111352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c4b93-1ba6-4b62-98e6-02e0d62ee0c1 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:17.115185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95ba4d-d413-4e31-9ec3-006f28303c3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:17.115793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95ba4d-d413-4e31-9ec3-006f28303c3b service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:17.116072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95ba4d-d413-4e31-9ec3-006f28303c3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:17.116344 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95ba4d-d413-4e31-9ec3-006f28303c3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:17.118175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ee95ba4d-d413-4e31-9ec3-006f28303c3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:17.120948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006609b8-5fe3-408e-b600-97ed171b99c2 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:17.122603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-006609b8-5fe3-408e-b600-97ed171b99c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:17.192014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95ba4d-d413-4e31-9ec3-006f28303c3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:17.193796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95ba4d-d413-4e31-9ec3-006f28303c3b service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:17.204366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 928/1855] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:17.237425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006609b8-5fe3-408e-b600-97ed171b99c2 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:17.243410 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d390c1-418b-474b-9a5a-b5507114238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:17.244042 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d390c1-418b-474b-9a5a-b5507114238c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:17.244324 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d390c1-418b-474b-9a5a-b5507114238c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:17.244598 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d390c1-418b-474b-9a5a-b5507114238c admin admin] PATH_INFO: `/v3/projects/354e4e09b1ed482c86ed7b256ed108c1` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:17.266112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d390c1-418b-474b-9a5a-b5507114238c admin admin] RBAC: Authorizing `identity:delete_project(project_id=354e4e09b1ed482c86ed7b256ed108c1)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:17.268427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d390c1-418b-474b-9a5a-b5507114238c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:17.362710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7d390c1-418b-474b-9a5a-b5507114238c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354e4e09b1ed482c86ed7b256ed108c1', 'request_id': 'req-a7d390c1-418b-474b-9a5a-b5507114238c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:17.376101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7d390c1-418b-474b-9a5a-b5507114238c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354e4e09b1ed482c86ed7b256ed108c1', 'request_id': 'req-a7d390c1-418b-474b-9a5a-b5507114238c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:17.383530 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7d390c1-418b-474b-9a5a-b5507114238c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354e4e09b1ed482c86ed7b256ed108c1', 'request_id': 'req-a7d390c1-418b-474b-9a5a-b5507114238c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:17.408976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7d390c1-418b-474b-9a5a-b5507114238c admin admin] The token cache is being invalidate because project 354e4e09b1ed482c86ed7b256ed108c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:17.409276 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7d390c1-418b-474b-9a5a-b5507114238c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:17.410386 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7d390c1-418b-474b-9a5a-b5507114238c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:17.412091 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 928/1856] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:17 2022] DELETE /identity/v3/projects/354e4e09b1ed482c86ed7b256ed108c1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:17.420641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95ba4d-d413-4e31-9ec3-006f28303c3b service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:17.433677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95ba4d-d413-4e31-9ec3-006f28303c3b service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:17.475712 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:17.536007 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d062bc1-1b0c-4255-b8a9-035b32392e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:17.536918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d062bc1-1b0c-4255-b8a9-035b32392e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:17.536918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d062bc1-1b0c-4255-b8a9-035b32392e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:17.537155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d062bc1-1b0c-4255-b8a9-035b32392e49 admin admin] PATH_INFO: `/v3/users/24f55549434b48a6a416dacf04d0db13` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:17.539022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d062bc1-1b0c-4255-b8a9-035b32392e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f55549434b48a6a416dacf04d0db13)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:17.541640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d062bc1-1b0c-4255-b8a9-035b32392e49 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:17.627057 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7d062bc1-1b0c-4255-b8a9-035b32392e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f55549434b48a6a416dacf04d0db13'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:17.636793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d390c1-418b-474b-9a5a-b5507114238c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:17.641583 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a7d390c1-418b-474b-9a5a-b5507114238c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:17.654367 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7d062bc1-1b0c-4255-b8a9-035b32392e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f55549434b48a6a416dacf04d0db13'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:17.668908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7d062bc1-1b0c-4255-b8a9-035b32392e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f55549434b48a6a416dacf04d0db13'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:17.670612 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d390c1-418b-474b-9a5a-b5507114238c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:17.679266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7d062bc1-1b0c-4255-b8a9-035b32392e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f55549434b48a6a416dacf04d0db13'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:17.680093 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8544e-9f95-492e-9eb3-cc4d53c52e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:17.681286 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8544e-9f95-492e-9eb3-cc4d53c52e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:17.681923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7d062bc1-1b0c-4255-b8a9-035b32392e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f55549434b48a6a416dacf04d0db13'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:17.682602 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8544e-9f95-492e-9eb3-cc4d53c52e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:17.683973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8544e-9f95-492e-9eb3-cc4d53c52e16 admin admin] PATH_INFO: `/v3/users/1ddee9f09e214b2ebe7edafd462c59e8` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:17.687747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8544e-9f95-492e-9eb3-cc4d53c52e16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ddee9f09e214b2ebe7edafd462c59e8)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:17.696194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8544e-9f95-492e-9eb3-cc4d53c52e16 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:17.701775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 929/1857] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:17 2022] DELETE /identity/v3/users/24f55549434b48a6a416dacf04d0db13 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:17.706637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:17.812011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-96a8544e-9f95-492e-9eb3-cc4d53c52e16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ddee9f09e214b2ebe7edafd462c59e8'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:17.813394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-96a8544e-9f95-492e-9eb3-cc4d53c52e16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ddee9f09e214b2ebe7edafd462c59e8'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:17.846171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-96a8544e-9f95-492e-9eb3-cc4d53c52e16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ddee9f09e214b2ebe7edafd462c59e8'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:17.877026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-96a8544e-9f95-492e-9eb3-cc4d53c52e16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ddee9f09e214b2ebe7edafd462c59e8'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:17.887044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-96a8544e-9f95-492e-9eb3-cc4d53c52e16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ddee9f09e214b2ebe7edafd462c59e8'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:17.901991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 929/1858] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:17 2022] DELETE /identity/v3/users/1ddee9f09e214b2ebe7edafd462c59e8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:17.903937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cd4d1-a447-4188-ba2f-9b6f4031baf3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:17.905020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cd4d1-a447-4188-ba2f-9b6f4031baf3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:17.905525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cd4d1-a447-4188-ba2f-9b6f4031baf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:17.950108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0d5cd4d1-a447-4188-ba2f-9b6f4031baf3 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:17.952409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0d5cd4d1-a447-4188-ba2f-9b6f4031baf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:18.121214 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 930/1859] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:18.182931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8544e-9f95-492e-9eb3-cc4d53c52e16 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:18.188269 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-96a8544e-9f95-492e-9eb3-cc4d53c52e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:18.286785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cd4d1-a447-4188-ba2f-9b6f4031baf3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:18.288701 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0d5cd4d1-a447-4188-ba2f-9b6f4031baf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:18.314384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cd4d1-a447-4188-ba2f-9b6f4031baf3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:18.322821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8000de-95d0-4468-95f3-4480a4111d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:18.324214 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8544e-9f95-492e-9eb3-cc4d53c52e16 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:18.326206 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8000de-95d0-4468-95f3-4480a4111d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:18.327151 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8000de-95d0-4468-95f3-4480a4111d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:18.328354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8000de-95d0-4468-95f3-4480a4111d81 admin admin] PATH_INFO: `/v3/projects/7d2ac3abd5844a73ad5975d2b393445a` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:18.330634 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8000de-95d0-4468-95f3-4480a4111d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2ac3abd5844a73ad5975d2b393445a)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:18.336397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8000de-95d0-4468-95f3-4480a4111d81 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:18.337967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5074a-c965-42f5-b4f1-18dedd1eac6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:18.338874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5074a-c965-42f5-b4f1-18dedd1eac6b service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:18.339482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5074a-c965-42f5-b4f1-18dedd1eac6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:18.340081 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5074a-c965-42f5-b4f1-18dedd1eac6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:18.358589 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5074a-c965-42f5-b4f1-18dedd1eac6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:18.368032 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5074a-c965-42f5-b4f1-18dedd1eac6b service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:18.394844 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 930/1860] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:24:18.455558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fd8000de-95d0-4468-95f3-4480a4111d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2ac3abd5844a73ad5975d2b393445a', 'request_id': 'req-fd8000de-95d0-4468-95f3-4480a4111d81'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:18.457892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:18.467166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fd8000de-95d0-4468-95f3-4480a4111d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2ac3abd5844a73ad5975d2b393445a', 'request_id': 'req-fd8000de-95d0-4468-95f3-4480a4111d81'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:18.478142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fd8000de-95d0-4468-95f3-4480a4111d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2ac3abd5844a73ad5975d2b393445a', 'request_id': 'req-fd8000de-95d0-4468-95f3-4480a4111d81'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:18.508639 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fd8000de-95d0-4468-95f3-4480a4111d81 admin admin] The token cache is being invalidate because project 7d2ac3abd5844a73ad5975d2b393445a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:18.509023 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fd8000de-95d0-4468-95f3-4480a4111d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:18.512709 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fd8000de-95d0-4468-95f3-4480a4111d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:18.521003 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 931/1861] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:18 2022] DELETE /identity/v3/projects/7d2ac3abd5844a73ad5975d2b393445a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:18.523336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226cf97-cb95-4e11-84e2-d6ca0ed6ceb2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:18.523733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226cf97-cb95-4e11-84e2-d6ca0ed6ceb2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:18.524114 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226cf97-cb95-4e11-84e2-d6ca0ed6ceb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:18.553014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a226cf97-cb95-4e11-84e2-d6ca0ed6ceb2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:18.554497 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a226cf97-cb95-4e11-84e2-d6ca0ed6ceb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:18.652856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 931/1862] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:24:18.662293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f8fd7-42e7-4032-b37a-b17a76765c96 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:18.663098 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f8fd7-42e7-4032-b37a-b17a76765c96 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:18.663388 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f8fd7-42e7-4032-b37a-b17a76765c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:18.688822 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-018f8fd7-42e7-4032-b37a-b17a76765c96 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:18.690246 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-018f8fd7-42e7-4032-b37a-b17a76765c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:18.704646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 932/1863] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:18.705017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226cf97-cb95-4e11-84e2-d6ca0ed6ceb2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:18.722382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226cf97-cb95-4e11-84e2-d6ca0ed6ceb2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:18.735321 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503e354-945a-4d62-8e74-e46d86945fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:18.736134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503e354-945a-4d62-8e74-e46d86945fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:18.736413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503e354-945a-4d62-8e74-e46d86945fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:18.736685 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503e354-945a-4d62-8e74-e46d86945fe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:18.737338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503e354-945a-4d62-8e74-e46d86945fe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:18.737635 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503e354-945a-4d62-8e74-e46d86945fe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:18.740260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503e354-945a-4d62-8e74-e46d86945fe0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:18.753382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 932/1864] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:24:18.759304 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f8fd7-42e7-4032-b37a-b17a76765c96 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:18.775825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f8fd7-42e7-4032-b37a-b17a76765c96 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:18.794459 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6487c-9c6a-4ee2-894a-dc27f52edb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:18.795408 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6487c-9c6a-4ee2-894a-dc27f52edb75 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:18.795408 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6487c-9c6a-4ee2-894a-dc27f52edb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:18.795665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6487c-9c6a-4ee2-894a-dc27f52edb75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:18.796607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6487c-9c6a-4ee2-894a-dc27f52edb75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:18.798742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6487c-9c6a-4ee2-894a-dc27f52edb75 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:18.839193 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 933/1865] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:18 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:18.840470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503e354-945a-4d62-8e74-e46d86945fe0 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:18.858708 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503e354-945a-4d62-8e74-e46d86945fe0 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:18.872635 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:18.884188 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6487c-9c6a-4ee2-894a-dc27f52edb75 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:18.886033 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4ee6487c-9c6a-4ee2-894a-dc27f52edb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:18.970504 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dc9dc-45b2-4300-8f4a-c401d1f5775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:18.971330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc9dc-45b2-4300-8f4a-c401d1f5775c admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:18.972599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc9dc-45b2-4300-8f4a-c401d1f5775c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:18.973085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc9dc-45b2-4300-8f4a-c401d1f5775c admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:18.973848 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dc9dc-45b2-4300-8f4a-c401d1f5775c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:18.976214 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dc9dc-45b2-4300-8f4a-c401d1f5775c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:18.996519 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6487c-9c6a-4ee2-894a-dc27f52edb75 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:19.002009 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca467fc-04f3-459e-8d7d-45378082e6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:19.002934 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca467fc-04f3-459e-8d7d-45378082e6b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:19.003415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca467fc-04f3-459e-8d7d-45378082e6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:19.003701 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca467fc-04f3-459e-8d7d-45378082e6b1 admin admin] PATH_INFO: `/v3/projects/0211bfcec4e04cb0895319cf382267d0` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:19.005051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca467fc-04f3-459e-8d7d-45378082e6b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0211bfcec4e04cb0895319cf382267d0)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:19.007096 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca467fc-04f3-459e-8d7d-45378082e6b1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:19.014517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 933/1866] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:18 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:19.018464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dc9dc-45b2-4300-8f4a-c401d1f5775c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:19.036429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dc9dc-45b2-4300-8f4a-c401d1f5775c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:19.043433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab1c1e-7a3f-4ba5-a8e8-2b7cdd503b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:19.044138 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab1c1e-7a3f-4ba5-a8e8-2b7cdd503b5e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:19.044490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab1c1e-7a3f-4ba5-a8e8-2b7cdd503b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:19.044995 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab1c1e-7a3f-4ba5-a8e8-2b7cdd503b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:19.045872 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab1c1e-7a3f-4ba5-a8e8-2b7cdd503b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:19.048779 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab1c1e-7a3f-4ba5-a8e8-2b7cdd503b5e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:19.075333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 934/1867] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:19.076366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab1c1e-7a3f-4ba5-a8e8-2b7cdd503b5e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:19.087264 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5ca467fc-04f3-459e-8d7d-45378082e6b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0211bfcec4e04cb0895319cf382267d0', 'request_id': 'req-5ca467fc-04f3-459e-8d7d-45378082e6b1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:19.087628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab1c1e-7a3f-4ba5-a8e8-2b7cdd503b5e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:19.093717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5ca467fc-04f3-459e-8d7d-45378082e6b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0211bfcec4e04cb0895319cf382267d0', 'request_id': 'req-5ca467fc-04f3-459e-8d7d-45378082e6b1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:19.101673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5ca467fc-04f3-459e-8d7d-45378082e6b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0211bfcec4e04cb0895319cf382267d0', 'request_id': 'req-5ca467fc-04f3-459e-8d7d-45378082e6b1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:19.118170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5ca467fc-04f3-459e-8d7d-45378082e6b1 admin admin] The token cache is being invalidate because project 0211bfcec4e04cb0895319cf382267d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:19.118520 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5ca467fc-04f3-459e-8d7d-45378082e6b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:19.119438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5ca467fc-04f3-459e-8d7d-45378082e6b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:19.121743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 934/1868] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:18 2022] DELETE /identity/v3/projects/0211bfcec4e04cb0895319cf382267d0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:19.125293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca467fc-04f3-459e-8d7d-45378082e6b1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:19.127170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5ca467fc-04f3-459e-8d7d-45378082e6b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:19.156051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca011ee5-3df8-4628-8f32-9d1b3f58cf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:19.156818 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca011ee5-3df8-4628-8f32-9d1b3f58cf91 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:19.157178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca011ee5-3df8-4628-8f32-9d1b3f58cf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:19.157527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca011ee5-3df8-4628-8f32-9d1b3f58cf91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:19.158293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca011ee5-3df8-4628-8f32-9d1b3f58cf91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:19.160965 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca011ee5-3df8-4628-8f32-9d1b3f58cf91 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:19.174021 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 935/1869] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:19.178778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca011ee5-3df8-4628-8f32-9d1b3f58cf91 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:19.181074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ca011ee5-3df8-4628-8f32-9d1b3f58cf91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:19.181514 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:19.195465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca011ee5-3df8-4628-8f32-9d1b3f58cf91 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:19.200077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08273041-c6cb-410f-8f61-925367d6aea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:19.200851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08273041-c6cb-410f-8f61-925367d6aea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:19.201148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08273041-c6cb-410f-8f61-925367d6aea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:19.201418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08273041-c6cb-410f-8f61-925367d6aea6 admin admin] PATH_INFO: `/v3/projects/ece92df2c6894ba093b482933a6fee51/users/a97c324c65784adc92267fd05a59639f/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:19.215138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca467fc-04f3-459e-8d7d-45378082e6b1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:19.220291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf78717-6748-4128-bcb2-a21e380311cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:19.220933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78717-6748-4128-bcb2-a21e380311cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:19.221033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08273041-c6cb-410f-8f61-925367d6aea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece92df2c6894ba093b482933a6fee51, user_id=a97c324c65784adc92267fd05a59639f, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:19.221210 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78717-6748-4128-bcb2-a21e380311cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:19.221486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78717-6748-4128-bcb2-a21e380311cc admin admin] PATH_INFO: `/v3/users/0767b9930b91440a9aac27a69f9c6620` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:19.222945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf78717-6748-4128-bcb2-a21e380311cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0767b9930b91440a9aac27a69f9c6620)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:19.224142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08273041-c6cb-410f-8f61-925367d6aea6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:19.224847 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf78717-6748-4128-bcb2-a21e380311cc admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:19.239492 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 936/1870] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:19 2022] PUT /identity/v3/projects/ece92df2c6894ba093b482933a6fee51/users/a97c324c65784adc92267fd05a59639f/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:19.250264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62c4d8-d8aa-4562-9891-ceb184cf3c5a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:19.250550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62c4d8-d8aa-4562-9891-ceb184cf3c5a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:19.250824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62c4d8-d8aa-4562-9891-ceb184cf3c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:19.282727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-3e62c4d8-d8aa-4562-9891-ceb184cf3c5a None None] MFA Rules not processed for user `a97c324c65784adc92267fd05a59639f`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:19.284262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3e62c4d8-d8aa-4562-9891-ceb184cf3c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:19.303121 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fdf78717-6748-4128-bcb2-a21e380311cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0767b9930b91440a9aac27a69f9c6620'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:19.312488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fdf78717-6748-4128-bcb2-a21e380311cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0767b9930b91440a9aac27a69f9c6620'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:19.329623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fdf78717-6748-4128-bcb2-a21e380311cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0767b9930b91440a9aac27a69f9c6620'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:19.338261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fdf78717-6748-4128-bcb2-a21e380311cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0767b9930b91440a9aac27a69f9c6620'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:19.339351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fdf78717-6748-4128-bcb2-a21e380311cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0767b9930b91440a9aac27a69f9c6620'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:19.350416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 935/1871] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:19 2022] DELETE /identity/v3/users/0767b9930b91440a9aac27a69f9c6620 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:19.356784 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:19.375545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 937/1872] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:24:19.377225 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf78717-6748-4128-bcb2-a21e380311cc admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:19.378950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fdf78717-6748-4128-bcb2-a21e380311cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:19.500940 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf78717-6748-4128-bcb2-a21e380311cc admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:19.507977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b75af-7b16-461c-b129-31050757628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:19.508618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b75af-7b16-461c-b129-31050757628b admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:19.509029 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b75af-7b16-461c-b129-31050757628b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:19.509364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b75af-7b16-461c-b129-31050757628b admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:19.509977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b75af-7b16-461c-b129-31050757628b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:19.512079 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b75af-7b16-461c-b129-31050757628b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:19.582552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 936/1873] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:19 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:19.582732 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62c4d8-d8aa-4562-9891-ceb184cf3c5a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:19.688510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62c4d8-d8aa-4562-9891-ceb184cf3c5a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:19.813992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0297c-2cce-424f-8ef9-097c669605c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:19.815640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0297c-2cce-424f-8ef9-097c669605c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:19.819387 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0297c-2cce-424f-8ef9-097c669605c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:19.819913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0297c-2cce-424f-8ef9-097c669605c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:19.822992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0297c-2cce-424f-8ef9-097c669605c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:19.824823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0297c-2cce-424f-8ef9-097c669605c7 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:19.849659 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b75af-7b16-461c-b129-31050757628b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:19.852824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b96b75af-7b16-461c-b129-31050757628b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:19.865238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 938/1874] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:19 2022] POST /identity/v3/users => generated 300 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:24:19.866823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0297c-2cce-424f-8ef9-097c669605c7 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:19.881769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0297c-2cce-424f-8ef9-097c669605c7 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:19.891327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2d59d-0225-4ea8-b67f-8b367155bf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:19.892640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d59d-0225-4ea8-b67f-8b367155bf09 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:19.892973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d59d-0225-4ea8-b67f-8b367155bf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:19.893419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d59d-0225-4ea8-b67f-8b367155bf09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:19.897360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2d59d-0225-4ea8-b67f-8b367155bf09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:19.900189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2d59d-0225-4ea8-b67f-8b367155bf09 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:19.909760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b75af-7b16-461c-b129-31050757628b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:19.923764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 939/1875] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:19.928209 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2d59d-0225-4ea8-b67f-8b367155bf09 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:19.931206 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c5718-63b9-41d6-a87d-cf6887b007cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:19.932101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c5718-63b9-41d6-a87d-cf6887b007cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:19.932483 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c5718-63b9-41d6-a87d-cf6887b007cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:19.932651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c5718-63b9-41d6-a87d-cf6887b007cd admin admin] PATH_INFO: `/v3/projects/018cc994a81c408fb937af2aa2c324c5` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:19.938277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c5718-63b9-41d6-a87d-cf6887b007cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=018cc994a81c408fb937af2aa2c324c5)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:19.940334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c5718-63b9-41d6-a87d-cf6887b007cd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:19.944290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2d59d-0225-4ea8-b67f-8b367155bf09 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:19.950350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166d823-8630-4598-a7cf-0adf2aef2696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:19.951030 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166d823-8630-4598-a7cf-0adf2aef2696 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:19.951305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166d823-8630-4598-a7cf-0adf2aef2696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:19.951582 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166d823-8630-4598-a7cf-0adf2aef2696 admin admin] PATH_INFO: `/v3/projects/c26c8b4c5964416abfe43c6195b1ca32/users/fd67f5aeb79b4d4ebedb72d216dc7b51/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:19.970142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166d823-8630-4598-a7cf-0adf2aef2696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26c8b4c5964416abfe43c6195b1ca32, user_id=fd67f5aeb79b4d4ebedb72d216dc7b51, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:19.974475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166d823-8630-4598-a7cf-0adf2aef2696 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:19.993367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 940/1876] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:19 2022] PUT /identity/v3/projects/c26c8b4c5964416abfe43c6195b1ca32/users/fd67f5aeb79b4d4ebedb72d216dc7b51/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:19.995315 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166d823-8630-4598-a7cf-0adf2aef2696 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:20.028372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:20.038664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4a6c5718-63b9-41d6-a87d-cf6887b007cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '018cc994a81c408fb937af2aa2c324c5', 'request_id': 'req-4a6c5718-63b9-41d6-a87d-cf6887b007cd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:20.062751 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4a6c5718-63b9-41d6-a87d-cf6887b007cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '018cc994a81c408fb937af2aa2c324c5', 'request_id': 'req-4a6c5718-63b9-41d6-a87d-cf6887b007cd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:20.082661 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4a6c5718-63b9-41d6-a87d-cf6887b007cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '018cc994a81c408fb937af2aa2c324c5', 'request_id': 'req-4a6c5718-63b9-41d6-a87d-cf6887b007cd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:20.085788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:20.091211 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166d823-8630-4598-a7cf-0adf2aef2696 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:20.107683 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4a6c5718-63b9-41d6-a87d-cf6887b007cd admin admin] The token cache is being invalidate because project 018cc994a81c408fb937af2aa2c324c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:20.107979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4a6c5718-63b9-41d6-a87d-cf6887b007cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:20.110211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4a6c5718-63b9-41d6-a87d-cf6887b007cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:20.119937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 937/1877] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:19 2022] DELETE /identity/v3/projects/018cc994a81c408fb937af2aa2c324c5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:20.121463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d840-9e8a-47ab-a6f5-120ea14a43fe None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:20.121776 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d840-9e8a-47ab-a6f5-120ea14a43fe None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:20.122312 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d840-9e8a-47ab-a6f5-120ea14a43fe None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:20.123465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 938/1878] 10.222.0.57 () {54 vars in 921 bytes} [Tue Sep 27 17:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:24:20.124523 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2884a-df60-49f8-9e90-926bb317e03a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:20.125257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2884a-df60-49f8-9e90-926bb317e03a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:20.125257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2884a-df60-49f8-9e90-926bb317e03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:20.157994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-10d2884a-df60-49f8-9e90-926bb317e03a None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:20.159421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-10d2884a-df60-49f8-9e90-926bb317e03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:20.173014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf0b26-b021-41b6-bfbc-ee80d1e8a5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:20.173636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf0b26-b021-41b6-bfbc-ee80d1e8a5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:20.173949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf0b26-b021-41b6-bfbc-ee80d1e8a5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:20.174225 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf0b26-b021-41b6-bfbc-ee80d1e8a5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:20.174872 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf0b26-b021-41b6-bfbc-ee80d1e8a5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:20.176992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf0b26-b021-41b6-bfbc-ee80d1e8a5f9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:20.197944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 941/1879] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:20.197944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf0b26-b021-41b6-bfbc-ee80d1e8a5f9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:20.197944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-04bf0b26-b021-41b6-bfbc-ee80d1e8a5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:20.209243 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf0b26-b021-41b6-bfbc-ee80d1e8a5f9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:20.216264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085ebc6-2258-4f4d-a7ea-6114daec220b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:20.217123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085ebc6-2258-4f4d-a7ea-6114daec220b admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:20.218212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085ebc6-2258-4f4d-a7ea-6114daec220b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:20.218621 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085ebc6-2258-4f4d-a7ea-6114daec220b admin admin] PATH_INFO: `/v3/projects/c26c8b4c5964416abfe43c6195b1ca32/users/fd67f5aeb79b4d4ebedb72d216dc7b51/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:20.220948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085ebc6-2258-4f4d-a7ea-6114daec220b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26c8b4c5964416abfe43c6195b1ca32, user_id=fd67f5aeb79b4d4ebedb72d216dc7b51, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:20.225224 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085ebc6-2258-4f4d-a7ea-6114daec220b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:20.242770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 942/1880] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:20 2022] PUT /identity/v3/projects/c26c8b4c5964416abfe43c6195b1ca32/users/fd67f5aeb79b4d4ebedb72d216dc7b51/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:20.253195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9d616-138d-428e-832f-f97022f77500 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:20.254554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9d616-138d-428e-832f-f97022f77500 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:20.255113 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9d616-138d-428e-832f-f97022f77500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:20.306707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7ef9d616-138d-428e-832f-f97022f77500 None None] MFA Rules not processed for user `fd67f5aeb79b4d4ebedb72d216dc7b51`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:20.308521 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7ef9d616-138d-428e-832f-f97022f77500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:20.360848 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 939/1881] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:20.374427 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f3c0-a5db-41c2-ac08-e9772599ace9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:20.374722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f3c0-a5db-41c2-ac08-e9772599ace9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:20.375000 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f3c0-a5db-41c2-ac08-e9772599ace9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:20.429911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 943/1882] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:20.430419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f9f3f3c0-a5db-41c2-ac08-e9772599ace9 None None] MFA Rules not processed for user `e75b03fde75e411bace8d406237a7e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:20.430419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f9f3f3c0-a5db-41c2-ac08-e9772599ace9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:20.433907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765e27f-9e3e-4873-81c2-1a3746b8f806 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:20.434306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765e27f-9e3e-4873-81c2-1a3746b8f806 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:20.434642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765e27f-9e3e-4873-81c2-1a3746b8f806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:20.460130 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a765e27f-9e3e-4873-81c2-1a3746b8f806 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:20.461370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a765e27f-9e3e-4873-81c2-1a3746b8f806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:20.586239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 940/1883] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Sep 27 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:20.587186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3f3c0-a5db-41c2-ac08-e9772599ace9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:20.588763 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f9f3f3c0-a5db-41c2-ac08-e9772599ace9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:20.589898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 944/1884] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:20.593785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765e27f-9e3e-4873-81c2-1a3746b8f806 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:20.619111 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765e27f-9e3e-4873-81c2-1a3746b8f806 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:20.624966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39844c-a23e-4f0c-8500-d132e77e3945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:20.625864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39844c-a23e-4f0c-8500-d132e77e3945 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:20.626222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39844c-a23e-4f0c-8500-d132e77e3945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:20.626571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39844c-a23e-4f0c-8500-d132e77e3945 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:20.627295 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39844c-a23e-4f0c-8500-d132e77e3945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:20.628072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39844c-a23e-4f0c-8500-d132e77e3945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:20.631181 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39844c-a23e-4f0c-8500-d132e77e3945 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:20.639256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:20.647559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 945/1885] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:24:20.652492 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39844c-a23e-4f0c-8500-d132e77e3945 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:20.675651 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39844c-a23e-4f0c-8500-d132e77e3945 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:20.679015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3f3c0-a5db-41c2-ac08-e9772599ace9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:20.681158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580c880-b241-4eda-b7c4-02523d30c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:20.681810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580c880-b241-4eda-b7c4-02523d30c13c admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:20.682277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580c880-b241-4eda-b7c4-02523d30c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:20.682533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580c880-b241-4eda-b7c4-02523d30c13c admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:20.683165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580c880-b241-4eda-b7c4-02523d30c13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:20.685169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d023715-cee2-48ad-bcc7-6ba12237ae0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:20.685492 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580c880-b241-4eda-b7c4-02523d30c13c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:20.685827 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d023715-cee2-48ad-bcc7-6ba12237ae0e service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:20.686107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d023715-cee2-48ad-bcc7-6ba12237ae0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:20.686615 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d023715-cee2-48ad-bcc7-6ba12237ae0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:20.700124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d023715-cee2-48ad-bcc7-6ba12237ae0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:20.702219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d023715-cee2-48ad-bcc7-6ba12237ae0e service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:20.714816 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 941/1886] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:20.715596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d023715-cee2-48ad-bcc7-6ba12237ae0e service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:20.717615 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2d023715-cee2-48ad-bcc7-6ba12237ae0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:20.735521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:20.736450 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 946/1887] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:20 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:20.749946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580c880-b241-4eda-b7c4-02523d30c13c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:20.750046 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d023715-cee2-48ad-bcc7-6ba12237ae0e service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:20.848545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de257180-1025-4257-86ed-9dbdb4c3caae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:20.850089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de257180-1025-4257-86ed-9dbdb4c3caae service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:20.850393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de257180-1025-4257-86ed-9dbdb4c3caae service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:20.850670 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de257180-1025-4257-86ed-9dbdb4c3caae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:20.853159 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580c880-b241-4eda-b7c4-02523d30c13c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:20.860128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e7b7c-295b-44a5-851c-2a88a2ecafb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:20.860993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e7b7c-295b-44a5-851c-2a88a2ecafb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:20.861277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e7b7c-295b-44a5-851c-2a88a2ecafb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:20.862091 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e7b7c-295b-44a5-851c-2a88a2ecafb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:20.862222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e7b7c-295b-44a5-851c-2a88a2ecafb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:20.864202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e7b7c-295b-44a5-851c-2a88a2ecafb1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:20.864633 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de257180-1025-4257-86ed-9dbdb4c3caae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:20.866246 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de257180-1025-4257-86ed-9dbdb4c3caae service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:20.880978 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 942/1888] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:20.882151 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de257180-1025-4257-86ed-9dbdb4c3caae service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:20.894272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de257180-1025-4257-86ed-9dbdb4c3caae service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:20.895337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 947/1889] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:20 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:20.901260 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f0ebd-7176-44a8-a869-d02b9e99f130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:20.901260 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f0ebd-7176-44a8-a869-d02b9e99f130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:20.901488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f0ebd-7176-44a8-a869-d02b9e99f130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:20.901787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f0ebd-7176-44a8-a869-d02b9e99f130 admin admin] PATH_INFO: `/v3/users/a97c324c65784adc92267fd05a59639f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:20.903626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f0ebd-7176-44a8-a869-d02b9e99f130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a97c324c65784adc92267fd05a59639f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:20.905828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f0ebd-7176-44a8-a869-d02b9e99f130 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:20.912966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e7b7c-295b-44a5-851c-2a88a2ecafb1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:20.946357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e7b7c-295b-44a5-851c-2a88a2ecafb1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:20.959288 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64c1be-b04f-4b63-9188-c5491fc39fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:20.959911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64c1be-b04f-4b63-9188-c5491fc39fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:20.960188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64c1be-b04f-4b63-9188-c5491fc39fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:20.960454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64c1be-b04f-4b63-9188-c5491fc39fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:20.961193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64c1be-b04f-4b63-9188-c5491fc39fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:20.962715 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64c1be-b04f-4b63-9188-c5491fc39fc9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:20.985793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 948/1890] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:20.989903 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64c1be-b04f-4b63-9188-c5491fc39fc9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:21.002686 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a57f0ebd-7176-44a8-a869-d02b9e99f130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a97c324c65784adc92267fd05a59639f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:21.004756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64c1be-b04f-4b63-9188-c5491fc39fc9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:21.011691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250064ec-6a64-4eed-a528-a5eb8da2d0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:21.012769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250064ec-6a64-4eed-a528-a5eb8da2d0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:21.013329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250064ec-6a64-4eed-a528-a5eb8da2d0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:21.013955 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250064ec-6a64-4eed-a528-a5eb8da2d0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:21.015002 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250064ec-6a64-4eed-a528-a5eb8da2d0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:21.017061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250064ec-6a64-4eed-a528-a5eb8da2d0b0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:21.022803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a57f0ebd-7176-44a8-a869-d02b9e99f130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a97c324c65784adc92267fd05a59639f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:21.043214 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 949/1891] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:21.045561 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250064ec-6a64-4eed-a528-a5eb8da2d0b0 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:21.051722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a57f0ebd-7176-44a8-a869-d02b9e99f130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a97c324c65784adc92267fd05a59639f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:21.066132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250064ec-6a64-4eed-a528-a5eb8da2d0b0 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:21.068354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a57f0ebd-7176-44a8-a869-d02b9e99f130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a97c324c65784adc92267fd05a59639f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:21.069151 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a57f0ebd-7176-44a8-a869-d02b9e99f130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a97c324c65784adc92267fd05a59639f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:21.072873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db21d1c-df56-4f36-b231-3e892881fb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:21.073712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db21d1c-df56-4f36-b231-3e892881fb52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:21.074154 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db21d1c-df56-4f36-b231-3e892881fb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:21.075292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db21d1c-df56-4f36-b231-3e892881fb52 admin admin] PATH_INFO: `/v3/projects/0a30a0296d5043e88382109d7e1ce32f/users/31a94b1155cf44d7a83c6aa4969de2d4/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:21.098781 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 943/1892] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:20 2022] DELETE /identity/v3/users/a97c324c65784adc92267fd05a59639f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:21.103600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a491bd-a442-4a05-b2c0-7f6579bc9711 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:21.103893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a491bd-a442-4a05-b2c0-7f6579bc9711 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:21.104170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a491bd-a442-4a05-b2c0-7f6579bc9711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:21.112795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db21d1c-df56-4f36-b231-3e892881fb52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a30a0296d5043e88382109d7e1ce32f, user_id=31a94b1155cf44d7a83c6aa4969de2d4, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:21.116814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db21d1c-df56-4f36-b231-3e892881fb52 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:21.130727 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f6a491bd-a442-4a05-b2c0-7f6579bc9711 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:21.135496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f6a491bd-a442-4a05-b2c0-7f6579bc9711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:21.141802 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 950/1893] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:21 2022] PUT /identity/v3/projects/0a30a0296d5043e88382109d7e1ce32f/users/31a94b1155cf44d7a83c6aa4969de2d4/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:21.150573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907d82f-47f9-42ff-9ae8-87a529750fc0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:21.150853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907d82f-47f9-42ff-9ae8-87a529750fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:21.151137 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907d82f-47f9-42ff-9ae8-87a529750fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:21.186249 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2907d82f-47f9-42ff-9ae8-87a529750fc0 None None] MFA Rules not processed for user `31a94b1155cf44d7a83c6aa4969de2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:21.187532 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2907d82f-47f9-42ff-9ae8-87a529750fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:21.225237 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:21.245607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 944/1894] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:24:21.252558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a491bd-a442-4a05-b2c0-7f6579bc9711 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:21.258390 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f6a491bd-a442-4a05-b2c0-7f6579bc9711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:21.303977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 951/1895] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:21.316234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907d82f-47f9-42ff-9ae8-87a529750fc0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:21.319650 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2907d82f-47f9-42ff-9ae8-87a529750fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:21.342399 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:21.351625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a491bd-a442-4a05-b2c0-7f6579bc9711 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:21.356924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b5a0b-af53-4409-814c-4f57a302aab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:21.359177 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b5a0b-af53-4409-814c-4f57a302aab3 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:21.359627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b5a0b-af53-4409-814c-4f57a302aab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:21.360072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b5a0b-af53-4409-814c-4f57a302aab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:21.377056 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b5a0b-af53-4409-814c-4f57a302aab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:21.380051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b5a0b-af53-4409-814c-4f57a302aab3 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:21.396348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 945/1896] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:24:21.450783 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907d82f-47f9-42ff-9ae8-87a529750fc0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:21.460142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3bfba-8e30-44ab-9703-e55c8266a69e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:21.460988 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3bfba-8e30-44ab-9703-e55c8266a69e service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:21.461210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3bfba-8e30-44ab-9703-e55c8266a69e service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:21.461630 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3bfba-8e30-44ab-9703-e55c8266a69e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:21.475081 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3bfba-8e30-44ab-9703-e55c8266a69e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:21.476962 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3bfba-8e30-44ab-9703-e55c8266a69e service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:21.489928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 952/1897] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:21.983000 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b5a0b-af53-4409-814c-4f57a302aab3 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:21.985501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1c2b5a0b-af53-4409-814c-4f57a302aab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:22.026220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b5a0b-af53-4409-814c-4f57a302aab3 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:22.049837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184d196-58b8-4156-aef1-a955ce2326ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:22.050496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184d196-58b8-4156-aef1-a955ce2326ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:22.050807 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184d196-58b8-4156-aef1-a955ce2326ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:22.051084 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184d196-58b8-4156-aef1-a955ce2326ea admin admin] PATH_INFO: `/v3/projects/ece92df2c6894ba093b482933a6fee51` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:22.069316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184d196-58b8-4156-aef1-a955ce2326ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece92df2c6894ba093b482933a6fee51)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:22.071528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184d196-58b8-4156-aef1-a955ce2326ea admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:22.189660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7184d196-58b8-4156-aef1-a955ce2326ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece92df2c6894ba093b482933a6fee51', 'request_id': 'req-7184d196-58b8-4156-aef1-a955ce2326ea'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:22.201913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7184d196-58b8-4156-aef1-a955ce2326ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece92df2c6894ba093b482933a6fee51', 'request_id': 'req-7184d196-58b8-4156-aef1-a955ce2326ea'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:22.210547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7184d196-58b8-4156-aef1-a955ce2326ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece92df2c6894ba093b482933a6fee51', 'request_id': 'req-7184d196-58b8-4156-aef1-a955ce2326ea'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:22.234880 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7184d196-58b8-4156-aef1-a955ce2326ea admin admin] The token cache is being invalidate because project ece92df2c6894ba093b482933a6fee51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:22.236525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7184d196-58b8-4156-aef1-a955ce2326ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:22.237488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7184d196-58b8-4156-aef1-a955ce2326ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:22.240269 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 946/1898] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:21 2022] DELETE /identity/v3/projects/ece92df2c6894ba093b482933a6fee51 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:22.244765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3bfba-8e30-44ab-9703-e55c8266a69e service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:22.258623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3bfba-8e30-44ab-9703-e55c8266a69e service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:22.362311 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a594b7-50c6-4ca3-9b8d-52c78545d88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:22.363397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a594b7-50c6-4ca3-9b8d-52c78545d88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:22.364028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a594b7-50c6-4ca3-9b8d-52c78545d88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:22.364466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a594b7-50c6-4ca3-9b8d-52c78545d88c admin admin] PATH_INFO: `/v3/users/fd67f5aeb79b4d4ebedb72d216dc7b51` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:22.367476 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a594b7-50c6-4ca3-9b8d-52c78545d88c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd67f5aeb79b4d4ebedb72d216dc7b51)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:22.371003 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a594b7-50c6-4ca3-9b8d-52c78545d88c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:22.438005 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d8a594b7-50c6-4ca3-9b8d-52c78545d88c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd67f5aeb79b4d4ebedb72d216dc7b51'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:22.439442 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d8a594b7-50c6-4ca3-9b8d-52c78545d88c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd67f5aeb79b4d4ebedb72d216dc7b51'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:22.450525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d8a594b7-50c6-4ca3-9b8d-52c78545d88c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd67f5aeb79b4d4ebedb72d216dc7b51'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:22.466711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d8a594b7-50c6-4ca3-9b8d-52c78545d88c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd67f5aeb79b4d4ebedb72d216dc7b51'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:22.477739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d8a594b7-50c6-4ca3-9b8d-52c78545d88c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd67f5aeb79b4d4ebedb72d216dc7b51'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:22.484825 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 953/1899] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:22 2022] DELETE /identity/v3/users/fd67f5aeb79b4d4ebedb72d216dc7b51 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:23.054435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184d196-58b8-4156-aef1-a955ce2326ea admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:23.056910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7184d196-58b8-4156-aef1-a955ce2326ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:23.085510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184d196-58b8-4156-aef1-a955ce2326ea admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:23.189293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bbfae-0bc2-4035-8f75-95cc566b13da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:23.190240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bbfae-0bc2-4035-8f75-95cc566b13da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:23.190826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bbfae-0bc2-4035-8f75-95cc566b13da admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:23.191007 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bbfae-0bc2-4035-8f75-95cc566b13da admin admin] PATH_INFO: `/v3/projects/c26c8b4c5964416abfe43c6195b1ca32` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:23.194213 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bbfae-0bc2-4035-8f75-95cc566b13da admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26c8b4c5964416abfe43c6195b1ca32)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:23.196474 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bbfae-0bc2-4035-8f75-95cc566b13da admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:23.258493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:23.299257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4b8bbfae-0bc2-4035-8f75-95cc566b13da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26c8b4c5964416abfe43c6195b1ca32', 'request_id': 'req-4b8bbfae-0bc2-4035-8f75-95cc566b13da'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:23.315608 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4b8bbfae-0bc2-4035-8f75-95cc566b13da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26c8b4c5964416abfe43c6195b1ca32', 'request_id': 'req-4b8bbfae-0bc2-4035-8f75-95cc566b13da'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:23.325126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4b8bbfae-0bc2-4035-8f75-95cc566b13da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26c8b4c5964416abfe43c6195b1ca32', 'request_id': 'req-4b8bbfae-0bc2-4035-8f75-95cc566b13da'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:23.385381 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4b8bbfae-0bc2-4035-8f75-95cc566b13da admin admin] The token cache is being invalidate because project c26c8b4c5964416abfe43c6195b1ca32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:23.385783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4b8bbfae-0bc2-4035-8f75-95cc566b13da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:23.386820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4b8bbfae-0bc2-4035-8f75-95cc566b13da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:23.390426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 947/1900] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:23 2022] DELETE /identity/v3/projects/c26c8b4c5964416abfe43c6195b1ca32 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:23.395628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eb35f-741d-4933-b801-125e6ac0fee6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:23.395918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eb35f-741d-4933-b801-125e6ac0fee6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:23.396191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eb35f-741d-4933-b801-125e6ac0fee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:23.434935 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e45eb35f-741d-4933-b801-125e6ac0fee6 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:23.436470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e45eb35f-741d-4933-b801-125e6ac0fee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:23.475831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:23.540798 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 954/1901] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:23.548630 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dc91c-2119-406a-9bd7-f36376a796a9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:23.548988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dc91c-2119-406a-9bd7-f36376a796a9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:23.549086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dc91c-2119-406a-9bd7-f36376a796a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:23.584770 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3a7dc91c-2119-406a-9bd7-f36376a796a9 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:23.586014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3a7dc91c-2119-406a-9bd7-f36376a796a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:23.604689 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 948/1902] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:23.606653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eb35f-741d-4933-b801-125e6ac0fee6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:23.625238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eb35f-741d-4933-b801-125e6ac0fee6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:23.632662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bbcd9-5c89-4185-bb85-74cc0cad7a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:23.633539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bbcd9-5c89-4185-bb85-74cc0cad7a54 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:23.634039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bbcd9-5c89-4185-bb85-74cc0cad7a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:23.634490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bbcd9-5c89-4185-bb85-74cc0cad7a54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:23.635324 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bbcd9-5c89-4185-bb85-74cc0cad7a54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:23.635900 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bbcd9-5c89-4185-bb85-74cc0cad7a54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:23.637762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bbcd9-5c89-4185-bb85-74cc0cad7a54 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:23.660385 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 955/1903] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:24:23.663981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dc91c-2119-406a-9bd7-f36376a796a9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:23.677190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dc91c-2119-406a-9bd7-f36376a796a9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:23.694050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2a981-5565-4e03-b6b0-41fcb646e60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:23.694746 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2a981-5565-4e03-b6b0-41fcb646e60e admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:23.695022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2a981-5565-4e03-b6b0-41fcb646e60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:23.695292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2a981-5565-4e03-b6b0-41fcb646e60e admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:23.695923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2a981-5565-4e03-b6b0-41fcb646e60e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:23.699435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2a981-5565-4e03-b6b0-41fcb646e60e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:23.767587 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 949/1904] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:23 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:23.773336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bbcd9-5c89-4185-bb85-74cc0cad7a54 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:23.790973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bbcd9-5c89-4185-bb85-74cc0cad7a54 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:23.875671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067ebda-3e6c-4373-85ac-b24f99ea479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:23.876679 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067ebda-3e6c-4373-85ac-b24f99ea479f admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:23.876679 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067ebda-3e6c-4373-85ac-b24f99ea479f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:23.876881 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067ebda-3e6c-4373-85ac-b24f99ea479f admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:23.877460 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067ebda-3e6c-4373-85ac-b24f99ea479f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:23.879446 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067ebda-3e6c-4373-85ac-b24f99ea479f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:23.908975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 956/1905] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:23 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:23.910863 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2a981-5565-4e03-b6b0-41fcb646e60e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:23.924282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2a981-5565-4e03-b6b0-41fcb646e60e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:23.929542 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abb0d6-1233-43de-b963-5489d07a0ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:23.930202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abb0d6-1233-43de-b963-5489d07a0ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:23.930505 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abb0d6-1233-43de-b963-5489d07a0ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:23.930756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abb0d6-1233-43de-b963-5489d07a0ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:23.931404 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abb0d6-1233-43de-b963-5489d07a0ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:23.933007 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abb0d6-1233-43de-b963-5489d07a0ea4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:23.945029 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 950/1906] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:23.948983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067ebda-3e6c-4373-85ac-b24f99ea479f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:23.960165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067ebda-3e6c-4373-85ac-b24f99ea479f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:23.965119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c958cf5-6aa8-4d99-b486-ecdb01b48f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:23.965753 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c958cf5-6aa8-4d99-b486-ecdb01b48f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:23.966038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c958cf5-6aa8-4d99-b486-ecdb01b48f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:23.966313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c958cf5-6aa8-4d99-b486-ecdb01b48f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:23.967009 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c958cf5-6aa8-4d99-b486-ecdb01b48f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:23.968594 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c958cf5-6aa8-4d99-b486-ecdb01b48f96 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:23.981244 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 957/1907] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:23.985749 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abb0d6-1233-43de-b963-5489d07a0ea4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:23.997597 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abb0d6-1233-43de-b963-5489d07a0ea4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:24.002506 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0af8bd-b9f3-4bab-a94c-dbe96f861be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:24.006673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0af8bd-b9f3-4bab-a94c-dbe96f861be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:24.006957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0af8bd-b9f3-4bab-a94c-dbe96f861be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:24.007333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0af8bd-b9f3-4bab-a94c-dbe96f861be3 admin admin] PATH_INFO: `/v3/projects/e7f1e4fb1d8c4c55b4657808ef621301/users/3ce8aef178d646fa87fbd31c9ed0920c/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:24.024320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0af8bd-b9f3-4bab-a94c-dbe96f861be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f1e4fb1d8c4c55b4657808ef621301, user_id=3ce8aef178d646fa87fbd31c9ed0920c, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:24.027875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0af8bd-b9f3-4bab-a94c-dbe96f861be3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:24.056391 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 951/1908] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:23 2022] PUT /identity/v3/projects/e7f1e4fb1d8c4c55b4657808ef621301/users/3ce8aef178d646fa87fbd31c9ed0920c/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:24.067840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a31b4-5b6d-4d36-a90d-dc5f405ad6dd None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:24.068107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a31b4-5b6d-4d36-a90d-dc5f405ad6dd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:24.068403 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a31b4-5b6d-4d36-a90d-dc5f405ad6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:24.100316 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-1f6a31b4-5b6d-4d36-a90d-dc5f405ad6dd None None] MFA Rules not processed for user `3ce8aef178d646fa87fbd31c9ed0920c`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:24.101548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1f6a31b4-5b6d-4d36-a90d-dc5f405ad6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:24.177065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 958/1909] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:24:24.181754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0af8bd-b9f3-4bab-a94c-dbe96f861be3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:24.246466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0af8bd-b9f3-4bab-a94c-dbe96f861be3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:24.251071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4820370-783a-437e-a07f-5c723fb9d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:24.251673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4820370-783a-437e-a07f-5c723fb9d0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:24.251953 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4820370-783a-437e-a07f-5c723fb9d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:24.252226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4820370-783a-437e-a07f-5c723fb9d0a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:24.252863 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4820370-783a-437e-a07f-5c723fb9d0a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:24.255000 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4820370-783a-437e-a07f-5c723fb9d0a1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:24.287423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 952/1910] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:24 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:24.288859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a31b4-5b6d-4d36-a90d-dc5f405ad6dd None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:24.299796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a31b4-5b6d-4d36-a90d-dc5f405ad6dd None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:24.325668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:24.372928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013c07a-5441-4850-894f-7870bab15254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:24.373554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013c07a-5441-4850-894f-7870bab15254 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:24.374319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013c07a-5441-4850-894f-7870bab15254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:24.374319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013c07a-5441-4850-894f-7870bab15254 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:24.374827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013c07a-5441-4850-894f-7870bab15254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:24.376801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013c07a-5441-4850-894f-7870bab15254 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:24.407102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 959/1911] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:24 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:24.411623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4820370-783a-437e-a07f-5c723fb9d0a1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:24.428467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4820370-783a-437e-a07f-5c723fb9d0a1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:24.440063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5bac0-173c-4046-89f1-efb66362c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:24.440718 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5bac0-173c-4046-89f1-efb66362c06b admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:24.441000 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5bac0-173c-4046-89f1-efb66362c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:24.443883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5bac0-173c-4046-89f1-efb66362c06b admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:24.444549 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5bac0-173c-4046-89f1-efb66362c06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:24.446676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5bac0-173c-4046-89f1-efb66362c06b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:24.478647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 953/1912] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:24.480051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013c07a-5441-4850-894f-7870bab15254 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:24.491349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013c07a-5441-4850-894f-7870bab15254 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:24.496509 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e550e-4508-4440-9215-229321be9c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:24.497183 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e550e-4508-4440-9215-229321be9c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:24.497463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e550e-4508-4440-9215-229321be9c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:24.497878 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e550e-4508-4440-9215-229321be9c69 admin admin] PATH_INFO: `/v3/projects/72da0d059daa4201b14fa81f48161f0c/users/0c907f40c6ab4a2d8a88390c41660608/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:24.523925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e550e-4508-4440-9215-229321be9c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72da0d059daa4201b14fa81f48161f0c, user_id=0c907f40c6ab4a2d8a88390c41660608, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:24.527826 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e550e-4508-4440-9215-229321be9c69 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:24.560787 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 960/1913] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:24 2022] PUT /identity/v3/projects/72da0d059daa4201b14fa81f48161f0c/users/0c907f40c6ab4a2d8a88390c41660608/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:24.565008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5bac0-173c-4046-89f1-efb66362c06b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:24.584993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5bac0-173c-4046-89f1-efb66362c06b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:24.620790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:24.688302 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f073b3-4b16-46e9-8358-a31c922a738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:24.688830 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f073b3-4b16-46e9-8358-a31c922a738a admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:24.689218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f073b3-4b16-46e9-8358-a31c922a738a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:24.689556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f073b3-4b16-46e9-8358-a31c922a738a admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:24.690334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f073b3-4b16-46e9-8358-a31c922a738a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:24.693075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f073b3-4b16-46e9-8358-a31c922a738a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:24.706586 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 954/1914] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:24.711686 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e550e-4508-4440-9215-229321be9c69 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:24.723181 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e550e-4508-4440-9215-229321be9c69 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:24.728890 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87f44f-0947-4a73-8742-207bd4c83ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:24.730183 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87f44f-0947-4a73-8742-207bd4c83ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:24.730365 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87f44f-0947-4a73-8742-207bd4c83ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:24.730859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87f44f-0947-4a73-8742-207bd4c83ce8 admin admin] PATH_INFO: `/v3/projects/72da0d059daa4201b14fa81f48161f0c/users/0c907f40c6ab4a2d8a88390c41660608/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:24.734579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87f44f-0947-4a73-8742-207bd4c83ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72da0d059daa4201b14fa81f48161f0c, user_id=0c907f40c6ab4a2d8a88390c41660608, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:24.738810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87f44f-0947-4a73-8742-207bd4c83ce8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:24.754827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 961/1915] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:24 2022] PUT /identity/v3/projects/72da0d059daa4201b14fa81f48161f0c/users/0c907f40c6ab4a2d8a88390c41660608/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:24.768604 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f4768-ccc4-4f2d-9ab1-ac621130fe9c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:24.768898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f4768-ccc4-4f2d-9ab1-ac621130fe9c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:24.769220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f4768-ccc4-4f2d-9ab1-ac621130fe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:24.809930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7f7f4768-ccc4-4f2d-9ab1-ac621130fe9c None None] MFA Rules not processed for user `0c907f40c6ab4a2d8a88390c41660608`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:24.811321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7f7f4768-ccc4-4f2d-9ab1-ac621130fe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:24.913262 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 955/1916] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:24:24.979390 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87f44f-0947-4a73-8742-207bd4c83ce8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:24.983901 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fe87f44f-0947-4a73-8742-207bd4c83ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:25.096506 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87f44f-0947-4a73-8742-207bd4c83ce8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:25.119501 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1858c-fbd0-4d77-82b7-3a000f400ccc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:25.120588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1858c-fbd0-4d77-82b7-3a000f400ccc service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:25.121905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1858c-fbd0-4d77-82b7-3a000f400ccc service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:25.123124 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1858c-fbd0-4d77-82b7-3a000f400ccc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:25.141430 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1858c-fbd0-4d77-82b7-3a000f400ccc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:25.142845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1858c-fbd0-4d77-82b7-3a000f400ccc service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:25.154052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 962/1917] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:25.601343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f4768-ccc4-4f2d-9ab1-ac621130fe9c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:25.611911 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f4768-ccc4-4f2d-9ab1-ac621130fe9c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:25.616848 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a33f1f-afbe-412d-a05d-46ab8bc531b6 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c907f40c6ab4a2d8a88390c41660608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72da0d059daa4201b14fa81f48161f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:25.617457 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a33f1f-afbe-412d-a05d-46ab8bc531b6 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:25.617771 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a33f1f-afbe-412d-a05d-46ab8bc531b6 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:25.618051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a33f1f-afbe-412d-a05d-46ab8bc531b6 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:25.618697 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a33f1f-afbe-412d-a05d-46ab8bc531b6 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:25.619002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a33f1f-afbe-412d-a05d-46ab8bc531b6 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:25.620602 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a33f1f-afbe-412d-a05d-46ab8bc531b6 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:25.636819 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 956/1918] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:24:25.641628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1858c-fbd0-4d77-82b7-3a000f400ccc service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:25.651512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1858c-fbd0-4d77-82b7-3a000f400ccc service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:25.656098 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0cef7-6647-4f92-8037-e21162b2931c tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c907f40c6ab4a2d8a88390c41660608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72da0d059daa4201b14fa81f48161f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:25.656772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0cef7-6647-4f92-8037-e21162b2931c tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:25.657059 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0cef7-6647-4f92-8037-e21162b2931c tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:25.657331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0cef7-6647-4f92-8037-e21162b2931c tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:25.658002 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0cef7-6647-4f92-8037-e21162b2931c tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:25.659983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0cef7-6647-4f92-8037-e21162b2931c tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:25.698851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 963/1919] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:25 2022] POST /identity/v3/projects => generated 354 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:25.709925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a33f1f-afbe-412d-a05d-46ab8bc531b6 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:25.721365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a33f1f-afbe-412d-a05d-46ab8bc531b6 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:25.790472 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a58fd-291a-444e-8faa-9e9d978734be tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c907f40c6ab4a2d8a88390c41660608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72da0d059daa4201b14fa81f48161f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:25.791133 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a58fd-291a-444e-8faa-9e9d978734be tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:25.791439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a58fd-291a-444e-8faa-9e9d978734be tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:25.791821 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a58fd-291a-444e-8faa-9e9d978734be tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:25.792521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a58fd-291a-444e-8faa-9e9d978734be tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:25.792824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a58fd-291a-444e-8faa-9e9d978734be tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:25.794769 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a58fd-291a-444e-8faa-9e9d978734be tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:25.809738 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 957/1920] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:24:25.865254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0cef7-6647-4f92-8037-e21162b2931c tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:25.887759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0cef7-6647-4f92-8037-e21162b2931c tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:25.894099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a16b11-8473-4dbd-86e0-418b35566947 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c907f40c6ab4a2d8a88390c41660608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72da0d059daa4201b14fa81f48161f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:25.895632 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a16b11-8473-4dbd-86e0-418b35566947 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:25.896174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a16b11-8473-4dbd-86e0-418b35566947 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:25.897062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a16b11-8473-4dbd-86e0-418b35566947 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] PATH_INFO: `/v3/projects/9d695528f7e94dcc9b95181eac0e22c5` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:25.899053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a16b11-8473-4dbd-86e0-418b35566947 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9d695528f7e94dcc9b95181eac0e22c5)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:25.901214 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a16b11-8473-4dbd-86e0-418b35566947 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:25.970770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d7a16b11-8473-4dbd-86e0-418b35566947 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d695528f7e94dcc9b95181eac0e22c5', 'request_id': 'req-d7a16b11-8473-4dbd-86e0-418b35566947'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:25.976619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:25.978728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d7a16b11-8473-4dbd-86e0-418b35566947 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d695528f7e94dcc9b95181eac0e22c5', 'request_id': 'req-d7a16b11-8473-4dbd-86e0-418b35566947'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:25.986297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d7a16b11-8473-4dbd-86e0-418b35566947 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d695528f7e94dcc9b95181eac0e22c5', 'request_id': 'req-d7a16b11-8473-4dbd-86e0-418b35566947'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:26.001452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d7a16b11-8473-4dbd-86e0-418b35566947 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] The token cache is being invalidate because project 9d695528f7e94dcc9b95181eac0e22c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:26.001783 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d7a16b11-8473-4dbd-86e0-418b35566947 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:26.002435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d7a16b11-8473-4dbd-86e0-418b35566947 tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:26.004026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 964/1921] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:25 2022] DELETE /identity/v3/projects/9d695528f7e94dcc9b95181eac0e22c5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:26.224852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a58fd-291a-444e-8faa-9e9d978734be tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:26.226816 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0a3a58fd-291a-444e-8faa-9e9d978734be tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:26.271451 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:26.313099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a58fd-291a-444e-8faa-9e9d978734be tempest-VolumeQuotaClassesTest-1479605055 tempest-VolumeQuotaClassesTest-1479605055-project-admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:26.398536 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45a6d4-477b-4ec9-94f6-e129eb511cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:26.399432 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45a6d4-477b-4ec9-94f6-e129eb511cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:26.400195 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45a6d4-477b-4ec9-94f6-e129eb511cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:26.400708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45a6d4-477b-4ec9-94f6-e129eb511cc7 admin admin] PATH_INFO: `/v3/users/3ce8aef178d646fa87fbd31c9ed0920c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:26.402062 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45a6d4-477b-4ec9-94f6-e129eb511cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce8aef178d646fa87fbd31c9ed0920c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:26.404969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45a6d4-477b-4ec9-94f6-e129eb511cc7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:26.537969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3d45a6d4-477b-4ec9-94f6-e129eb511cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce8aef178d646fa87fbd31c9ed0920c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:26.555510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3d45a6d4-477b-4ec9-94f6-e129eb511cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce8aef178d646fa87fbd31c9ed0920c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:26.572854 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3d45a6d4-477b-4ec9-94f6-e129eb511cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce8aef178d646fa87fbd31c9ed0920c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:26.583978 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3d45a6d4-477b-4ec9-94f6-e129eb511cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce8aef178d646fa87fbd31c9ed0920c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:26.585628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3d45a6d4-477b-4ec9-94f6-e129eb511cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce8aef178d646fa87fbd31c9ed0920c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:26.593349 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 958/1922] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:26 2022] DELETE /identity/v3/users/3ce8aef178d646fa87fbd31c9ed0920c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:26.598535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e3a3e-f33b-4c14-81d1-4c8891a7b46b None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:26.599045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e3a3e-f33b-4c14-81d1-4c8891a7b46b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:26.599591 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e3a3e-f33b-4c14-81d1-4c8891a7b46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:26.635260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-805e3a3e-f33b-4c14-81d1-4c8891a7b46b None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:26.636740 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-805e3a3e-f33b-4c14-81d1-4c8891a7b46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:26.712602 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 965/1923] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:26.722129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45a6d4-477b-4ec9-94f6-e129eb511cc7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:26.724796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3d45a6d4-477b-4ec9-94f6-e129eb511cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:26.819967 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45a6d4-477b-4ec9-94f6-e129eb511cc7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:26.823853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e69cee-cede-4ea5-9d1d-9a6600a09d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:26.824473 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e69cee-cede-4ea5-9d1d-9a6600a09d44 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:26.824893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e69cee-cede-4ea5-9d1d-9a6600a09d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:26.825171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e69cee-cede-4ea5-9d1d-9a6600a09d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:26.836465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e69cee-cede-4ea5-9d1d-9a6600a09d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:26.838037 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e69cee-cede-4ea5-9d1d-9a6600a09d44 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:26.843062 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:26.855145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 959/1924] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:27.315022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e3a3e-f33b-4c14-81d1-4c8891a7b46b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:27.318573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-805e3a3e-f33b-4c14-81d1-4c8891a7b46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:27.366335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e3a3e-f33b-4c14-81d1-4c8891a7b46b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:27.376709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:27.377385 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:27.377667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:27.377985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13 admin admin] PATH_INFO: `/v3/projects/e7f1e4fb1d8c4c55b4657808ef621301` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:27.379260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7f1e4fb1d8c4c55b4657808ef621301)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:27.381339 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:27.492087 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7f1e4fb1d8c4c55b4657808ef621301', 'request_id': 'req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:27.501854 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7f1e4fb1d8c4c55b4657808ef621301', 'request_id': 'req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:27.511310 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7f1e4fb1d8c4c55b4657808ef621301', 'request_id': 'req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:27.535797 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13 admin admin] The token cache is being invalidate because project e7f1e4fb1d8c4c55b4657808ef621301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:27.536739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:27.537928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:27.540031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 966/1925] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:27 2022] DELETE /identity/v3/projects/e7f1e4fb1d8c4c55b4657808ef621301 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:27.543850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e69cee-cede-4ea5-9d1d-9a6600a09d44 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:27.561675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e69cee-cede-4ea5-9d1d-9a6600a09d44 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:27.680452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dea297-4a8e-47f6-9690-849d16bea8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:27.681412 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dea297-4a8e-47f6-9690-849d16bea8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:27.682050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dea297-4a8e-47f6-9690-849d16bea8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:27.682525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dea297-4a8e-47f6-9690-849d16bea8cb admin admin] PATH_INFO: `/v3/users/0c907f40c6ab4a2d8a88390c41660608` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:27.684003 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dea297-4a8e-47f6-9690-849d16bea8cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c907f40c6ab4a2d8a88390c41660608)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:27.686322 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dea297-4a8e-47f6-9690-849d16bea8cb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:27.765623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-24dea297-4a8e-47f6-9690-849d16bea8cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c907f40c6ab4a2d8a88390c41660608'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:27.774825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-24dea297-4a8e-47f6-9690-849d16bea8cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c907f40c6ab4a2d8a88390c41660608'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:27.789796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-24dea297-4a8e-47f6-9690-849d16bea8cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c907f40c6ab4a2d8a88390c41660608'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:27.797526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-24dea297-4a8e-47f6-9690-849d16bea8cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c907f40c6ab4a2d8a88390c41660608'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:27.798486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-24dea297-4a8e-47f6-9690-849d16bea8cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c907f40c6ab4a2d8a88390c41660608'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:27.807138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 960/1926] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:27 2022] DELETE /identity/v3/users/0c907f40c6ab4a2d8a88390c41660608 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:28.423106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:28.425262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:28.457472 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16deecf-dcd0-44c4-84bc-8f0e84e06a13 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:28.533305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03f466-a0f3-4ecb-9348-a662a250de72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:28.533986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03f466-a0f3-4ecb-9348-a662a250de72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:28.534273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03f466-a0f3-4ecb-9348-a662a250de72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:28.534552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03f466-a0f3-4ecb-9348-a662a250de72 admin admin] PATH_INFO: `/v3/projects/72da0d059daa4201b14fa81f48161f0c` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:28.535901 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03f466-a0f3-4ecb-9348-a662a250de72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72da0d059daa4201b14fa81f48161f0c)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:28.537839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03f466-a0f3-4ecb-9348-a662a250de72 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:28.546312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:28.603688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4d03f466-a0f3-4ecb-9348-a662a250de72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72da0d059daa4201b14fa81f48161f0c', 'request_id': 'req-4d03f466-a0f3-4ecb-9348-a662a250de72'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:28.616110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4d03f466-a0f3-4ecb-9348-a662a250de72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72da0d059daa4201b14fa81f48161f0c', 'request_id': 'req-4d03f466-a0f3-4ecb-9348-a662a250de72'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:28.624419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4d03f466-a0f3-4ecb-9348-a662a250de72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72da0d059daa4201b14fa81f48161f0c', 'request_id': 'req-4d03f466-a0f3-4ecb-9348-a662a250de72'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:28.659314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4d03f466-a0f3-4ecb-9348-a662a250de72 admin admin] The token cache is being invalidate because project 72da0d059daa4201b14fa81f48161f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:28.659935 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4d03f466-a0f3-4ecb-9348-a662a250de72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:28.662005 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4d03f466-a0f3-4ecb-9348-a662a250de72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:28.663881 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 967/1927] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:28 2022] DELETE /identity/v3/projects/72da0d059daa4201b14fa81f48161f0c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:28.668931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92dc4c-f89f-40b4-9466-1db33f88d88b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:28.669298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92dc4c-f89f-40b4-9466-1db33f88d88b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:28.669596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92dc4c-f89f-40b4-9466-1db33f88d88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:28.691431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6b92dc4c-f89f-40b4-9466-1db33f88d88b None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:28.692677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6b92dc4c-f89f-40b4-9466-1db33f88d88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:28.779898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 961/1928] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:28.780802 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad2fc9-b933-4a24-9d2e-379a9a05f29c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:28.781162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad2fc9-b933-4a24-9d2e-379a9a05f29c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:28.781567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad2fc9-b933-4a24-9d2e-379a9a05f29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:28.807881 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-bbad2fc9-b933-4a24-9d2e-379a9a05f29c None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:28.809678 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bbad2fc9-b933-4a24-9d2e-379a9a05f29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:28.853788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 968/1929] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:24:28.856653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92dc4c-f89f-40b4-9466-1db33f88d88b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:28.873341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92dc4c-f89f-40b4-9466-1db33f88d88b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:28.883310 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f8a44-e2a4-44ac-92f6-1bf0211ce30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:28.883973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f8a44-e2a4-44ac-92f6-1bf0211ce30b admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:28.884358 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f8a44-e2a4-44ac-92f6-1bf0211ce30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:28.884635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f8a44-e2a4-44ac-92f6-1bf0211ce30b admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:28.885339 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f8a44-e2a4-44ac-92f6-1bf0211ce30b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:28.885670 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f8a44-e2a4-44ac-92f6-1bf0211ce30b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:28.887537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f8a44-e2a4-44ac-92f6-1bf0211ce30b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:28.901932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 962/1930] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:24:28.906101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad2fc9-b933-4a24-9d2e-379a9a05f29c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:28.918857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad2fc9-b933-4a24-9d2e-379a9a05f29c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:28.924748 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330161c-d7e2-4ea1-8274-f147d393d4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:28.925604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330161c-d7e2-4ea1-8274-f147d393d4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:28.925998 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330161c-d7e2-4ea1-8274-f147d393d4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:28.926350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330161c-d7e2-4ea1-8274-f147d393d4e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:28.927129 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330161c-d7e2-4ea1-8274-f147d393d4e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:28.929299 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330161c-d7e2-4ea1-8274-f147d393d4e2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:28.965724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 969/1931] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:28 2022] POST /identity/v3/projects => generated 407 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:24:28.970564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f8a44-e2a4-44ac-92f6-1bf0211ce30b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:28.978426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:28.982646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f8a44-e2a4-44ac-92f6-1bf0211ce30b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:29.080274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a0aa3-e141-4f3f-a616-fd0e0f99804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:29.081226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a0aa3-e141-4f3f-a616-fd0e0f99804b admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:29.082004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a0aa3-e141-4f3f-a616-fd0e0f99804b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:29.082709 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a0aa3-e141-4f3f-a616-fd0e0f99804b admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:29.083755 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a0aa3-e141-4f3f-a616-fd0e0f99804b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:29.085873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a0aa3-e141-4f3f-a616-fd0e0f99804b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:29.114844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 963/1932] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:28 2022] POST /identity/v3/users => generated 304 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:29.118842 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330161c-d7e2-4ea1-8274-f147d393d4e2 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:29.131238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330161c-d7e2-4ea1-8274-f147d393d4e2 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:29.137770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86cacb-d50c-4ff0-ac21-2fc05f8162e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:29.138523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86cacb-d50c-4ff0-ac21-2fc05f8162e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:29.138871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86cacb-d50c-4ff0-ac21-2fc05f8162e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:29.139265 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86cacb-d50c-4ff0-ac21-2fc05f8162e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:29.139977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86cacb-d50c-4ff0-ac21-2fc05f8162e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:29.141722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86cacb-d50c-4ff0-ac21-2fc05f8162e3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:29.155860 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 970/1933] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:29.157267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a0aa3-e141-4f3f-a616-fd0e0f99804b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:29.168052 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a0aa3-e141-4f3f-a616-fd0e0f99804b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:29.173901 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f23dd-1234-4fd3-8d7a-18c761a4c3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:29.174573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f23dd-1234-4fd3-8d7a-18c761a4c3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:29.174866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f23dd-1234-4fd3-8d7a-18c761a4c3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:29.175914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f23dd-1234-4fd3-8d7a-18c761a4c3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:29.177253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f23dd-1234-4fd3-8d7a-18c761a4c3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:29.179567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f23dd-1234-4fd3-8d7a-18c761a4c3a8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:29.193723 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 964/1934] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:29.202373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86cacb-d50c-4ff0-ac21-2fc05f8162e3 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:29.221864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86cacb-d50c-4ff0-ac21-2fc05f8162e3 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:29.221864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0b611-f3b5-490f-a24f-7726dc8c35d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:29.221864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0b611-f3b5-490f-a24f-7726dc8c35d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:29.221864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0b611-f3b5-490f-a24f-7726dc8c35d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:29.222284 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0b611-f3b5-490f-a24f-7726dc8c35d8 admin admin] PATH_INFO: `/v3/projects/29bbaa42b8604cebb5a412f71df8e78f/users/bd4a443d81e449c8868719ede79c6194/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:29.236296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0b611-f3b5-490f-a24f-7726dc8c35d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29bbaa42b8604cebb5a412f71df8e78f, user_id=bd4a443d81e449c8868719ede79c6194, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:29.239473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0b611-f3b5-490f-a24f-7726dc8c35d8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:29.252490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 971/1935] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:29 2022] PUT /identity/v3/projects/29bbaa42b8604cebb5a412f71df8e78f/users/bd4a443d81e449c8868719ede79c6194/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:29.263939 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8d6eb-c845-4a61-b21d-3f02e56b5c04 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:29.264314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8d6eb-c845-4a61-b21d-3f02e56b5c04 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:29.264594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8d6eb-c845-4a61-b21d-3f02e56b5c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:29.295183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3eb8d6eb-c845-4a61-b21d-3f02e56b5c04 None None] MFA Rules not processed for user `bd4a443d81e449c8868719ede79c6194`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:29.296505 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3eb8d6eb-c845-4a61-b21d-3f02e56b5c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:29.371337 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 965/1936] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:29 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:29.376554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0b611-f3b5-490f-a24f-7726dc8c35d8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:29.506216 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0b611-f3b5-490f-a24f-7726dc8c35d8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:29.513066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d6adc-a910-4dca-9534-b1ebce09cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:29.513706 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d6adc-a910-4dca-9534-b1ebce09cde4 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:29.513999 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d6adc-a910-4dca-9534-b1ebce09cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:29.514272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d6adc-a910-4dca-9534-b1ebce09cde4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:29.514912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d6adc-a910-4dca-9534-b1ebce09cde4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:29.516898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d6adc-a910-4dca-9534-b1ebce09cde4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:29.547389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 972/1937] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:29 2022] POST /identity/v3/projects => generated 407 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:29.551952 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8d6eb-c845-4a61-b21d-3f02e56b5c04 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:29.567023 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8d6eb-c845-4a61-b21d-3f02e56b5c04 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:29.634260 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3179bf5-674c-4921-9bbc-faa1ae19f414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:29.635017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3179bf5-674c-4921-9bbc-faa1ae19f414 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:29.635319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3179bf5-674c-4921-9bbc-faa1ae19f414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:29.635605 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3179bf5-674c-4921-9bbc-faa1ae19f414 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:29.636255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3179bf5-674c-4921-9bbc-faa1ae19f414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:29.638387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3179bf5-674c-4921-9bbc-faa1ae19f414 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:29.661489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 966/1938] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:29 2022] POST /identity/v3/users => generated 310 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:24:29.666266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d6adc-a910-4dca-9534-b1ebce09cde4 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:29.678629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d6adc-a910-4dca-9534-b1ebce09cde4 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:29.684126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3032cc-8fe2-49c1-9533-3b35c79cac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:29.684745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3032cc-8fe2-49c1-9533-3b35c79cac52 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:29.685027 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3032cc-8fe2-49c1-9533-3b35c79cac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:29.685302 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3032cc-8fe2-49c1-9533-3b35c79cac52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:29.685991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3032cc-8fe2-49c1-9533-3b35c79cac52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:29.687664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3032cc-8fe2-49c1-9533-3b35c79cac52 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:29.699417 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 973/1939] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:29.703570 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3179bf5-674c-4921-9bbc-faa1ae19f414 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:29.709716 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:29.717169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3179bf5-674c-4921-9bbc-faa1ae19f414 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:29.722312 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a2183-2519-4733-9cf2-0650afa7ee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:29.723263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a2183-2519-4733-9cf2-0650afa7ee61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:29.723646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a2183-2519-4733-9cf2-0650afa7ee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:29.723925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a2183-2519-4733-9cf2-0650afa7ee61 admin admin] PATH_INFO: `/v3/projects/55b8af4b009a484083dc41c4ece543dd/users/fb169d6f55ab457181af1f64893d2d07/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:29.740470 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a2183-2519-4733-9cf2-0650afa7ee61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b8af4b009a484083dc41c4ece543dd, user_id=fb169d6f55ab457181af1f64893d2d07, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:29.743250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a2183-2519-4733-9cf2-0650afa7ee61 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:29.757638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 967/1940] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:29 2022] PUT /identity/v3/projects/55b8af4b009a484083dc41c4ece543dd/users/fb169d6f55ab457181af1f64893d2d07/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:29.761847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3032cc-8fe2-49c1-9533-3b35c79cac52 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:29.773438 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3032cc-8fe2-49c1-9533-3b35c79cac52 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:29.777595 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:29.839953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3058cb-379c-4358-82e3-f9fe39ba21fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:29.840571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3058cb-379c-4358-82e3-f9fe39ba21fb admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:29.840856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3058cb-379c-4358-82e3-f9fe39ba21fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:29.841134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3058cb-379c-4358-82e3-f9fe39ba21fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:29.841819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3058cb-379c-4358-82e3-f9fe39ba21fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:29.843619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3058cb-379c-4358-82e3-f9fe39ba21fb admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:29.853838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 974/1941] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:29.858195 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a2183-2519-4733-9cf2-0650afa7ee61 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:29.869766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a2183-2519-4733-9cf2-0650afa7ee61 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:29.874803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7ab3f-d641-4216-809f-3b3e8b123ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:29.875741 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7ab3f-d641-4216-809f-3b3e8b123ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:29.875984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7ab3f-d641-4216-809f-3b3e8b123ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:29.876257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7ab3f-d641-4216-809f-3b3e8b123ea1 admin admin] PATH_INFO: `/v3/projects/55b8af4b009a484083dc41c4ece543dd/users/fb169d6f55ab457181af1f64893d2d07/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:29.878204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7ab3f-d641-4216-809f-3b3e8b123ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b8af4b009a484083dc41c4ece543dd, user_id=fb169d6f55ab457181af1f64893d2d07, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:29.887357 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7ab3f-d641-4216-809f-3b3e8b123ea1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:29.901129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 968/1942] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:29 2022] PUT /identity/v3/projects/55b8af4b009a484083dc41c4ece543dd/users/fb169d6f55ab457181af1f64893d2d07/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:29.911556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288af636-f34c-486b-a79a-3175ff02dae8 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:29.911937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288af636-f34c-486b-a79a-3175ff02dae8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:29.912303 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288af636-f34c-486b-a79a-3175ff02dae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:29.943314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-288af636-f34c-486b-a79a-3175ff02dae8 None None] MFA Rules not processed for user `fb169d6f55ab457181af1f64893d2d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:29.944604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-288af636-f34c-486b-a79a-3175ff02dae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:30.023915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 975/1943] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:29 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:30.036818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7ab3f-d641-4216-809f-3b3e8b123ea1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:30.038654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b1e7ab3f-d641-4216-809f-3b3e8b123ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:30.142582 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7ab3f-d641-4216-809f-3b3e8b123ea1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:30.148454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327c000-c832-4389-9c68-fed1b5866bde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:30.149087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327c000-c832-4389-9c68-fed1b5866bde service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:30.149371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327c000-c832-4389-9c68-fed1b5866bde service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:30.149721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327c000-c832-4389-9c68-fed1b5866bde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:30.171310 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327c000-c832-4389-9c68-fed1b5866bde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:30.173632 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327c000-c832-4389-9c68-fed1b5866bde service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:30.195497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 969/1944] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:30 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:30.443836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288af636-f34c-486b-a79a-3175ff02dae8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:30.445159 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-288af636-f34c-486b-a79a-3175ff02dae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:30.456814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288af636-f34c-486b-a79a-3175ff02dae8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:30.460807 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d33ad-011b-42c9-8377-f0a8a558b3ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:30.461415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d33ad-011b-42c9-8377-f0a8a558b3ea service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:30.461922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d33ad-011b-42c9-8377-f0a8a558b3ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:30.462195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d33ad-011b-42c9-8377-f0a8a558b3ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:30.517419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327c000-c832-4389-9c68-fed1b5866bde service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:30.519157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2327c000-c832-4389-9c68-fed1b5866bde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:30.542631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d33ad-011b-42c9-8377-f0a8a558b3ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:30.544486 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d33ad-011b-42c9-8377-f0a8a558b3ea service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:30.554715 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 976/1945] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:30 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:30.612868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327c000-c832-4389-9c68-fed1b5866bde service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:30.619278 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b8ae3-93e4-4b50-a4bd-0e1596e97a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:30.620223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b8ae3-93e4-4b50-a4bd-0e1596e97a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:30.620507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b8ae3-93e4-4b50-a4bd-0e1596e97a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:30.620785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b8ae3-93e4-4b50-a4bd-0e1596e97a37 admin admin] PATH_INFO: `/v3/users/d8013b87d57240e187fdac16b53956f3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:30.622352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b8ae3-93e4-4b50-a4bd-0e1596e97a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8013b87d57240e187fdac16b53956f3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:30.625564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b8ae3-93e4-4b50-a4bd-0e1596e97a37 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:30.703921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-002b8ae3-93e4-4b50-a4bd-0e1596e97a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8013b87d57240e187fdac16b53956f3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:30.717153 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-002b8ae3-93e4-4b50-a4bd-0e1596e97a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8013b87d57240e187fdac16b53956f3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:30.734786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:30.737570 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-002b8ae3-93e4-4b50-a4bd-0e1596e97a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8013b87d57240e187fdac16b53956f3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:30.753170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-002b8ae3-93e4-4b50-a4bd-0e1596e97a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8013b87d57240e187fdac16b53956f3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:30.754828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-002b8ae3-93e4-4b50-a4bd-0e1596e97a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8013b87d57240e187fdac16b53956f3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:30.768373 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 970/1946] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:30 2022] DELETE /identity/v3/users/d8013b87d57240e187fdac16b53956f3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:30.771743 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa5bef-afac-4fb1-91fc-cba552c0250e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:30.772090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa5bef-afac-4fb1-91fc-cba552c0250e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:30.772611 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa5bef-afac-4fb1-91fc-cba552c0250e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:30.802242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-23fa5bef-afac-4fb1-91fc-cba552c0250e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:30.804148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-23fa5bef-afac-4fb1-91fc-cba552c0250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:30.828482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:30.884815 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 977/1947] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:30.896634 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b8ae3-93e4-4b50-a4bd-0e1596e97a37 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:30.899470 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-002b8ae3-93e4-4b50-a4bd-0e1596e97a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:30.996847 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b8ae3-93e4-4b50-a4bd-0e1596e97a37 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:31.003400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbf7d7-0a05-4d63-a2f5-c5c33e427312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:31.004083 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbf7d7-0a05-4d63-a2f5-c5c33e427312 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:31.004510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbf7d7-0a05-4d63-a2f5-c5c33e427312 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:31.004792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbf7d7-0a05-4d63-a2f5-c5c33e427312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:31.014891 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbf7d7-0a05-4d63-a2f5-c5c33e427312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:31.016347 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbf7d7-0a05-4d63-a2f5-c5c33e427312 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:31.027286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 971/1948] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:31.341886 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa5bef-afac-4fb1-91fc-cba552c0250e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:31.343660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-23fa5bef-afac-4fb1-91fc-cba552c0250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:31.367997 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa5bef-afac-4fb1-91fc-cba552c0250e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:31.374319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:31.375092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:31.375380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:31.375657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1 admin admin] PATH_INFO: `/v3/projects/d9a0e7e568c94fcbbabde6cb735bce84` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:31.376790 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a0e7e568c94fcbbabde6cb735bce84)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:31.379537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:31.457896 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a0e7e568c94fcbbabde6cb735bce84', 'request_id': 'req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:31.475497 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a0e7e568c94fcbbabde6cb735bce84', 'request_id': 'req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:31.483056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a0e7e568c94fcbbabde6cb735bce84', 'request_id': 'req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:31.498505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1 admin admin] The token cache is being invalidate because project d9a0e7e568c94fcbbabde6cb735bce84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:31.499012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:31.499885 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:31.501793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 978/1949] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:31 2022] DELETE /identity/v3/projects/d9a0e7e568c94fcbbabde6cb735bce84 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:31.506499 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbf7d7-0a05-4d63-a2f5-c5c33e427312 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:31.517288 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbf7d7-0a05-4d63-a2f5-c5c33e427312 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:31.645643 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8f880-280b-4c03-84c4-587370c5cf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:31.646358 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8f880-280b-4c03-84c4-587370c5cf21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:31.647563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8f880-280b-4c03-84c4-587370c5cf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:31.651133 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8f880-280b-4c03-84c4-587370c5cf21 admin admin] PATH_INFO: `/v3/users/a295325fbd584193a451ab0c6539a437` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:31.652668 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8f880-280b-4c03-84c4-587370c5cf21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a295325fbd584193a451ab0c6539a437)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:31.669514 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8f880-280b-4c03-84c4-587370c5cf21 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:31.761008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d3b8f880-280b-4c03-84c4-587370c5cf21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a295325fbd584193a451ab0c6539a437'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:31.775749 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d3b8f880-280b-4c03-84c4-587370c5cf21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a295325fbd584193a451ab0c6539a437'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:31.792575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d3b8f880-280b-4c03-84c4-587370c5cf21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a295325fbd584193a451ab0c6539a437'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:31.801336 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d3b8f880-280b-4c03-84c4-587370c5cf21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a295325fbd584193a451ab0c6539a437'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:31.802229 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d3b8f880-280b-4c03-84c4-587370c5cf21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a295325fbd584193a451ab0c6539a437'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:31.808588 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 972/1950] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:31 2022] DELETE /identity/v3/users/a295325fbd584193a451ab0c6539a437 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:32.182138 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:32.183765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:32.249662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83553a-c4c7-4f24-94a7-a6c1e0dc11b1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:32.380599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b5ffb-ad81-490b-ad3c-7e51a9ff551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:32.381784 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b5ffb-ad81-490b-ad3c-7e51a9ff551d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:32.382885 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b5ffb-ad81-490b-ad3c-7e51a9ff551d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:32.382885 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b5ffb-ad81-490b-ad3c-7e51a9ff551d admin admin] PATH_INFO: `/v3/projects/2fb2c90876a8440fa4d3a10854cf2053` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:32.383751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b5ffb-ad81-490b-ad3c-7e51a9ff551d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb2c90876a8440fa4d3a10854cf2053)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:32.388826 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b5ffb-ad81-490b-ad3c-7e51a9ff551d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:32.466573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-aa4b5ffb-ad81-490b-ad3c-7e51a9ff551d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb2c90876a8440fa4d3a10854cf2053', 'request_id': 'req-aa4b5ffb-ad81-490b-ad3c-7e51a9ff551d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:32.468535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:32.475418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-aa4b5ffb-ad81-490b-ad3c-7e51a9ff551d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb2c90876a8440fa4d3a10854cf2053', 'request_id': 'req-aa4b5ffb-ad81-490b-ad3c-7e51a9ff551d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:32.483217 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-aa4b5ffb-ad81-490b-ad3c-7e51a9ff551d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb2c90876a8440fa4d3a10854cf2053', 'request_id': 'req-aa4b5ffb-ad81-490b-ad3c-7e51a9ff551d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:32.496451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-aa4b5ffb-ad81-490b-ad3c-7e51a9ff551d admin admin] The token cache is being invalidate because project 2fb2c90876a8440fa4d3a10854cf2053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:32.496744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-aa4b5ffb-ad81-490b-ad3c-7e51a9ff551d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:32.497372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-aa4b5ffb-ad81-490b-ad3c-7e51a9ff551d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:32.498878 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 979/1951] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:32 2022] DELETE /identity/v3/projects/2fb2c90876a8440fa4d3a10854cf2053 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:32.504782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802571f-2f32-4861-9e89-19e30d10bb63 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:32.505451 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802571f-2f32-4861-9e89-19e30d10bb63 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:32.505451 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802571f-2f32-4861-9e89-19e30d10bb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:32.526610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b802571f-2f32-4861-9e89-19e30d10bb63 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:32.527815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b802571f-2f32-4861-9e89-19e30d10bb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:32.532617 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:32.593590 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 973/1952] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:32.603696 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96123f5-093e-4f73-a7ef-b9117a425c61 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:32.604052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96123f5-093e-4f73-a7ef-b9117a425c61 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:32.604487 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96123f5-093e-4f73-a7ef-b9117a425c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:32.625615 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a96123f5-093e-4f73-a7ef-b9117a425c61 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:32.626857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a96123f5-093e-4f73-a7ef-b9117a425c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:32.636045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 980/1953] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:32.639743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802571f-2f32-4861-9e89-19e30d10bb63 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:32.650977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802571f-2f32-4861-9e89-19e30d10bb63 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:32.655768 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece4f0f-d341-43f8-85c5-6a7f995c6a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:32.656369 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece4f0f-d341-43f8-85c5-6a7f995c6a63 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:32.656647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece4f0f-d341-43f8-85c5-6a7f995c6a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:32.656918 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece4f0f-d341-43f8-85c5-6a7f995c6a63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:32.657590 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece4f0f-d341-43f8-85c5-6a7f995c6a63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:32.657913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece4f0f-d341-43f8-85c5-6a7f995c6a63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:32.659565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece4f0f-d341-43f8-85c5-6a7f995c6a63 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:32.673390 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 974/1954] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:24:32.679036 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96123f5-093e-4f73-a7ef-b9117a425c61 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:32.693495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96123f5-093e-4f73-a7ef-b9117a425c61 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:32.699928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187ff9a-d0d7-41b9-873d-c1232c61701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:32.700730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187ff9a-d0d7-41b9-873d-c1232c61701a admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:32.701011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187ff9a-d0d7-41b9-873d-c1232c61701a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:32.701306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187ff9a-d0d7-41b9-873d-c1232c61701a admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:32.702043 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187ff9a-d0d7-41b9-873d-c1232c61701a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:32.704183 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187ff9a-d0d7-41b9-873d-c1232c61701a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:32.743993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 981/1955] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:32 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:32.747544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece4f0f-d341-43f8-85c5-6a7f995c6a63 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:32.758117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece4f0f-d341-43f8-85c5-6a7f995c6a63 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:32.909367 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f495aa-4ba0-4a7b-b667-b782eb1f66be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:32.910435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f495aa-4ba0-4a7b-b667-b782eb1f66be admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:32.911014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f495aa-4ba0-4a7b-b667-b782eb1f66be admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:32.911425 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f495aa-4ba0-4a7b-b667-b782eb1f66be admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:32.912226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f495aa-4ba0-4a7b-b667-b782eb1f66be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:32.914331 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f495aa-4ba0-4a7b-b667-b782eb1f66be admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:32.997975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 975/1956] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:32 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:24:32.999962 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187ff9a-d0d7-41b9-873d-c1232c61701a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:33.016193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187ff9a-d0d7-41b9-873d-c1232c61701a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:33.028838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561493b-cea8-4985-b195-19c4bb454e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:33.029485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561493b-cea8-4985-b195-19c4bb454e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:33.030489 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561493b-cea8-4985-b195-19c4bb454e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:33.031147 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561493b-cea8-4985-b195-19c4bb454e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:33.031970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561493b-cea8-4985-b195-19c4bb454e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:33.037604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561493b-cea8-4985-b195-19c4bb454e11 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:33.064140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 982/1957] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:33.068529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f495aa-4ba0-4a7b-b667-b782eb1f66be admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:33.082058 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f495aa-4ba0-4a7b-b667-b782eb1f66be admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:33.095870 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addba969-a997-4e98-9e3a-ee6ebeff262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:33.096317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addba969-a997-4e98-9e3a-ee6ebeff262e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:33.096605 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addba969-a997-4e98-9e3a-ee6ebeff262e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:33.097134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addba969-a997-4e98-9e3a-ee6ebeff262e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:33.098903 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addba969-a997-4e98-9e3a-ee6ebeff262e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:33.100870 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addba969-a997-4e98-9e3a-ee6ebeff262e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:33.118038 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 976/1958] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:33.120371 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561493b-cea8-4985-b195-19c4bb454e11 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:33.138086 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561493b-cea8-4985-b195-19c4bb454e11 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:33.145972 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6d22c-4a29-499e-b681-8691e37026e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:33.146987 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d22c-4a29-499e-b681-8691e37026e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:33.147470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d22c-4a29-499e-b681-8691e37026e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:33.148193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d22c-4a29-499e-b681-8691e37026e1 admin admin] PATH_INFO: `/v3/projects/8c9330f4e9b64647a50750b0ea2f95df/users/dbd9af1299114b3ea580cc2eeef44b1a/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:33.169979 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6d22c-4a29-499e-b681-8691e37026e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9330f4e9b64647a50750b0ea2f95df, user_id=dbd9af1299114b3ea580cc2eeef44b1a, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:33.173639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6d22c-4a29-499e-b681-8691e37026e1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:33.193619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 983/1959] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:33 2022] PUT /identity/v3/projects/8c9330f4e9b64647a50750b0ea2f95df/users/dbd9af1299114b3ea580cc2eeef44b1a/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:33.204453 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab657ad-4405-45b2-acad-1cb046917955 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:33.204758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab657ad-4405-45b2-acad-1cb046917955 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:33.205075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab657ad-4405-45b2-acad-1cb046917955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:33.247809 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8ab657ad-4405-45b2-acad-1cb046917955 None None] MFA Rules not processed for user `dbd9af1299114b3ea580cc2eeef44b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:33.248978 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8ab657ad-4405-45b2-acad-1cb046917955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:33.353736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 977/1960] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:33.357644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6d22c-4a29-499e-b681-8691e37026e1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:33.450641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6d22c-4a29-499e-b681-8691e37026e1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:33.474954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85379e-6613-448a-96e4-c4455408c609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:33.477132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85379e-6613-448a-96e4-c4455408c609 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:33.479292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85379e-6613-448a-96e4-c4455408c609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:33.479846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85379e-6613-448a-96e4-c4455408c609 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:33.480667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85379e-6613-448a-96e4-c4455408c609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:33.482775 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85379e-6613-448a-96e4-c4455408c609 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:33.533668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 984/1961] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:33 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:33.538390 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab657ad-4405-45b2-acad-1cb046917955 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:33.550095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:33.563373 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab657ad-4405-45b2-acad-1cb046917955 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:33.656719 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269de4b-347a-4573-85f7-a0483cd94da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:33.657549 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269de4b-347a-4573-85f7-a0483cd94da6 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:33.657661 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269de4b-347a-4573-85f7-a0483cd94da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:33.657923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269de4b-347a-4573-85f7-a0483cd94da6 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:33.658565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269de4b-347a-4573-85f7-a0483cd94da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:33.661038 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269de4b-347a-4573-85f7-a0483cd94da6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:33.695401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 978/1962] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:33 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:33.695866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85379e-6613-448a-96e4-c4455408c609 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:33.708714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85379e-6613-448a-96e4-c4455408c609 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:33.716424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cc8da-a9be-4479-8538-5399134dda03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:33.718314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cc8da-a9be-4479-8538-5399134dda03 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:33.719248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cc8da-a9be-4479-8538-5399134dda03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:33.719713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cc8da-a9be-4479-8538-5399134dda03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:33.720855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cc8da-a9be-4479-8538-5399134dda03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:33.723872 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cc8da-a9be-4479-8538-5399134dda03 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:33.741153 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269de4b-347a-4573-85f7-a0483cd94da6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:33.748549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 985/1963] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:33.752924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269de4b-347a-4573-85f7-a0483cd94da6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:33.773281 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e04fb-315f-4044-8a1a-3af07e866302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:33.774044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e04fb-315f-4044-8a1a-3af07e866302 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:33.774384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e04fb-315f-4044-8a1a-3af07e866302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:33.774853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e04fb-315f-4044-8a1a-3af07e866302 admin admin] PATH_INFO: `/v3/projects/63f470d51047449581428bd8f9d970ef/users/548bec6f502641b3837f8525b4cc6964/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:33.798977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e04fb-315f-4044-8a1a-3af07e866302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f470d51047449581428bd8f9d970ef, user_id=548bec6f502641b3837f8525b4cc6964, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:33.802250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e04fb-315f-4044-8a1a-3af07e866302 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:33.819443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 979/1964] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:33 2022] PUT /identity/v3/projects/63f470d51047449581428bd8f9d970ef/users/548bec6f502641b3837f8525b4cc6964/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:33.823526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cc8da-a9be-4479-8538-5399134dda03 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:33.836896 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cc8da-a9be-4479-8538-5399134dda03 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:33.901904 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:33.922528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ccb21-7d1b-4e1b-839d-60753a8b1c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:33.923526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ccb21-7d1b-4e1b-839d-60753a8b1c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:33.924214 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ccb21-7d1b-4e1b-839d-60753a8b1c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:33.924799 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ccb21-7d1b-4e1b-839d-60753a8b1c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:33.925938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ccb21-7d1b-4e1b-839d-60753a8b1c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:33.927983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ccb21-7d1b-4e1b-839d-60753a8b1c6b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:33.943364 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 986/1965] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:33.948198 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e04fb-315f-4044-8a1a-3af07e866302 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:33.968264 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e04fb-315f-4044-8a1a-3af07e866302 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:33.975437 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7417f9-94c7-4c1a-8e64-64e0b9564a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:33.976778 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7417f9-94c7-4c1a-8e64-64e0b9564a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:33.976778 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7417f9-94c7-4c1a-8e64-64e0b9564a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:33.976778 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7417f9-94c7-4c1a-8e64-64e0b9564a24 admin admin] PATH_INFO: `/v3/projects/63f470d51047449581428bd8f9d970ef/users/548bec6f502641b3837f8525b4cc6964/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:33.980064 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7417f9-94c7-4c1a-8e64-64e0b9564a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f470d51047449581428bd8f9d970ef, user_id=548bec6f502641b3837f8525b4cc6964, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:33.982636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7417f9-94c7-4c1a-8e64-64e0b9564a24 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:33.996785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 980/1966] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:33 2022] PUT /identity/v3/projects/63f470d51047449581428bd8f9d970ef/users/548bec6f502641b3837f8525b4cc6964/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:34.007200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ea5a3-c6bc-49d9-8684-41e05957f6e0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:34.007482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ea5a3-c6bc-49d9-8684-41e05957f6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:34.007757 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ea5a3-c6bc-49d9-8684-41e05957f6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:34.047586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b25ea5a3-c6bc-49d9-8684-41e05957f6e0 None None] MFA Rules not processed for user `548bec6f502641b3837f8525b4cc6964`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:34.049174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b25ea5a3-c6bc-49d9-8684-41e05957f6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:34.146018 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 987/1967] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:34.157202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7417f9-94c7-4c1a-8e64-64e0b9564a24 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:34.161600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cb7417f9-94c7-4c1a-8e64-64e0b9564a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:34.245298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7417f9-94c7-4c1a-8e64-64e0b9564a24 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:34.248188 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d74927-bd5e-4879-adf6-0aa19253a80d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:34.248702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d74927-bd5e-4879-adf6-0aa19253a80d service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:34.248987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d74927-bd5e-4879-adf6-0aa19253a80d service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:34.249261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d74927-bd5e-4879-adf6-0aa19253a80d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:34.265064 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d74927-bd5e-4879-adf6-0aa19253a80d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:34.267070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d74927-bd5e-4879-adf6-0aa19253a80d service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:34.282110 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 981/1968] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:34.295823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ea5a3-c6bc-49d9-8684-41e05957f6e0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:34.297342 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b25ea5a3-c6bc-49d9-8684-41e05957f6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:34.389793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ea5a3-c6bc-49d9-8684-41e05957f6e0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:34.398980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9a09c-7b55-47f6-a62d-8bdb3848cc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:34.398980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a09c-7b55-47f6-a62d-8bdb3848cc5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:34.398980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a09c-7b55-47f6-a62d-8bdb3848cc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:34.398980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a09c-7b55-47f6-a62d-8bdb3848cc5b admin admin] PATH_INFO: `/v3/users/31a94b1155cf44d7a83c6aa4969de2d4` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:34.399457 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9a09c-7b55-47f6-a62d-8bdb3848cc5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a94b1155cf44d7a83c6aa4969de2d4)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:34.401467 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9a09c-7b55-47f6-a62d-8bdb3848cc5b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:34.407496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d74927-bd5e-4879-adf6-0aa19253a80d service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:34.420382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d74927-bd5e-4879-adf6-0aa19253a80d service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:34.425157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb9628-6f4d-440a-b85b-be44a6f6c570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:34.431980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb9628-6f4d-440a-b85b-be44a6f6c570 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:34.431980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb9628-6f4d-440a-b85b-be44a6f6c570 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:34.431980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb9628-6f4d-440a-b85b-be44a6f6c570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:34.456383 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4c9a09c-7b55-47f6-a62d-8bdb3848cc5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a94b1155cf44d7a83c6aa4969de2d4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:34.458581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4c9a09c-7b55-47f6-a62d-8bdb3848cc5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a94b1155cf44d7a83c6aa4969de2d4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:34.467566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4c9a09c-7b55-47f6-a62d-8bdb3848cc5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a94b1155cf44d7a83c6aa4969de2d4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:34.492348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4c9a09c-7b55-47f6-a62d-8bdb3848cc5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a94b1155cf44d7a83c6aa4969de2d4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:34.496646 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:34.507700 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4c9a09c-7b55-47f6-a62d-8bdb3848cc5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a94b1155cf44d7a83c6aa4969de2d4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:34.517299 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 988/1969] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:34 2022] DELETE /identity/v3/users/31a94b1155cf44d7a83c6aa4969de2d4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:34.522419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f6815-29d7-4a64-8d48-f2d9e6b113eb None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:34.522895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f6815-29d7-4a64-8d48-f2d9e6b113eb None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:34.523277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f6815-29d7-4a64-8d48-f2d9e6b113eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:34.525149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb9628-6f4d-440a-b85b-be44a6f6c570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:34.526945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb9628-6f4d-440a-b85b-be44a6f6c570 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:34.531292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:34.542488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 982/1970] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:24:34.546705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2e9f6815-29d7-4a64-8d48-f2d9e6b113eb None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:34.548129 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2e9f6815-29d7-4a64-8d48-f2d9e6b113eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:34.626459 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 989/1971] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:24:34.649938 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb9628-6f4d-440a-b85b-be44a6f6c570 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:34.651847 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3dcb9628-6f4d-440a-b85b-be44a6f6c570 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:34.731144 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb9628-6f4d-440a-b85b-be44a6f6c570 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:34.825479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac47cc2-ca2b-48db-8a7d-d6b5a07d945c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:34.826136 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac47cc2-ca2b-48db-8a7d-d6b5a07d945c service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:34.826418 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac47cc2-ca2b-48db-8a7d-d6b5a07d945c service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:34.826723 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac47cc2-ca2b-48db-8a7d-d6b5a07d945c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:34.839175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac47cc2-ca2b-48db-8a7d-d6b5a07d945c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:34.840614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac47cc2-ca2b-48db-8a7d-d6b5a07d945c service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:34.861760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 983/1972] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:35.183958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f6815-29d7-4a64-8d48-f2d9e6b113eb None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:35.185512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2e9f6815-29d7-4a64-8d48-f2d9e6b113eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:35.213596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f6815-29d7-4a64-8d48-f2d9e6b113eb None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:35.218150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777912d-8687-4eb0-949c-c220fb52b5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:35.218808 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777912d-8687-4eb0-949c-c220fb52b5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:35.219236 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777912d-8687-4eb0-949c-c220fb52b5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:35.219605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777912d-8687-4eb0-949c-c220fb52b5af admin admin] PATH_INFO: `/v3/projects/0a30a0296d5043e88382109d7e1ce32f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:35.220853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777912d-8687-4eb0-949c-c220fb52b5af admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a30a0296d5043e88382109d7e1ce32f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:35.224074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777912d-8687-4eb0-949c-c220fb52b5af admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:35.283997 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4777912d-8687-4eb0-949c-c220fb52b5af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a30a0296d5043e88382109d7e1ce32f', 'request_id': 'req-4777912d-8687-4eb0-949c-c220fb52b5af'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:35.290769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4777912d-8687-4eb0-949c-c220fb52b5af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a30a0296d5043e88382109d7e1ce32f', 'request_id': 'req-4777912d-8687-4eb0-949c-c220fb52b5af'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:35.298124 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4777912d-8687-4eb0-949c-c220fb52b5af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a30a0296d5043e88382109d7e1ce32f', 'request_id': 'req-4777912d-8687-4eb0-949c-c220fb52b5af'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:35.312729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4777912d-8687-4eb0-949c-c220fb52b5af admin admin] The token cache is being invalidate because project 0a30a0296d5043e88382109d7e1ce32f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:35.313158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4777912d-8687-4eb0-949c-c220fb52b5af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:35.313819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4777912d-8687-4eb0-949c-c220fb52b5af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:35.315336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 990/1973] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:35 2022] DELETE /identity/v3/projects/0a30a0296d5043e88382109d7e1ce32f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:35.321936 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee890a-4722-4b8e-ab3b-d78c54e907c6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:35.322223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee890a-4722-4b8e-ab3b-d78c54e907c6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:35.322501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee890a-4722-4b8e-ab3b-d78c54e907c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:35.345787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4fee890a-4722-4b8e-ab3b-d78c54e907c6 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:35.346332 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4fee890a-4722-4b8e-ab3b-d78c54e907c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:35.428251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 984/1974] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:35.436043 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580f7f5-51be-4a12-9e9a-087122f59c24 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:35.436409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580f7f5-51be-4a12-9e9a-087122f59c24 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:35.437245 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580f7f5-51be-4a12-9e9a-087122f59c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:35.457960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-3580f7f5-51be-4a12-9e9a-087122f59c24 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:35.459189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3580f7f5-51be-4a12-9e9a-087122f59c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:35.472165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 991/1975] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:35.473402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee890a-4722-4b8e-ab3b-d78c54e907c6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:35.486168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee890a-4722-4b8e-ab3b-d78c54e907c6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:35.491686 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d797df-06f1-4222-ba56-25b537637759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:35.492289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d797df-06f1-4222-ba56-25b537637759 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:35.492570 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d797df-06f1-4222-ba56-25b537637759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:35.492842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d797df-06f1-4222-ba56-25b537637759 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:35.493490 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d797df-06f1-4222-ba56-25b537637759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:35.493826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d797df-06f1-4222-ba56-25b537637759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:35.495441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d797df-06f1-4222-ba56-25b537637759 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:35.511491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 985/1976] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:24:35.512606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580f7f5-51be-4a12-9e9a-087122f59c24 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:35.525301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580f7f5-51be-4a12-9e9a-087122f59c24 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:35.530137 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca61be4-8997-4058-bbaf-ae48480c6c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:35.530857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca61be4-8997-4058-bbaf-ae48480c6c30 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:35.531274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca61be4-8997-4058-bbaf-ae48480c6c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:35.531656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca61be4-8997-4058-bbaf-ae48480c6c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:35.532386 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca61be4-8997-4058-bbaf-ae48480c6c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:35.534446 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca61be4-8997-4058-bbaf-ae48480c6c30 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:35.573720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 992/1977] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:35 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:35.576711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d797df-06f1-4222-ba56-25b537637759 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:35.591056 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d797df-06f1-4222-ba56-25b537637759 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:35.637832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:35.658479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0686c8-5161-4243-8cef-840836e38ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:35.659104 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0686c8-5161-4243-8cef-840836e38ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:35.659383 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0686c8-5161-4243-8cef-840836e38ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:35.659688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0686c8-5161-4243-8cef-840836e38ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:35.660672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0686c8-5161-4243-8cef-840836e38ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:35.662707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0686c8-5161-4243-8cef-840836e38ad5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:35.690522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 986/1978] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:35 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:24:35.695301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca61be4-8997-4058-bbaf-ae48480c6c30 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:35.706230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca61be4-8997-4058-bbaf-ae48480c6c30 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:35.712073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b0fa7-93b9-48c4-85ea-b588edf3092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:35.713011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b0fa7-93b9-48c4-85ea-b588edf3092b admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:35.713471 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b0fa7-93b9-48c4-85ea-b588edf3092b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:35.713991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b0fa7-93b9-48c4-85ea-b588edf3092b admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:35.714732 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b0fa7-93b9-48c4-85ea-b588edf3092b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:35.716433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b0fa7-93b9-48c4-85ea-b588edf3092b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:35.729773 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 993/1979] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:35.733432 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0686c8-5161-4243-8cef-840836e38ad5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:35.745598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0686c8-5161-4243-8cef-840836e38ad5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:35.774485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56051344-5096-4046-a88b-1da01534173a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:35.775357 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56051344-5096-4046-a88b-1da01534173a admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:35.775635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56051344-5096-4046-a88b-1da01534173a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:35.776064 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56051344-5096-4046-a88b-1da01534173a admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:35.776817 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56051344-5096-4046-a88b-1da01534173a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:35.778456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56051344-5096-4046-a88b-1da01534173a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:35.816340 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 987/1980] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:35.818528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b0fa7-93b9-48c4-85ea-b588edf3092b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:35.832016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b0fa7-93b9-48c4-85ea-b588edf3092b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:35.844641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da08c78-3a0f-47c8-bb2d-3a4f333f56fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:35.845329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da08c78-3a0f-47c8-bb2d-3a4f333f56fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:35.845613 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da08c78-3a0f-47c8-bb2d-3a4f333f56fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:35.845917 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da08c78-3a0f-47c8-bb2d-3a4f333f56fb admin admin] PATH_INFO: `/v3/projects/c7f764d71c9845849a31cae247be10bd/users/af5ede371e3448638f86f6b553b4ef34/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:35.869204 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da08c78-3a0f-47c8-bb2d-3a4f333f56fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f764d71c9845849a31cae247be10bd, user_id=af5ede371e3448638f86f6b553b4ef34, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:35.872641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da08c78-3a0f-47c8-bb2d-3a4f333f56fb admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:35.891186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 994/1981] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:35 2022] PUT /identity/v3/projects/c7f764d71c9845849a31cae247be10bd/users/af5ede371e3448638f86f6b553b4ef34/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:35.901904 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f9642-7365-492a-aebb-3428a43796ff None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:35.902194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f9642-7365-492a-aebb-3428a43796ff None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:35.902471 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f9642-7365-492a-aebb-3428a43796ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:35.956098 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-392f9642-7365-492a-aebb-3428a43796ff None None] MFA Rules not processed for user `af5ede371e3448638f86f6b553b4ef34`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:35.958779 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-392f9642-7365-492a-aebb-3428a43796ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:36.102517 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 988/1982] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:24:36.116154 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da08c78-3a0f-47c8-bb2d-3a4f333f56fb admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:36.119236 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7da08c78-3a0f-47c8-bb2d-3a4f333f56fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:36.149801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:36.260531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da08c78-3a0f-47c8-bb2d-3a4f333f56fb admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:36.272985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c1aeb-fdbc-47ed-a74b-9b259caeb6c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:36.273647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c1aeb-fdbc-47ed-a74b-9b259caeb6c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:36.274031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c1aeb-fdbc-47ed-a74b-9b259caeb6c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:36.274315 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c1aeb-fdbc-47ed-a74b-9b259caeb6c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:36.294043 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c1aeb-fdbc-47ed-a74b-9b259caeb6c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:36.295526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c1aeb-fdbc-47ed-a74b-9b259caeb6c5 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:36.321744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 995/1983] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:36.749286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f9642-7365-492a-aebb-3428a43796ff None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:36.750885 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-392f9642-7365-492a-aebb-3428a43796ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:36.834645 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c1aeb-fdbc-47ed-a74b-9b259caeb6c5 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:36.836511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ed6c1aeb-fdbc-47ed-a74b-9b259caeb6c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:36.939489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f9642-7365-492a-aebb-3428a43796ff None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:36.968304 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657041e-e4d0-4d16-8406-2646fb98e6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:36.969159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657041e-e4d0-4d16-8406-2646fb98e6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:36.969622 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657041e-e4d0-4d16-8406-2646fb98e6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:36.970082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657041e-e4d0-4d16-8406-2646fb98e6b8 admin admin] PATH_INFO: `/v3/users/bd4a443d81e449c8868719ede79c6194` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:36.973292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657041e-e4d0-4d16-8406-2646fb98e6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd4a443d81e449c8868719ede79c6194)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:36.975484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657041e-e4d0-4d16-8406-2646fb98e6b8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:37.100488 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c1aeb-fdbc-47ed-a74b-9b259caeb6c5 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:37.121619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bbfe9-27c0-4336-bba0-8d6d0394d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:37.122405 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bbfe9-27c0-4336-bba0-8d6d0394d865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:37.122755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bbfe9-27c0-4336-bba0-8d6d0394d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:37.123143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bbfe9-27c0-4336-bba0-8d6d0394d865 admin admin] PATH_INFO: `/v3/users/dbd9af1299114b3ea580cc2eeef44b1a` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:37.124243 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c657041e-e4d0-4d16-8406-2646fb98e6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd4a443d81e449c8868719ede79c6194'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:37.125661 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0bbfe9-27c0-4336-bba0-8d6d0394d865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd9af1299114b3ea580cc2eeef44b1a)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:37.128053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0bbfe9-27c0-4336-bba0-8d6d0394d865 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:37.139117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c657041e-e4d0-4d16-8406-2646fb98e6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd4a443d81e449c8868719ede79c6194'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:37.140573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:37.173886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c657041e-e4d0-4d16-8406-2646fb98e6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd4a443d81e449c8868719ede79c6194'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:37.184015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c657041e-e4d0-4d16-8406-2646fb98e6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd4a443d81e449c8868719ede79c6194'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:37.185263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c657041e-e4d0-4d16-8406-2646fb98e6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd4a443d81e449c8868719ede79c6194'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:37.193299 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 989/1984] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:36 2022] DELETE /identity/v3/users/bd4a443d81e449c8868719ede79c6194 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:37.198512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439401f5-b9af-4aef-a04d-5fd582bcd5e4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:37.199175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439401f5-b9af-4aef-a04d-5fd582bcd5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:37.199678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439401f5-b9af-4aef-a04d-5fd582bcd5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:37.228596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-439401f5-b9af-4aef-a04d-5fd582bcd5e4 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:37.230935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-439401f5-b9af-4aef-a04d-5fd582bcd5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:37.242456 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0c0bbfe9-27c0-4336-bba0-8d6d0394d865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd9af1299114b3ea580cc2eeef44b1a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:37.243074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0c0bbfe9-27c0-4336-bba0-8d6d0394d865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd9af1299114b3ea580cc2eeef44b1a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:37.255492 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0c0bbfe9-27c0-4336-bba0-8d6d0394d865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd9af1299114b3ea580cc2eeef44b1a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:37.292865 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0c0bbfe9-27c0-4336-bba0-8d6d0394d865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd9af1299114b3ea580cc2eeef44b1a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:37.306556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0c0bbfe9-27c0-4336-bba0-8d6d0394d865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd9af1299114b3ea580cc2eeef44b1a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:37.332922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 996/1985] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:36 2022] DELETE /identity/v3/users/dbd9af1299114b3ea580cc2eeef44b1a => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:37.335046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d71e04-fe84-4e86-8d92-ee0fb46ab53e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:37.335614 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d71e04-fe84-4e86-8d92-ee0fb46ab53e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:37.335997 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d71e04-fe84-4e86-8d92-ee0fb46ab53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:37.388094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 990/1986] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:37.388320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a1d71e04-fe84-4e86-8d92-ee0fb46ab53e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:37.388320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a1d71e04-fe84-4e86-8d92-ee0fb46ab53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:37.413204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439401f5-b9af-4aef-a04d-5fd582bcd5e4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:37.415347 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-439401f5-b9af-4aef-a04d-5fd582bcd5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:37.450277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:37.502502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439401f5-b9af-4aef-a04d-5fd582bcd5e4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:37.513304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 997/1987] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:37.539927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d71e04-fe84-4e86-8d92-ee0fb46ab53e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:37.588196 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ca310-5a1b-491a-99a0-a7b13a3819dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:37.589105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ca310-5a1b-491a-99a0-a7b13a3819dc service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:37.590048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ca310-5a1b-491a-99a0-a7b13a3819dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:37.590458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ca310-5a1b-491a-99a0-a7b13a3819dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:37.605272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ca310-5a1b-491a-99a0-a7b13a3819dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:37.607293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ca310-5a1b-491a-99a0-a7b13a3819dc service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:37.619780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 991/1988] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:24:37.658084 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d71e04-fe84-4e86-8d92-ee0fb46ab53e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:37.663204 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07096998-85b8-45f9-8bed-25a49736c133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:37.663929 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07096998-85b8-45f9-8bed-25a49736c133 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:37.664310 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07096998-85b8-45f9-8bed-25a49736c133 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:37.664680 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07096998-85b8-45f9-8bed-25a49736c133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:37.690329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07096998-85b8-45f9-8bed-25a49736c133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:37.691845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07096998-85b8-45f9-8bed-25a49736c133 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:37.703347 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 998/1989] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:38.147635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ca310-5a1b-491a-99a0-a7b13a3819dc service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:38.149921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e63ca310-5a1b-491a-99a0-a7b13a3819dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:38.164453 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ca310-5a1b-491a-99a0-a7b13a3819dc service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:38.171070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45433cb-bc34-4b88-bc9a-43f304adf328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:38.172081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45433cb-bc34-4b88-bc9a-43f304adf328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:38.172513 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45433cb-bc34-4b88-bc9a-43f304adf328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:38.172932 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45433cb-bc34-4b88-bc9a-43f304adf328 admin admin] PATH_INFO: `/v3/projects/29bbaa42b8604cebb5a412f71df8e78f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:38.175871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45433cb-bc34-4b88-bc9a-43f304adf328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29bbaa42b8604cebb5a412f71df8e78f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:38.187067 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45433cb-bc34-4b88-bc9a-43f304adf328 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:38.234049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07096998-85b8-45f9-8bed-25a49736c133 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:38.235765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-07096998-85b8-45f9-8bed-25a49736c133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:38.249717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:38.255200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07096998-85b8-45f9-8bed-25a49736c133 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:38.282549 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f45433cb-bc34-4b88-bc9a-43f304adf328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29bbaa42b8604cebb5a412f71df8e78f', 'request_id': 'req-f45433cb-bc34-4b88-bc9a-43f304adf328'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.289638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f45433cb-bc34-4b88-bc9a-43f304adf328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29bbaa42b8604cebb5a412f71df8e78f', 'request_id': 'req-f45433cb-bc34-4b88-bc9a-43f304adf328'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.298611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f45433cb-bc34-4b88-bc9a-43f304adf328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29bbaa42b8604cebb5a412f71df8e78f', 'request_id': 'req-f45433cb-bc34-4b88-bc9a-43f304adf328'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.327089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f45433cb-bc34-4b88-bc9a-43f304adf328 admin admin] The token cache is being invalidate because project 29bbaa42b8604cebb5a412f71df8e78f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:38.327490 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f45433cb-bc34-4b88-bc9a-43f304adf328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.328329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f45433cb-bc34-4b88-bc9a-43f304adf328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.330166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 992/1990] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:38 2022] DELETE /identity/v3/projects/29bbaa42b8604cebb5a412f71df8e78f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:38.333349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81fe35-3269-4c82-b694-a0eb6da34632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:38.334042 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81fe35-3269-4c82-b694-a0eb6da34632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:38.334329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81fe35-3269-4c82-b694-a0eb6da34632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:38.334616 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81fe35-3269-4c82-b694-a0eb6da34632 admin admin] PATH_INFO: `/v3/projects/8c9330f4e9b64647a50750b0ea2f95df` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:38.335509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45433cb-bc34-4b88-bc9a-43f304adf328 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:38.335769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81fe35-3269-4c82-b694-a0eb6da34632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9330f4e9b64647a50750b0ea2f95df)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:38.337998 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81fe35-3269-4c82-b694-a0eb6da34632 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:38.338754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f45433cb-bc34-4b88-bc9a-43f304adf328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:38.355157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45433cb-bc34-4b88-bc9a-43f304adf328 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:38.363258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c492ed8-87f8-4d21-acde-a04aa7cf3b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:38.364089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c492ed8-87f8-4d21-acde-a04aa7cf3b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:38.364766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c492ed8-87f8-4d21-acde-a04aa7cf3b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:38.365314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c492ed8-87f8-4d21-acde-a04aa7cf3b5f admin admin] PATH_INFO: `/v3/users/fb169d6f55ab457181af1f64893d2d07` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:38.367837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c492ed8-87f8-4d21-acde-a04aa7cf3b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb169d6f55ab457181af1f64893d2d07)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:38.370011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c492ed8-87f8-4d21-acde-a04aa7cf3b5f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:38.442194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2d81fe35-3269-4c82-b694-a0eb6da34632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9330f4e9b64647a50750b0ea2f95df', 'request_id': 'req-2d81fe35-3269-4c82-b694-a0eb6da34632'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.457932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2d81fe35-3269-4c82-b694-a0eb6da34632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9330f4e9b64647a50750b0ea2f95df', 'request_id': 'req-2d81fe35-3269-4c82-b694-a0eb6da34632'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.474126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2d81fe35-3269-4c82-b694-a0eb6da34632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9330f4e9b64647a50750b0ea2f95df', 'request_id': 'req-2d81fe35-3269-4c82-b694-a0eb6da34632'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.480745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0c492ed8-87f8-4d21-acde-a04aa7cf3b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb169d6f55ab457181af1f64893d2d07'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.506270 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2d81fe35-3269-4c82-b694-a0eb6da34632 admin admin] The token cache is being invalidate because project 8c9330f4e9b64647a50750b0ea2f95df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:38.506542 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2d81fe35-3269-4c82-b694-a0eb6da34632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.507422 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2d81fe35-3269-4c82-b694-a0eb6da34632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.514782 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 999/1991] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:38 2022] DELETE /identity/v3/projects/8c9330f4e9b64647a50750b0ea2f95df => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:38.518436 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81fe35-3269-4c82-b694-a0eb6da34632 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:38.519159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0c492ed8-87f8-4d21-acde-a04aa7cf3b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb169d6f55ab457181af1f64893d2d07'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.521701 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2d81fe35-3269-4c82-b694-a0eb6da34632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:38.536876 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:38.539546 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0c492ed8-87f8-4d21-acde-a04aa7cf3b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb169d6f55ab457181af1f64893d2d07'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.548919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0c492ed8-87f8-4d21-acde-a04aa7cf3b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb169d6f55ab457181af1f64893d2d07'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.549828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0c492ed8-87f8-4d21-acde-a04aa7cf3b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb169d6f55ab457181af1f64893d2d07'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.558356 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 993/1992] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:38 2022] DELETE /identity/v3/users/fb169d6f55ab457181af1f64893d2d07 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:38.669235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81fe35-3269-4c82-b694-a0eb6da34632 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:38.761644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7d244-7af1-46e8-8cc2-7bfbcdeb1125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:38.762712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d244-7af1-46e8-8cc2-7bfbcdeb1125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:38.763717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d244-7af1-46e8-8cc2-7bfbcdeb1125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:38.764188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d244-7af1-46e8-8cc2-7bfbcdeb1125 admin admin] PATH_INFO: `/v3/users/548bec6f502641b3837f8525b4cc6964` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:38.766129 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7d244-7af1-46e8-8cc2-7bfbcdeb1125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=548bec6f502641b3837f8525b4cc6964)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:38.768517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7d244-7af1-46e8-8cc2-7bfbcdeb1125 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:38.840499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c6d7d244-7af1-46e8-8cc2-7bfbcdeb1125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548bec6f502641b3837f8525b4cc6964'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.842250 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c6d7d244-7af1-46e8-8cc2-7bfbcdeb1125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548bec6f502641b3837f8525b4cc6964'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.856555 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c6d7d244-7af1-46e8-8cc2-7bfbcdeb1125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548bec6f502641b3837f8525b4cc6964'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.874407 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c6d7d244-7af1-46e8-8cc2-7bfbcdeb1125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548bec6f502641b3837f8525b4cc6964'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.885195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c6d7d244-7af1-46e8-8cc2-7bfbcdeb1125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548bec6f502641b3837f8525b4cc6964'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:38.897313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1000/1993] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:38 2022] DELETE /identity/v3/users/548bec6f502641b3837f8525b4cc6964 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:38.984281 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c492ed8-87f8-4d21-acde-a04aa7cf3b5f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:38.986125 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0c492ed8-87f8-4d21-acde-a04aa7cf3b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:39.007349 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c492ed8-87f8-4d21-acde-a04aa7cf3b5f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:39.085874 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6814a01-58e4-4ee6-a054-36ab81e6962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:39.086600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6814a01-58e4-4ee6-a054-36ab81e6962f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.087102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6814a01-58e4-4ee6-a054-36ab81e6962f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.087380 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6814a01-58e4-4ee6-a054-36ab81e6962f admin admin] PATH_INFO: `/v3/projects/55b8af4b009a484083dc41c4ece543dd` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.088599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6814a01-58e4-4ee6-a054-36ab81e6962f admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b8af4b009a484083dc41c4ece543dd)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:39.090651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6814a01-58e4-4ee6-a054-36ab81e6962f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:39.135861 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:39.163350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e6814a01-58e4-4ee6-a054-36ab81e6962f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b8af4b009a484083dc41c4ece543dd', 'request_id': 'req-e6814a01-58e4-4ee6-a054-36ab81e6962f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:39.170506 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e6814a01-58e4-4ee6-a054-36ab81e6962f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b8af4b009a484083dc41c4ece543dd', 'request_id': 'req-e6814a01-58e4-4ee6-a054-36ab81e6962f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:39.178550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e6814a01-58e4-4ee6-a054-36ab81e6962f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b8af4b009a484083dc41c4ece543dd', 'request_id': 'req-e6814a01-58e4-4ee6-a054-36ab81e6962f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:39.197391 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e6814a01-58e4-4ee6-a054-36ab81e6962f admin admin] The token cache is being invalidate because project 55b8af4b009a484083dc41c4ece543dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:39.197791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e6814a01-58e4-4ee6-a054-36ab81e6962f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:39.198744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e6814a01-58e4-4ee6-a054-36ab81e6962f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:39.200835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 994/1994] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:38 2022] DELETE /identity/v3/projects/55b8af4b009a484083dc41c4ece543dd => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:39.206826 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b22117-9ca4-4a3e-a295-841afc3a7cda None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.207114 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b22117-9ca4-4a3e-a295-841afc3a7cda None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.207391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b22117-9ca4-4a3e-a295-841afc3a7cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.229542 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a6b22117-9ca4-4a3e-a295-841afc3a7cda None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:39.230819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a6b22117-9ca4-4a3e-a295-841afc3a7cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:39.259850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6814a01-58e4-4ee6-a054-36ab81e6962f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:39.261967 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e6814a01-58e4-4ee6-a054-36ab81e6962f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:39.268146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:39.317838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1001/1995] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:39.326445 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9697925-f595-4bce-81a8-da59d91b5db6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.327023 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9697925-f595-4bce-81a8-da59d91b5db6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.327220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9697925-f595-4bce-81a8-da59d91b5db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.350498 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6814a01-58e4-4ee6-a054-36ab81e6962f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:39.352162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e9697925-f595-4bce-81a8-da59d91b5db6 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:39.354040 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e9697925-f595-4bce-81a8-da59d91b5db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:39.357697 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f68efe-84b7-4396-b368-d4f6922ac77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:39.358391 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f68efe-84b7-4396-b368-d4f6922ac77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.359406 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f68efe-84b7-4396-b368-d4f6922ac77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.359817 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f68efe-84b7-4396-b368-d4f6922ac77b admin admin] PATH_INFO: `/v3/projects/63f470d51047449581428bd8f9d970ef` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.361446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f68efe-84b7-4396-b368-d4f6922ac77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f470d51047449581428bd8f9d970ef)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:39.363011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1002/1996] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:24:39.363472 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f68efe-84b7-4396-b368-d4f6922ac77b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:39.367147 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9697925-f595-4bce-81a8-da59d91b5db6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:39.376830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9697925-f595-4bce-81a8-da59d91b5db6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:39.382710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c0ed9-2617-41b8-ada0-50982f7ebb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:39.383332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c0ed9-2617-41b8-ada0-50982f7ebb5a admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.383608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c0ed9-2617-41b8-ada0-50982f7ebb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.383882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c0ed9-2617-41b8-ada0-50982f7ebb5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.384537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c0ed9-2617-41b8-ada0-50982f7ebb5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:39.384846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c0ed9-2617-41b8-ada0-50982f7ebb5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:39.386505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c0ed9-2617-41b8-ada0-50982f7ebb5a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:39.404115 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1003/1997] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:24:39.404991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c0ed9-2617-41b8-ada0-50982f7ebb5a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:39.417588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c0ed9-2617-41b8-ada0-50982f7ebb5a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:39.418401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-04f68efe-84b7-4396-b368-d4f6922ac77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f470d51047449581428bd8f9d970ef', 'request_id': 'req-04f68efe-84b7-4396-b368-d4f6922ac77b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:39.424529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-04f68efe-84b7-4396-b368-d4f6922ac77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f470d51047449581428bd8f9d970ef', 'request_id': 'req-04f68efe-84b7-4396-b368-d4f6922ac77b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:39.431717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-04f68efe-84b7-4396-b368-d4f6922ac77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f470d51047449581428bd8f9d970ef', 'request_id': 'req-04f68efe-84b7-4396-b368-d4f6922ac77b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:39.445706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-04f68efe-84b7-4396-b368-d4f6922ac77b admin admin] The token cache is being invalidate because project 63f470d51047449581428bd8f9d970ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:39.446004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-04f68efe-84b7-4396-b368-d4f6922ac77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:39.446691 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-04f68efe-84b7-4396-b368-d4f6922ac77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:39.448243 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 995/1998] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:39 2022] DELETE /identity/v3/projects/63f470d51047449581428bd8f9d970ef => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:39.452966 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1700a-484e-4a04-8419-71f93f71a7c9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.453248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1700a-484e-4a04-8419-71f93f71a7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.453520 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1700a-484e-4a04-8419-71f93f71a7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.475041 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-16c1700a-484e-4a04-8419-71f93f71a7c9 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:39.476301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-16c1700a-484e-4a04-8419-71f93f71a7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:39.486856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc2849-57db-422e-b57a-135931a3ad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:39.487471 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc2849-57db-422e-b57a-135931a3ad7f admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.487899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc2849-57db-422e-b57a-135931a3ad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.488272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc2849-57db-422e-b57a-135931a3ad7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.489008 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc2849-57db-422e-b57a-135931a3ad7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:39.490917 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc2849-57db-422e-b57a-135931a3ad7f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:39.524281 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:39.530652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1004/1999] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:39 2022] POST /identity/v3/projects => generated 361 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:39.535474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc2849-57db-422e-b57a-135931a3ad7f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:39.537179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2cbc2849-57db-422e-b57a-135931a3ad7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:39.549243 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 996/2000] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:39.558039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbd1ea-9a6d-4bbd-99dd-e7eee9d2a8ec None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.558329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbd1ea-9a6d-4bbd-99dd-e7eee9d2a8ec None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.558606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbd1ea-9a6d-4bbd-99dd-e7eee9d2a8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.584455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0cdbd1ea-9a6d-4bbd-99dd-e7eee9d2a8ec None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:39.585705 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0cdbd1ea-9a6d-4bbd-99dd-e7eee9d2a8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:39.630335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc2849-57db-422e-b57a-135931a3ad7f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:39.637796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb21d14-dad8-4dbb-a45e-9e05dd2fc2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:39.638470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb21d14-dad8-4dbb-a45e-9e05dd2fc2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.638758 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb21d14-dad8-4dbb-a45e-9e05dd2fc2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.639069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb21d14-dad8-4dbb-a45e-9e05dd2fc2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.639660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb21d14-dad8-4dbb-a45e-9e05dd2fc2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:39.641538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb21d14-dad8-4dbb-a45e-9e05dd2fc2f2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:39.651434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 997/2001] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:39.655714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbd1ea-9a6d-4bbd-99dd-e7eee9d2a8ec None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:39.665796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbd1ea-9a6d-4bbd-99dd-e7eee9d2a8ec None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:39.670839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1005/2002] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:39 2022] POST /identity/v3/users => generated 281 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:24:39.671944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb21d14-dad8-4dbb-a45e-9e05dd2fc2f2 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:39.672608 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101aed5-33bb-483e-82c0-6b57e9e1ae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:39.673224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101aed5-33bb-483e-82c0-6b57e9e1ae7b admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.673507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101aed5-33bb-483e-82c0-6b57e9e1ae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.673842 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101aed5-33bb-483e-82c0-6b57e9e1ae7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.674486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101aed5-33bb-483e-82c0-6b57e9e1ae7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:39.674791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101aed5-33bb-483e-82c0-6b57e9e1ae7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:39.676953 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101aed5-33bb-483e-82c0-6b57e9e1ae7b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:39.684466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb21d14-dad8-4dbb-a45e-9e05dd2fc2f2 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:39.690410 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cff55-8710-4f68-a585-c201c57ac273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:39.691753 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cff55-8710-4f68-a585-c201c57ac273 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.692279 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cff55-8710-4f68-a585-c201c57ac273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.696770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cff55-8710-4f68-a585-c201c57ac273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.696903 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 998/2003] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:24:39.696999 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cff55-8710-4f68-a585-c201c57ac273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:39.696999 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cff55-8710-4f68-a585-c201c57ac273 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:39.697795 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101aed5-33bb-483e-82c0-6b57e9e1ae7b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:39.707518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1006/2004] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:39.708557 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101aed5-33bb-483e-82c0-6b57e9e1ae7b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:39.711146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cff55-8710-4f68-a585-c201c57ac273 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:39.713735 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e129fc-3bef-443a-a7d9-749e58d1ace6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:39.714569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e129fc-3bef-443a-a7d9-749e58d1ace6 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.714765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e129fc-3bef-443a-a7d9-749e58d1ace6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.715040 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e129fc-3bef-443a-a7d9-749e58d1ace6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.715673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e129fc-3bef-443a-a7d9-749e58d1ace6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:39.718681 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e129fc-3bef-443a-a7d9-749e58d1ace6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:39.736971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cff55-8710-4f68-a585-c201c57ac273 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:39.742831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191cba-03c1-418a-ad6a-94078fe74af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:39.743446 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191cba-03c1-418a-ad6a-94078fe74af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.744186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191cba-03c1-418a-ad6a-94078fe74af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.744622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191cba-03c1-418a-ad6a-94078fe74af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.745262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93191cba-03c1-418a-ad6a-94078fe74af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:39.746943 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93191cba-03c1-418a-ad6a-94078fe74af2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:39.757958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 999/2005] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:39 2022] POST /identity/v3/projects => generated 389 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:24:39.761799 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1007/2006] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:39.762815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e129fc-3bef-443a-a7d9-749e58d1ace6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:39.763001 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191cba-03c1-418a-ad6a-94078fe74af2 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:39.773897 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191cba-03c1-418a-ad6a-94078fe74af2 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:39.787927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:39.844597 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e129fc-3bef-443a-a7d9-749e58d1ace6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:39.854609 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d885ac-f81c-4deb-bd3e-5effe6d6a10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:39.855141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a5146-357b-4535-8fa9-c01a70cf97e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:39.855302 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d885ac-f81c-4deb-bd3e-5effe6d6a10c admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.855610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d885ac-f81c-4deb-bd3e-5effe6d6a10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.855871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d885ac-f81c-4deb-bd3e-5effe6d6a10c admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.856220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a5146-357b-4535-8fa9-c01a70cf97e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.856523 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d885ac-f81c-4deb-bd3e-5effe6d6a10c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:39.856713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a5146-357b-4535-8fa9-c01a70cf97e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.857085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a5146-357b-4535-8fa9-c01a70cf97e2 admin admin] PATH_INFO: `/v3/projects/1be4648449584e099efd3564c51dc720/users/12175ea68575410d97a6926f3836d83f/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.858583 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d885ac-f81c-4deb-bd3e-5effe6d6a10c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:39.876168 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a5146-357b-4535-8fa9-c01a70cf97e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be4648449584e099efd3564c51dc720, user_id=12175ea68575410d97a6926f3836d83f, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:39.879968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a5146-357b-4535-8fa9-c01a70cf97e2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:39.886568 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1000/2007] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:39 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:39.890692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d885ac-f81c-4deb-bd3e-5effe6d6a10c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:39.893737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1008/2008] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:39 2022] PUT /identity/v3/projects/1be4648449584e099efd3564c51dc720/users/12175ea68575410d97a6926f3836d83f/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:39.902895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d885ac-f81c-4deb-bd3e-5effe6d6a10c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:39.905335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a0611-a404-4f5f-a810-a0aab07ab94b None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.905705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a0611-a404-4f5f-a810-a0aab07ab94b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.906214 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a0611-a404-4f5f-a810-a0aab07ab94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.937481 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a26a0611-a404-4f5f-a810-a0aab07ab94b None None] MFA Rules not processed for user `12175ea68575410d97a6926f3836d83f`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:39.938826 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a26a0611-a404-4f5f-a810-a0aab07ab94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:39.947467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:39.966105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a35be-76aa-4a15-b260-76b8ec5a0ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:39.966742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a35be-76aa-4a15-b260-76b8ec5a0ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:39.967121 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a35be-76aa-4a15-b260-76b8ec5a0ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:39.967314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a35be-76aa-4a15-b260-76b8ec5a0ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:39.967955 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a35be-76aa-4a15-b260-76b8ec5a0ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:39.969736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a35be-76aa-4a15-b260-76b8ec5a0ee2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:39.980601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1001/2009] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:39.984446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a35be-76aa-4a15-b260-76b8ec5a0ee2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:39.995552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a35be-76aa-4a15-b260-76b8ec5a0ee2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:40.000456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3274655-3408-4f59-8319-784aa7a3c363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:40.001049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3274655-3408-4f59-8319-784aa7a3c363 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.001331 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3274655-3408-4f59-8319-784aa7a3c363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.001606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3274655-3408-4f59-8319-784aa7a3c363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.002279 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3274655-3408-4f59-8319-784aa7a3c363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:40.004010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3274655-3408-4f59-8319-784aa7a3c363 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:40.010833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1009/2010] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:24:40.018796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1002/2011] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:40.025413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a0611-a404-4f5f-a810-a0aab07ab94b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:40.037806 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a0611-a404-4f5f-a810-a0aab07ab94b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:40.042537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d4a9d-9663-4401-83e7-d3254a548ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:40.043545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d4a9d-9663-4401-83e7-d3254a548ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.043825 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d4a9d-9663-4401-83e7-d3254a548ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.044097 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d4a9d-9663-4401-83e7-d3254a548ae2 admin admin] PATH_INFO: `/v3/projects/17455bd4a8424a03af4edd5a85b0cba0/users/a73e34897d934a5ead4343c8639c0613/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.051890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3274655-3408-4f59-8319-784aa7a3c363 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:40.055304 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e3274655-3408-4f59-8319-784aa7a3c363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:40.064646 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d4a9d-9663-4401-83e7-d3254a548ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17455bd4a8424a03af4edd5a85b0cba0, user_id=a73e34897d934a5ead4343c8639c0613, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:40.068083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d4a9d-9663-4401-83e7-d3254a548ae2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:40.083617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1010/2012] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:40 2022] PUT /identity/v3/projects/17455bd4a8424a03af4edd5a85b0cba0/users/a73e34897d934a5ead4343c8639c0613/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:40.085991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d4a9d-9663-4401-83e7-d3254a548ae2 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:40.086453 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1e8d4a9d-9663-4401-83e7-d3254a548ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:40.125290 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3274655-3408-4f59-8319-784aa7a3c363 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:40.154027 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:40.161306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d4a9d-9663-4401-83e7-d3254a548ae2 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:40.167034 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cad90-b92e-4f13-902e-263406c3d6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:40.167682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cad90-b92e-4f13-902e-263406c3d6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.167989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cad90-b92e-4f13-902e-263406c3d6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.168295 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cad90-b92e-4f13-902e-263406c3d6c9 admin admin] PATH_INFO: `/v3/users/af5ede371e3448638f86f6b553b4ef34` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.169446 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cad90-b92e-4f13-902e-263406c3d6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5ede371e3448638f86f6b553b4ef34)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:40.171452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cad90-b92e-4f13-902e-263406c3d6c9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:40.182891 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473adabf-505b-4486-9bfc-98347c3d4d28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:40.183516 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473adabf-505b-4486-9bfc-98347c3d4d28 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.183799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473adabf-505b-4486-9bfc-98347c3d4d28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.184217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473adabf-505b-4486-9bfc-98347c3d4d28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.224515 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dd4cad90-b92e-4f13-902e-263406c3d6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5ede371e3448638f86f6b553b4ef34'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:40.225352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dd4cad90-b92e-4f13-902e-263406c3d6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5ede371e3448638f86f6b553b4ef34'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:40.235175 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dd4cad90-b92e-4f13-902e-263406c3d6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5ede371e3448638f86f6b553b4ef34'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:40.249163 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dd4cad90-b92e-4f13-902e-263406c3d6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5ede371e3448638f86f6b553b4ef34'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:40.257308 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dd4cad90-b92e-4f13-902e-263406c3d6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5ede371e3448638f86f6b553b4ef34'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:40.257554 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473adabf-505b-4486-9bfc-98347c3d4d28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:40.259685 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473adabf-505b-4486-9bfc-98347c3d4d28 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:40.264017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1011/2013] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:40 2022] DELETE /identity/v3/users/af5ede371e3448638f86f6b553b4ef34 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:40.265823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d392f-dd5c-4db1-a049-ae1d8270aaa0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.266217 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d392f-dd5c-4db1-a049-ae1d8270aaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.266584 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d392f-dd5c-4db1-a049-ae1d8270aaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.274701 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1003/2014] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:40.276548 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119da61-b24e-412d-9c75-7844714d19a2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.277000 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119da61-b24e-412d-9c75-7844714d19a2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.277591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119da61-b24e-412d-9c75-7844714d19a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.301001 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-600d392f-dd5c-4db1-a049-ae1d8270aaa0 None None] MFA Rules not processed for user `a73e34897d934a5ead4343c8639c0613`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:40.302476 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-600d392f-dd5c-4db1-a049-ae1d8270aaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:40.308513 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4119da61-b24e-412d-9c75-7844714d19a2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:40.309706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4119da61-b24e-412d-9c75-7844714d19a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:40.347431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:40.374803 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1012/2015] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:40.381453 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1004/2016] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:40.381605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d392f-dd5c-4db1-a049-ae1d8270aaa0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:40.381724 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119da61-b24e-412d-9c75-7844714d19a2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:40.381724 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4119da61-b24e-412d-9c75-7844714d19a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:40.386256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-600d392f-dd5c-4db1-a049-ae1d8270aaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:40.396981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119da61-b24e-412d-9c75-7844714d19a2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:40.400953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d392f-dd5c-4db1-a049-ae1d8270aaa0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:40.407123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ace13-1a00-4213-bab3-57ac3728a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:40.407426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc9c71-be4f-48b3-9cdf-735a3d598ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:40.408030 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc9c71-be4f-48b3-9cdf-735a3d598ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.408133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ace13-1a00-4213-bab3-57ac3728a783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.408309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc9c71-be4f-48b3-9cdf-735a3d598ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.408581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc9c71-be4f-48b3-9cdf-735a3d598ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.408724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ace13-1a00-4213-bab3-57ac3728a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.409179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ace13-1a00-4213-bab3-57ac3728a783 admin admin] PATH_INFO: `/v3/users/12175ea68575410d97a6926f3836d83f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.409275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc9c71-be4f-48b3-9cdf-735a3d598ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:40.411071 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ace13-1a00-4213-bab3-57ac3728a783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12175ea68575410d97a6926f3836d83f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:40.411774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc9c71-be4f-48b3-9cdf-735a3d598ab2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:40.414466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ace13-1a00-4213-bab3-57ac3728a783 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:40.454960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1005/2017] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:40 2022] POST /identity/v3/projects => generated 389 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:24:40.455626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc9c71-be4f-48b3-9cdf-735a3d598ab2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:40.459926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a1dc9c71-be4f-48b3-9cdf-735a3d598ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:40.479422 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed2ace13-1a00-4213-bab3-57ac3728a783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12175ea68575410d97a6926f3836d83f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:40.480422 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed2ace13-1a00-4213-bab3-57ac3728a783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12175ea68575410d97a6926f3836d83f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:40.491981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed2ace13-1a00-4213-bab3-57ac3728a783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12175ea68575410d97a6926f3836d83f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:40.497917 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:40.515707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed2ace13-1a00-4213-bab3-57ac3728a783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12175ea68575410d97a6926f3836d83f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:40.524391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed2ace13-1a00-4213-bab3-57ac3728a783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12175ea68575410d97a6926f3836d83f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:40.532202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc9c71-be4f-48b3-9cdf-735a3d598ab2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:40.532411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1013/2018] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:40 2022] DELETE /identity/v3/users/12175ea68575410d97a6926f3836d83f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:40.538662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ace13-1a00-4213-bab3-57ac3728a783 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:40.540136 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ed2ace13-1a00-4213-bab3-57ac3728a783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:40.595081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ee86a-942b-460d-95ca-543913eb5c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:40.596029 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ee86a-942b-460d-95ca-543913eb5c31 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.596352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ee86a-942b-460d-95ca-543913eb5c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.596627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ee86a-942b-460d-95ca-543913eb5c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.599333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-542ee86a-942b-460d-95ca-543913eb5c31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:40.630624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ace13-1a00-4213-bab3-57ac3728a783 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:40.637051 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d803a2b-7394-4d11-806c-1ccbac99501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:40.637700 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d803a2b-7394-4d11-806c-1ccbac99501a admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.638793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d803a2b-7394-4d11-806c-1ccbac99501a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.639071 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d803a2b-7394-4d11-806c-1ccbac99501a admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.640138 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d803a2b-7394-4d11-806c-1ccbac99501a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:40.642403 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d803a2b-7394-4d11-806c-1ccbac99501a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:40.668415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1014/2019] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:40 2022] POST /identity/v3/users => generated 301 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:40.669559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c185-3832-4094-be4a-d86cf6e4a7f8 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.669933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c185-3832-4094-be4a-d86cf6e4a7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.670201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c185-3832-4094-be4a-d86cf6e4a7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.693392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-9356c185-3832-4094-be4a-d86cf6e4a7f8 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:40.695073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9356c185-3832-4094-be4a-d86cf6e4a7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:40.700470 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ee86a-942b-460d-95ca-543913eb5c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:40.702237 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ee86a-942b-460d-95ca-543913eb5c31 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:40.707153 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1015/2020] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:40.709868 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356c185-3832-4094-be4a-d86cf6e4a7f8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:40.718052 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1006/2021] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:40.720048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ee86a-942b-460d-95ca-543913eb5c31 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:40.721194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356c185-3832-4094-be4a-d86cf6e4a7f8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:40.721567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-542ee86a-942b-460d-95ca-543913eb5c31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:40.730332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3662894-785a-488a-a892-3790a8942f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:40.731406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662894-785a-488a-a892-3790a8942f66 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.731406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662894-785a-488a-a892-3790a8942f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.732194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662894-785a-488a-a892-3790a8942f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.732872 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3662894-785a-488a-a892-3790a8942f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:40.735261 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3662894-785a-488a-a892-3790a8942f66 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:40.739437 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ee86a-942b-460d-95ca-543913eb5c31 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:40.746274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe3609-8fae-45d6-a516-80b7aaa725f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:40.747105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe3609-8fae-45d6-a516-80b7aaa725f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.747105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe3609-8fae-45d6-a516-80b7aaa725f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.747716 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe3609-8fae-45d6-a516-80b7aaa725f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.752089 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1016/2022] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:40.760543 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3662894-785a-488a-a892-3790a8942f66 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:40.762305 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe3609-8fae-45d6-a516-80b7aaa725f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:40.764186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe3609-8fae-45d6-a516-80b7aaa725f5 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:40.771609 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3662894-785a-488a-a892-3790a8942f66 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:40.777598 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e12064-79a4-4eba-9add-7c673e533fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:40.778382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e12064-79a4-4eba-9add-7c673e533fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.778602 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e12064-79a4-4eba-9add-7c673e533fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.778875 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e12064-79a4-4eba-9add-7c673e533fa1 admin admin] PATH_INFO: `/v3/projects/8e069783ef824f319f5c473af5cf6692/users/0dffebf32286439eaad3dabed00560e9/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.785882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1007/2023] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:24:40.799373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e12064-79a4-4eba-9add-7c673e533fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e069783ef824f319f5c473af5cf6692, user_id=0dffebf32286439eaad3dabed00560e9, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:40.804165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e12064-79a4-4eba-9add-7c673e533fa1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:40.820713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1017/2024] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:40 2022] PUT /identity/v3/projects/8e069783ef824f319f5c473af5cf6692/users/0dffebf32286439eaad3dabed00560e9/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:40.824875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe3609-8fae-45d6-a516-80b7aaa725f5 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:40.838829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe3609-8fae-45d6-a516-80b7aaa725f5 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:40.846211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:40.910800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51a055-7138-4d1e-a796-05cbfb4a88d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:40.911426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51a055-7138-4d1e-a796-05cbfb4a88d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.912911 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51a055-7138-4d1e-a796-05cbfb4a88d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.912911 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51a055-7138-4d1e-a796-05cbfb4a88d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.912911 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51a055-7138-4d1e-a796-05cbfb4a88d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:40.915240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51a055-7138-4d1e-a796-05cbfb4a88d8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:40.929716 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1008/2025] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:40.933103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e12064-79a4-4eba-9add-7c673e533fa1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:40.948143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e12064-79a4-4eba-9add-7c673e533fa1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:40.955533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed35515-6b70-4097-9ac0-e4809ff720aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:40.956801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed35515-6b70-4097-9ac0-e4809ff720aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.956801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed35515-6b70-4097-9ac0-e4809ff720aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.956801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed35515-6b70-4097-9ac0-e4809ff720aa admin admin] PATH_INFO: `/v3/projects/8e069783ef824f319f5c473af5cf6692/users/0dffebf32286439eaad3dabed00560e9/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:40.959180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed35515-6b70-4097-9ac0-e4809ff720aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e069783ef824f319f5c473af5cf6692, user_id=0dffebf32286439eaad3dabed00560e9, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:40.962576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed35515-6b70-4097-9ac0-e4809ff720aa admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:40.975846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1018/2026] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:40 2022] PUT /identity/v3/projects/8e069783ef824f319f5c473af5cf6692/users/0dffebf32286439eaad3dabed00560e9/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:40.989574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c381e-d9d3-409b-985b-1a6893e32a5c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:40.991567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c381e-d9d3-409b-985b-1a6893e32a5c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:40.991864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c381e-d9d3-409b-985b-1a6893e32a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:41.043517 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-191c381e-d9d3-409b-985b-1a6893e32a5c None None] MFA Rules not processed for user `0dffebf32286439eaad3dabed00560e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:41.044481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-191c381e-d9d3-409b-985b-1a6893e32a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:41.159117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1009/2027] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:40 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:41.167121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed35515-6b70-4097-9ac0-e4809ff720aa admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:41.168836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3ed35515-6b70-4097-9ac0-e4809ff720aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:41.229358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed35515-6b70-4097-9ac0-e4809ff720aa admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:41.233091 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64062122-12e4-4386-906d-0e8afb8de660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:41.233748 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64062122-12e4-4386-906d-0e8afb8de660 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:41.234038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64062122-12e4-4386-906d-0e8afb8de660 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:41.234313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64062122-12e4-4386-906d-0e8afb8de660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:41.244392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64062122-12e4-4386-906d-0e8afb8de660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:41.245893 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64062122-12e4-4386-906d-0e8afb8de660 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:41.256157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1019/2028] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:41.400534 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c381e-d9d3-409b-985b-1a6893e32a5c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:41.431858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64062122-12e4-4386-906d-0e8afb8de660 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:41.431858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-64062122-12e4-4386-906d-0e8afb8de660 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:41.448640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:41.473924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c381e-d9d3-409b-985b-1a6893e32a5c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:41.479702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a5c10-4d86-4774-8586-3a205a9da7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:41.480622 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a5c10-4d86-4774-8586-3a205a9da7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:41.481832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a5c10-4d86-4774-8586-3a205a9da7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:41.481832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a5c10-4d86-4774-8586-3a205a9da7e9 admin admin] PATH_INFO: `/v3/users/a73e34897d934a5ead4343c8639c0613` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:41.482450 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a5c10-4d86-4774-8586-3a205a9da7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73e34897d934a5ead4343c8639c0613)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:41.485267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a5c10-4d86-4774-8586-3a205a9da7e9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:41.532171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:41.554605 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f42a5c10-4d86-4774-8586-3a205a9da7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73e34897d934a5ead4343c8639c0613'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:41.558801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64062122-12e4-4386-906d-0e8afb8de660 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:41.563120 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f42a5c10-4d86-4774-8586-3a205a9da7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73e34897d934a5ead4343c8639c0613'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:41.565032 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03e607-4886-4b28-a7f6-cc293c5dc47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:41.565753 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03e607-4886-4b28-a7f6-cc293c5dc47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:41.566052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03e607-4886-4b28-a7f6-cc293c5dc47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:41.566356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03e607-4886-4b28-a7f6-cc293c5dc47e admin admin] PATH_INFO: `/v3/projects/c7f764d71c9845849a31cae247be10bd` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:41.567707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03e607-4886-4b28-a7f6-cc293c5dc47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f764d71c9845849a31cae247be10bd)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:41.569637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03e607-4886-4b28-a7f6-cc293c5dc47e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:41.589082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f42a5c10-4d86-4774-8586-3a205a9da7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73e34897d934a5ead4343c8639c0613'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:41.606742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f42a5c10-4d86-4774-8586-3a205a9da7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73e34897d934a5ead4343c8639c0613'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:41.607565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f42a5c10-4d86-4774-8586-3a205a9da7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73e34897d934a5ead4343c8639c0613'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:41.614688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1010/2029] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:41 2022] DELETE /identity/v3/users/a73e34897d934a5ead4343c8639c0613 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:41.618291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a5c10-4d86-4774-8586-3a205a9da7e9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:41.620071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f42a5c10-4d86-4774-8586-3a205a9da7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:41.634751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0a03e607-4886-4b28-a7f6-cc293c5dc47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f764d71c9845849a31cae247be10bd', 'request_id': 'req-0a03e607-4886-4b28-a7f6-cc293c5dc47e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:41.641708 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0a03e607-4886-4b28-a7f6-cc293c5dc47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f764d71c9845849a31cae247be10bd', 'request_id': 'req-0a03e607-4886-4b28-a7f6-cc293c5dc47e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:41.649662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0a03e607-4886-4b28-a7f6-cc293c5dc47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f764d71c9845849a31cae247be10bd', 'request_id': 'req-0a03e607-4886-4b28-a7f6-cc293c5dc47e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:41.664146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0a03e607-4886-4b28-a7f6-cc293c5dc47e admin admin] The token cache is being invalidate because project c7f764d71c9845849a31cae247be10bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:41.664576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0a03e607-4886-4b28-a7f6-cc293c5dc47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:41.665228 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0a03e607-4886-4b28-a7f6-cc293c5dc47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:41.669949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1020/2030] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:41 2022] DELETE /identity/v3/projects/c7f764d71c9845849a31cae247be10bd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:41.669949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26339d12-7630-4d7d-ab75-a8658b15eeb0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:41.669949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26339d12-7630-4d7d-ab75-a8658b15eeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:41.669949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26339d12-7630-4d7d-ab75-a8658b15eeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:41.689828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-26339d12-7630-4d7d-ab75-a8658b15eeb0 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:41.691224 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-26339d12-7630-4d7d-ab75-a8658b15eeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:41.698436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a5c10-4d86-4774-8586-3a205a9da7e9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:41.757533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1021/2031] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:41.758743 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90efbc-7505-4cf5-90d4-49d31e2ad90c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:41.759374 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90efbc-7505-4cf5-90d4-49d31e2ad90c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:41.759717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90efbc-7505-4cf5-90d4-49d31e2ad90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:41.760778 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad03548-e75a-4237-b33c-9710fe7b8846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:41.761568 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad03548-e75a-4237-b33c-9710fe7b8846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:41.761945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad03548-e75a-4237-b33c-9710fe7b8846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:41.762289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad03548-e75a-4237-b33c-9710fe7b8846 admin admin] PATH_INFO: `/v3/projects/1be4648449584e099efd3564c51dc720` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:41.763492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad03548-e75a-4237-b33c-9710fe7b8846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be4648449584e099efd3564c51dc720)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:41.765656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad03548-e75a-4237-b33c-9710fe7b8846 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:41.780037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ff90efbc-7505-4cf5-90d4-49d31e2ad90c None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:41.781393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ff90efbc-7505-4cf5-90d4-49d31e2ad90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:41.795006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1022/2032] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:41.795006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90efbc-7505-4cf5-90d4-49d31e2ad90c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:41.795006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ff90efbc-7505-4cf5-90d4-49d31e2ad90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:41.821836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1ad03548-e75a-4237-b33c-9710fe7b8846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be4648449584e099efd3564c51dc720', 'request_id': 'req-1ad03548-e75a-4237-b33c-9710fe7b8846'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:41.827437 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1ad03548-e75a-4237-b33c-9710fe7b8846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be4648449584e099efd3564c51dc720', 'request_id': 'req-1ad03548-e75a-4237-b33c-9710fe7b8846'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:41.828501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:41.838665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1ad03548-e75a-4237-b33c-9710fe7b8846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be4648449584e099efd3564c51dc720', 'request_id': 'req-1ad03548-e75a-4237-b33c-9710fe7b8846'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:41.848322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:41.854438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1ad03548-e75a-4237-b33c-9710fe7b8846 admin admin] The token cache is being invalidate because project 1be4648449584e099efd3564c51dc720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:41.854815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1ad03548-e75a-4237-b33c-9710fe7b8846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:41.855468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1ad03548-e75a-4237-b33c-9710fe7b8846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:41.858311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1011/2033] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:41 2022] DELETE /identity/v3/projects/1be4648449584e099efd3564c51dc720 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:41.867375 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab7b1b-6812-4e75-a682-113d007fff16 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:41.867935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab7b1b-6812-4e75-a682-113d007fff16 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:41.868606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab7b1b-6812-4e75-a682-113d007fff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:41.890090 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90efbc-7505-4cf5-90d4-49d31e2ad90c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:41.915448 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9bab7b1b-6812-4e75-a682-113d007fff16 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:41.924965 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9bab7b1b-6812-4e75-a682-113d007fff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:41.971132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28669435-1718-4ef9-a9be-841265a65358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:41.973207 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28669435-1718-4ef9-a9be-841265a65358 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:41.974079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28669435-1718-4ef9-a9be-841265a65358 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:41.976223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28669435-1718-4ef9-a9be-841265a65358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:41.978697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-28669435-1718-4ef9-a9be-841265a65358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:42.074243 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1012/2034] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:42.075441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab7b1b-6812-4e75-a682-113d007fff16 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:42.078642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28669435-1718-4ef9-a9be-841265a65358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:42.080679 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28669435-1718-4ef9-a9be-841265a65358 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:42.086667 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab7b1b-6812-4e75-a682-113d007fff16 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:42.094631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1023/2035] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:42.098485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413b304-4b2f-4395-ab81-470b96df9709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:42.100162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b304-4b2f-4395-ab81-470b96df9709 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:42.100162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b304-4b2f-4395-ab81-470b96df9709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:42.100162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b304-4b2f-4395-ab81-470b96df9709 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:42.100435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413b304-4b2f-4395-ab81-470b96df9709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:42.100648 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413b304-4b2f-4395-ab81-470b96df9709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:42.102229 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413b304-4b2f-4395-ab81-470b96df9709 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:42.119027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1013/2036] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:24:42.120291 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28669435-1718-4ef9-a9be-841265a65358 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:42.130878 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28669435-1718-4ef9-a9be-841265a65358 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:42.136740 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f196c-67f1-4456-aad3-96a93916eb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:42.137465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f196c-67f1-4456-aad3-96a93916eb40 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:42.137673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f196c-67f1-4456-aad3-96a93916eb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:42.137964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f196c-67f1-4456-aad3-96a93916eb40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:42.138608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f196c-67f1-4456-aad3-96a93916eb40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:42.140799 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f196c-67f1-4456-aad3-96a93916eb40 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:42.185754 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1024/2037] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:42 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:42.185963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413b304-4b2f-4395-ab81-470b96df9709 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:42.193178 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413b304-4b2f-4395-ab81-470b96df9709 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:42.279360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5246f7-073b-43c6-a4ed-964260dbd21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:42.279981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5246f7-073b-43c6-a4ed-964260dbd21a admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:42.280262 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5246f7-073b-43c6-a4ed-964260dbd21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:42.280535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5246f7-073b-43c6-a4ed-964260dbd21a admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:42.281188 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5246f7-073b-43c6-a4ed-964260dbd21a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:42.283150 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5246f7-073b-43c6-a4ed-964260dbd21a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:42.326370 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1014/2038] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:42 2022] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:42.330662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f196c-67f1-4456-aad3-96a93916eb40 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:42.341746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f196c-67f1-4456-aad3-96a93916eb40 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:42.350376 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f8f4f-0231-4fbc-8789-7ecfb9bcbe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:42.350994 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f8f4f-0231-4fbc-8789-7ecfb9bcbe76 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:42.351273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f8f4f-0231-4fbc-8789-7ecfb9bcbe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:42.351543 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f8f4f-0231-4fbc-8789-7ecfb9bcbe76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:42.352185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f8f4f-0231-4fbc-8789-7ecfb9bcbe76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:42.353812 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f8f4f-0231-4fbc-8789-7ecfb9bcbe76 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:42.366738 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1025/2039] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:42.370745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5246f7-073b-43c6-a4ed-964260dbd21a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:42.382127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5246f7-073b-43c6-a4ed-964260dbd21a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:42.387610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74679ace-401d-4478-a95c-c186df6b3799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:42.388223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74679ace-401d-4478-a95c-c186df6b3799 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:42.388504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74679ace-401d-4478-a95c-c186df6b3799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:42.388778 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74679ace-401d-4478-a95c-c186df6b3799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:42.389422 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74679ace-401d-4478-a95c-c186df6b3799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:42.391179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74679ace-401d-4478-a95c-c186df6b3799 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:42.403220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1015/2040] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:42.407505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f8f4f-0231-4fbc-8789-7ecfb9bcbe76 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:42.426433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f8f4f-0231-4fbc-8789-7ecfb9bcbe76 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:42.436710 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be06f6d-b65b-4442-aab7-a06b01d946bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:42.437660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be06f6d-b65b-4442-aab7-a06b01d946bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:42.437983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be06f6d-b65b-4442-aab7-a06b01d946bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:42.438354 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be06f6d-b65b-4442-aab7-a06b01d946bd admin admin] PATH_INFO: `/v3/projects/626285bbe1394090aeeaf108d4131075/users/90cc785cd63744b597899e458a25366b/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:42.449922 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74679ace-401d-4478-a95c-c186df6b3799 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:42.452057 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-74679ace-401d-4478-a95c-c186df6b3799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:42.465595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74679ace-401d-4478-a95c-c186df6b3799 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:42.467724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be06f6d-b65b-4442-aab7-a06b01d946bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=626285bbe1394090aeeaf108d4131075, user_id=90cc785cd63744b597899e458a25366b, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:42.470621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:42.471255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:42.471542 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:42.472620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1 admin admin] PATH_INFO: `/v3/projects/17455bd4a8424a03af4edd5a85b0cba0` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:42.473951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be06f6d-b65b-4442-aab7-a06b01d946bd admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:42.474092 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17455bd4a8424a03af4edd5a85b0cba0)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:42.476702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:42.501253 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1026/2041] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:42 2022] PUT /identity/v3/projects/626285bbe1394090aeeaf108d4131075/users/90cc785cd63744b597899e458a25366b/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:42.505670 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c02d3-8f8d-4394-9f18-9edc34e97c85 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:42.505985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c02d3-8f8d-4394-9f18-9edc34e97c85 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:42.506261 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c02d3-8f8d-4394-9f18-9edc34e97c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:42.544832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:42.546882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-804c02d3-8f8d-4394-9f18-9edc34e97c85 None None] MFA Rules not processed for user `90cc785cd63744b597899e458a25366b`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:42.548113 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-804c02d3-8f8d-4394-9f18-9edc34e97c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:42.552203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17455bd4a8424a03af4edd5a85b0cba0', 'request_id': 'req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:42.567321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17455bd4a8424a03af4edd5a85b0cba0', 'request_id': 'req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:42.578761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17455bd4a8424a03af4edd5a85b0cba0', 'request_id': 'req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:42.602805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1 admin admin] The token cache is being invalidate because project 17455bd4a8424a03af4edd5a85b0cba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:42.603434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:42.604117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:42.604516 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:42.606700 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1016/2042] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:42 2022] DELETE /identity/v3/projects/17455bd4a8424a03af4edd5a85b0cba0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:42.610431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:42.614201 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:42.655673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1027/2043] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:42.665823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c02d3-8f8d-4394-9f18-9edc34e97c85 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:42.667563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-804c02d3-8f8d-4394-9f18-9edc34e97c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:42.707694 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cefe0-c9d2-433a-a32c-3b337b9ccfe1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:42.713427 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f69966-0054-4dae-abd4-68ea8d3c7039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:42.714467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f69966-0054-4dae-abd4-68ea8d3c7039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:42.714731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f69966-0054-4dae-abd4-68ea8d3c7039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:42.715069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f69966-0054-4dae-abd4-68ea8d3c7039 admin admin] PATH_INFO: `/v3/users/0dffebf32286439eaad3dabed00560e9` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:42.716358 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f69966-0054-4dae-abd4-68ea8d3c7039 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dffebf32286439eaad3dabed00560e9)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:42.718545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f69966-0054-4dae-abd4-68ea8d3c7039 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:42.775180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c02d3-8f8d-4394-9f18-9edc34e97c85 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:42.780654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18ff77-dbe6-4f42-b1b4-aebfaf3393cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:42.781338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18ff77-dbe6-4f42-b1b4-aebfaf3393cd service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:42.782458 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18ff77-dbe6-4f42-b1b4-aebfaf3393cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:42.782740 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18ff77-dbe6-4f42-b1b4-aebfaf3393cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:42.802545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18ff77-dbe6-4f42-b1b4-aebfaf3393cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:42.806371 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18ff77-dbe6-4f42-b1b4-aebfaf3393cd service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:42.813650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-77f69966-0054-4dae-abd4-68ea8d3c7039 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dffebf32286439eaad3dabed00560e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:42.825296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1028/2044] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:24:42.825529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-77f69966-0054-4dae-abd4-68ea8d3c7039 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dffebf32286439eaad3dabed00560e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:42.846026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-77f69966-0054-4dae-abd4-68ea8d3c7039 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dffebf32286439eaad3dabed00560e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:42.856094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-77f69966-0054-4dae-abd4-68ea8d3c7039 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dffebf32286439eaad3dabed00560e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:42.856873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-77f69966-0054-4dae-abd4-68ea8d3c7039 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dffebf32286439eaad3dabed00560e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:42.864042 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1017/2045] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:42 2022] DELETE /identity/v3/users/0dffebf32286439eaad3dabed00560e9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:43.298046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18ff77-dbe6-4f42-b1b4-aebfaf3393cd service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:43.319829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18ff77-dbe6-4f42-b1b4-aebfaf3393cd service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:43.485733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39893fd-b575-4fdb-abfd-67551b512850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:43.486931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39893fd-b575-4fdb-abfd-67551b512850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:43.487220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39893fd-b575-4fdb-abfd-67551b512850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:43.487525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39893fd-b575-4fdb-abfd-67551b512850 admin admin] PATH_INFO: `/v3/projects/8e069783ef824f319f5c473af5cf6692` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:43.489401 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39893fd-b575-4fdb-abfd-67551b512850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e069783ef824f319f5c473af5cf6692)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:43.491546 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39893fd-b575-4fdb-abfd-67551b512850 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:43.561871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b39893fd-b575-4fdb-abfd-67551b512850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e069783ef824f319f5c473af5cf6692', 'request_id': 'req-b39893fd-b575-4fdb-abfd-67551b512850'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:43.570507 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b39893fd-b575-4fdb-abfd-67551b512850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e069783ef824f319f5c473af5cf6692', 'request_id': 'req-b39893fd-b575-4fdb-abfd-67551b512850'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:43.577285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b39893fd-b575-4fdb-abfd-67551b512850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e069783ef824f319f5c473af5cf6692', 'request_id': 'req-b39893fd-b575-4fdb-abfd-67551b512850'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:43.591825 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b39893fd-b575-4fdb-abfd-67551b512850 admin admin] The token cache is being invalidate because project 8e069783ef824f319f5c473af5cf6692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:43.592175 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b39893fd-b575-4fdb-abfd-67551b512850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:43.593962 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b39893fd-b575-4fdb-abfd-67551b512850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:43.599342 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1029/2046] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:43 2022] DELETE /identity/v3/projects/8e069783ef824f319f5c473af5cf6692 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:43.601092 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a88487-c5cd-4517-9602-355fa934721f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:43.601539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a88487-c5cd-4517-9602-355fa934721f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:43.601786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a88487-c5cd-4517-9602-355fa934721f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:43.625884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f7a88487-c5cd-4517-9602-355fa934721f None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:43.627130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f7a88487-c5cd-4517-9602-355fa934721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:43.681577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:43.697833 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1018/2047] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:43.704584 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8141c69-f144-4c63-b0e4-421a5cd8e8e0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:43.704866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8141c69-f144-4c63-b0e4-421a5cd8e8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:43.705140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8141c69-f144-4c63-b0e4-421a5cd8e8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:43.729561 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-c8141c69-f144-4c63-b0e4-421a5cd8e8e0 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:43.730930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c8141c69-f144-4c63-b0e4-421a5cd8e8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:43.742867 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1030/2048] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:43.747367 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a88487-c5cd-4517-9602-355fa934721f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:43.759584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a88487-c5cd-4517-9602-355fa934721f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:43.768618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9e816-e198-4806-88af-d90a5b254c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:43.770305 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9e816-e198-4806-88af-d90a5b254c34 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:43.770597 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9e816-e198-4806-88af-d90a5b254c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:43.770906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9e816-e198-4806-88af-d90a5b254c34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:43.771639 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9e816-e198-4806-88af-d90a5b254c34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:43.772037 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9e816-e198-4806-88af-d90a5b254c34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:43.773859 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9e816-e198-4806-88af-d90a5b254c34 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:43.792119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1019/2049] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:24:43.793257 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8141c69-f144-4c63-b0e4-421a5cd8e8e0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:43.797650 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:43.813028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8141c69-f144-4c63-b0e4-421a5cd8e8e0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:43.821990 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84700516-7e48-49f4-baa7-4485278095d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:43.822670 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84700516-7e48-49f4-baa7-4485278095d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:43.823054 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84700516-7e48-49f4-baa7-4485278095d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:43.823585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84700516-7e48-49f4-baa7-4485278095d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:43.824317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84700516-7e48-49f4-baa7-4485278095d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:43.827426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84700516-7e48-49f4-baa7-4485278095d8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:43.869733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1031/2050] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:43 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:43.874086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9e816-e198-4806-88af-d90a5b254c34 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:43.885384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9e816-e198-4806-88af-d90a5b254c34 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:43.944199 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40193bc0-a6f5-45c9-94f1-6cc17ece252a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:43.945018 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40193bc0-a6f5-45c9-94f1-6cc17ece252a admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:43.945471 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40193bc0-a6f5-45c9-94f1-6cc17ece252a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:43.945922 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40193bc0-a6f5-45c9-94f1-6cc17ece252a admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:43.946742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40193bc0-a6f5-45c9-94f1-6cc17ece252a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:43.948666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40193bc0-a6f5-45c9-94f1-6cc17ece252a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:43.970492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1020/2051] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:43 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:24:43.974946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84700516-7e48-49f4-baa7-4485278095d8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:43.985916 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84700516-7e48-49f4-baa7-4485278095d8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:43.992267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad810e-f0f9-4dcf-b93d-69f2a4a39707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:43.992884 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad810e-f0f9-4dcf-b93d-69f2a4a39707 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:43.993167 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad810e-f0f9-4dcf-b93d-69f2a4a39707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:43.993441 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad810e-f0f9-4dcf-b93d-69f2a4a39707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:43.994134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad810e-f0f9-4dcf-b93d-69f2a4a39707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:43.995822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad810e-f0f9-4dcf-b93d-69f2a4a39707 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:44.009736 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1032/2052] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:44.010865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40193bc0-a6f5-45c9-94f1-6cc17ece252a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:44.021627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40193bc0-a6f5-45c9-94f1-6cc17ece252a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:44.026238 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a25dc4-d960-4fcf-a5d3-40e2adfd6c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:44.026835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a25dc4-d960-4fcf-a5d3-40e2adfd6c45 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:44.027115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a25dc4-d960-4fcf-a5d3-40e2adfd6c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:44.027391 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a25dc4-d960-4fcf-a5d3-40e2adfd6c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:44.028027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a25dc4-d960-4fcf-a5d3-40e2adfd6c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:44.029618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a25dc4-d960-4fcf-a5d3-40e2adfd6c45 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:44.040425 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1021/2053] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:44.044660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad810e-f0f9-4dcf-b93d-69f2a4a39707 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:44.054692 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad810e-f0f9-4dcf-b93d-69f2a4a39707 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:44.059438 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e22c3-6aae-4b78-a3de-46ae0725a5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:44.060209 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e22c3-6aae-4b78-a3de-46ae0725a5dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:44.060525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e22c3-6aae-4b78-a3de-46ae0725a5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:44.060912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e22c3-6aae-4b78-a3de-46ae0725a5dc admin admin] PATH_INFO: `/v3/projects/c15f771d596749d5829f678b05e9861c/users/32d8443f651d400da5f935d4ccbd389b/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:44.077616 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e22c3-6aae-4b78-a3de-46ae0725a5dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15f771d596749d5829f678b05e9861c, user_id=32d8443f651d400da5f935d4ccbd389b, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:44.080207 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e22c3-6aae-4b78-a3de-46ae0725a5dc admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:44.104301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1033/2054] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:44 2022] PUT /identity/v3/projects/c15f771d596749d5829f678b05e9861c/users/32d8443f651d400da5f935d4ccbd389b/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:44.105925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa44a9-9175-4843-a3ab-cb5e68a8cb6e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:44.106213 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa44a9-9175-4843-a3ab-cb5e68a8cb6e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:44.106511 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa44a9-9175-4843-a3ab-cb5e68a8cb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:44.158892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-eaaa44a9-9175-4843-a3ab-cb5e68a8cb6e None None] MFA Rules not processed for user `32d8443f651d400da5f935d4ccbd389b`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:44.160465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-eaaa44a9-9175-4843-a3ab-cb5e68a8cb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:44.248015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1022/2055] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:24:44.252084 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e22c3-6aae-4b78-a3de-46ae0725a5dc admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:44.333105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e22c3-6aae-4b78-a3de-46ae0725a5dc admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:44.337705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227e6d8-09a0-4488-adc5-4a212aebd39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:44.338337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227e6d8-09a0-4488-adc5-4a212aebd39e admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:44.338623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227e6d8-09a0-4488-adc5-4a212aebd39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:44.338896 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227e6d8-09a0-4488-adc5-4a212aebd39e admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:44.339532 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227e6d8-09a0-4488-adc5-4a212aebd39e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:44.341432 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227e6d8-09a0-4488-adc5-4a212aebd39e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:44.369402 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1034/2056] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:44 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:44.373539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa44a9-9175-4843-a3ab-cb5e68a8cb6e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:44.385210 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa44a9-9175-4843-a3ab-cb5e68a8cb6e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:44.444838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:44.453887 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18655829-cc86-42ac-8564-d8f58d92a863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:44.454622 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18655829-cc86-42ac-8564-d8f58d92a863 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:44.454894 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18655829-cc86-42ac-8564-d8f58d92a863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:44.455172 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18655829-cc86-42ac-8564-d8f58d92a863 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:44.456365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18655829-cc86-42ac-8564-d8f58d92a863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:44.459749 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18655829-cc86-42ac-8564-d8f58d92a863 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:44.488048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227e6d8-09a0-4488-adc5-4a212aebd39e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:44.488871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1023/2057] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:44 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:44.516736 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227e6d8-09a0-4488-adc5-4a212aebd39e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:44.532315 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ca785-2e60-4bab-b268-d654f4f7ea5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:44.532970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ca785-2e60-4bab-b268-d654f4f7ea5f admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:44.533217 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ca785-2e60-4bab-b268-d654f4f7ea5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:44.533496 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ca785-2e60-4bab-b268-d654f4f7ea5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:44.534179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ca785-2e60-4bab-b268-d654f4f7ea5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:44.539319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ca785-2e60-4bab-b268-d654f4f7ea5f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:44.562831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1035/2058] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:44.567864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18655829-cc86-42ac-8564-d8f58d92a863 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:44.578805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18655829-cc86-42ac-8564-d8f58d92a863 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:44.584125 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7adeb-5dc7-4818-81f8-cfa7142e9507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:44.584768 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7adeb-5dc7-4818-81f8-cfa7142e9507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:44.585050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7adeb-5dc7-4818-81f8-cfa7142e9507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:44.585320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7adeb-5dc7-4818-81f8-cfa7142e9507 admin admin] PATH_INFO: `/v3/projects/87585d9a2a2c49469b7ec9c5211fc149/users/bc81b7b8326b4b60b5ceb230b11b0af7/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:44.605086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7adeb-5dc7-4818-81f8-cfa7142e9507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87585d9a2a2c49469b7ec9c5211fc149, user_id=bc81b7b8326b4b60b5ceb230b11b0af7, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:44.615975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7adeb-5dc7-4818-81f8-cfa7142e9507 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:44.654870 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1024/2059] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:44 2022] PUT /identity/v3/projects/87585d9a2a2c49469b7ec9c5211fc149/users/bc81b7b8326b4b60b5ceb230b11b0af7/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:44.661632 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ca785-2e60-4bab-b268-d654f4f7ea5f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:44.677502 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ca785-2e60-4bab-b268-d654f4f7ea5f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:44.797198 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a015b-604e-413d-bcfa-c45a85046904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:44.797894 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a015b-604e-413d-bcfa-c45a85046904 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:44.798184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a015b-604e-413d-bcfa-c45a85046904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:44.798438 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a015b-604e-413d-bcfa-c45a85046904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:44.799132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a015b-604e-413d-bcfa-c45a85046904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:44.802009 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a015b-604e-413d-bcfa-c45a85046904 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:44.818033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1036/2060] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:44.822074 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7adeb-5dc7-4818-81f8-cfa7142e9507 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:44.840366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7adeb-5dc7-4818-81f8-cfa7142e9507 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:44.861941 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dc0d6-def8-4f54-bf54-0620953b4b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:44.863371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dc0d6-def8-4f54-bf54-0620953b4b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:44.863656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dc0d6-def8-4f54-bf54-0620953b4b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:44.863929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dc0d6-def8-4f54-bf54-0620953b4b13 admin admin] PATH_INFO: `/v3/projects/87585d9a2a2c49469b7ec9c5211fc149/users/bc81b7b8326b4b60b5ceb230b11b0af7/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:44.869880 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dc0d6-def8-4f54-bf54-0620953b4b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87585d9a2a2c49469b7ec9c5211fc149, user_id=bc81b7b8326b4b60b5ceb230b11b0af7, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:44.872899 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dc0d6-def8-4f54-bf54-0620953b4b13 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:44.901837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1025/2061] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:44 2022] PUT /identity/v3/projects/87585d9a2a2c49469b7ec9c5211fc149/users/bc81b7b8326b4b60b5ceb230b11b0af7/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:44.915307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97f4d-e1cd-4ab8-a294-c9c2335b11e3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:44.915855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97f4d-e1cd-4ab8-a294-c9c2335b11e3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:44.916392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97f4d-e1cd-4ab8-a294-c9c2335b11e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:44.962832 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-47e97f4d-e1cd-4ab8-a294-c9c2335b11e3 None None] MFA Rules not processed for user `bc81b7b8326b4b60b5ceb230b11b0af7`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:44.964124 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-47e97f4d-e1cd-4ab8-a294-c9c2335b11e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:44.968850 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:45.076538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1037/2062] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:45.085859 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dc0d6-def8-4f54-bf54-0620953b4b13 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:45.087920 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6b9dc0d6-def8-4f54-bf54-0620953b4b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:45.197635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dc0d6-def8-4f54-bf54-0620953b4b13 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:45.202144 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f360d54-bde6-4078-806f-d71b6104ab31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:45.202784 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f360d54-bde6-4078-806f-d71b6104ab31 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:45.203062 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f360d54-bde6-4078-806f-d71b6104ab31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:45.203327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f360d54-bde6-4078-806f-d71b6104ab31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:45.267785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f360d54-bde6-4078-806f-d71b6104ab31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:45.270032 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f360d54-bde6-4078-806f-d71b6104ab31 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:45.282137 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1026/2063] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:45.360600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e97f4d-e1cd-4ab8-a294-c9c2335b11e3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:45.362208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-47e97f4d-e1cd-4ab8-a294-c9c2335b11e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:45.433286 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e97f4d-e1cd-4ab8-a294-c9c2335b11e3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:45.437884 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c90f0-76d9-47bf-8652-e57907658365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:45.438514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c90f0-76d9-47bf-8652-e57907658365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:45.438791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c90f0-76d9-47bf-8652-e57907658365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:45.439126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c90f0-76d9-47bf-8652-e57907658365 admin admin] PATH_INFO: `/v3/users/19f5565494964b36846b2e81447951a7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:45.440254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c90f0-76d9-47bf-8652-e57907658365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f5565494964b36846b2e81447951a7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:45.442935 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c90f0-76d9-47bf-8652-e57907658365 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:45.498220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-447c90f0-76d9-47bf-8652-e57907658365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f5565494964b36846b2e81447951a7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:45.498864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-447c90f0-76d9-47bf-8652-e57907658365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f5565494964b36846b2e81447951a7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:45.507711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-447c90f0-76d9-47bf-8652-e57907658365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f5565494964b36846b2e81447951a7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:45.521346 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-447c90f0-76d9-47bf-8652-e57907658365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f5565494964b36846b2e81447951a7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:45.528016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-447c90f0-76d9-47bf-8652-e57907658365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f5565494964b36846b2e81447951a7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:45.534030 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1038/2064] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:45 2022] DELETE /identity/v3/users/19f5565494964b36846b2e81447951a7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:45.738808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f360d54-bde6-4078-806f-d71b6104ab31 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:45.750430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f360d54-bde6-4078-806f-d71b6104ab31 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:45.805322 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:45.812465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac7af0-535c-4b4f-b728-5986e0154c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:45.813451 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac7af0-535c-4b4f-b728-5986e0154c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:45.813798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac7af0-535c-4b4f-b728-5986e0154c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:45.814335 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac7af0-535c-4b4f-b728-5986e0154c47 admin admin] PATH_INFO: `/v3/projects/d10b70d718744a3c99f8a859ef2de494` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:45.816336 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac7af0-535c-4b4f-b728-5986e0154c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10b70d718744a3c99f8a859ef2de494)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:45.818650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac7af0-535c-4b4f-b728-5986e0154c47 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:45.866504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d2ac7af0-535c-4b4f-b728-5986e0154c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10b70d718744a3c99f8a859ef2de494', 'request_id': 'req-d2ac7af0-535c-4b4f-b728-5986e0154c47'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:45.872111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d2ac7af0-535c-4b4f-b728-5986e0154c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10b70d718744a3c99f8a859ef2de494', 'request_id': 'req-d2ac7af0-535c-4b4f-b728-5986e0154c47'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:45.879607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d2ac7af0-535c-4b4f-b728-5986e0154c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10b70d718744a3c99f8a859ef2de494', 'request_id': 'req-d2ac7af0-535c-4b4f-b728-5986e0154c47'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:45.893168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d2ac7af0-535c-4b4f-b728-5986e0154c47 admin admin] The token cache is being invalidate because project d10b70d718744a3c99f8a859ef2de494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:45.893476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d2ac7af0-535c-4b4f-b728-5986e0154c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:45.894171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d2ac7af0-535c-4b4f-b728-5986e0154c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:45.895904 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1027/2065] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:45 2022] DELETE /identity/v3/projects/d10b70d718744a3c99f8a859ef2de494 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:45.907445 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c7552-abc4-40dd-b011-cc88fca103c1 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:45.907573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c7552-abc4-40dd-b011-cc88fca103c1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:45.907848 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c7552-abc4-40dd-b011-cc88fca103c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:45.941309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-796c7552-abc4-40dd-b011-cc88fca103c1 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:45.942829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-796c7552-abc4-40dd-b011-cc88fca103c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:45.957879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:46.013427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1039/2066] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:46.020743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b050ee-6434-48c0-b1e9-ee5b7ab88b04 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:46.021025 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b050ee-6434-48c0-b1e9-ee5b7ab88b04 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:46.021278 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b050ee-6434-48c0-b1e9-ee5b7ab88b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:46.041886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-81b050ee-6434-48c0-b1e9-ee5b7ab88b04 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:46.043080 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-81b050ee-6434-48c0-b1e9-ee5b7ab88b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:46.052551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1028/2067] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:46.057003 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c7552-abc4-40dd-b011-cc88fca103c1 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:46.068340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c7552-abc4-40dd-b011-cc88fca103c1 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:46.072711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8743c4-172e-4eac-be62-526414d81a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:46.073325 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8743c4-172e-4eac-be62-526414d81a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:46.073632 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8743c4-172e-4eac-be62-526414d81a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:46.074162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8743c4-172e-4eac-be62-526414d81a3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:46.074830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8743c4-172e-4eac-be62-526414d81a3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:46.075283 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8743c4-172e-4eac-be62-526414d81a3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:46.076971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8743c4-172e-4eac-be62-526414d81a3e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:46.089856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1040/2068] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:24:46.094665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b050ee-6434-48c0-b1e9-ee5b7ab88b04 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:46.105031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b050ee-6434-48c0-b1e9-ee5b7ab88b04 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:46.109764 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636da3ee-b395-4f3a-84f1-959dc0df443d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:46.110499 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636da3ee-b395-4f3a-84f1-959dc0df443d admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:46.111301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636da3ee-b395-4f3a-84f1-959dc0df443d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:46.111301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636da3ee-b395-4f3a-84f1-959dc0df443d admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:46.111933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636da3ee-b395-4f3a-84f1-959dc0df443d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:46.114441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636da3ee-b395-4f3a-84f1-959dc0df443d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:46.145177 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1029/2069] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:46 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:24:46.149268 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8743c4-172e-4eac-be62-526414d81a3e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:46.159188 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8743c4-172e-4eac-be62-526414d81a3e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:46.217458 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54850b7-e0d9-457f-a5fa-0d0272d5222e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:46.218099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54850b7-e0d9-457f-a5fa-0d0272d5222e admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:46.218380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54850b7-e0d9-457f-a5fa-0d0272d5222e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:46.218706 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54850b7-e0d9-457f-a5fa-0d0272d5222e admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:46.219346 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54850b7-e0d9-457f-a5fa-0d0272d5222e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:46.221320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54850b7-e0d9-457f-a5fa-0d0272d5222e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:46.243423 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1041/2070] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:46 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:46.247591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636da3ee-b395-4f3a-84f1-959dc0df443d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:46.258039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636da3ee-b395-4f3a-84f1-959dc0df443d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:46.262606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0802f6-1813-4316-aa29-a4f12d1ec861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:46.263233 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0802f6-1813-4316-aa29-a4f12d1ec861 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:46.263474 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0802f6-1813-4316-aa29-a4f12d1ec861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:46.263762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0802f6-1813-4316-aa29-a4f12d1ec861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:46.264398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0802f6-1813-4316-aa29-a4f12d1ec861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:46.266256 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0802f6-1813-4316-aa29-a4f12d1ec861 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:46.277076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1030/2071] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:46.281169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54850b7-e0d9-457f-a5fa-0d0272d5222e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:46.292538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54850b7-e0d9-457f-a5fa-0d0272d5222e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:46.298183 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cfd9b-f5e2-401b-918b-2db770cd19e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:46.298760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cfd9b-f5e2-401b-918b-2db770cd19e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:46.299048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cfd9b-f5e2-401b-918b-2db770cd19e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:46.299348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cfd9b-f5e2-401b-918b-2db770cd19e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:46.300536 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cfd9b-f5e2-401b-918b-2db770cd19e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:46.302429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cfd9b-f5e2-401b-918b-2db770cd19e9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:46.312276 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1042/2072] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:46.316963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0802f6-1813-4316-aa29-a4f12d1ec861 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:46.327804 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0802f6-1813-4316-aa29-a4f12d1ec861 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:46.332824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35b00a-937e-4ae2-9417-8968e9678e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:46.333468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35b00a-937e-4ae2-9417-8968e9678e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:46.333782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35b00a-937e-4ae2-9417-8968e9678e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:46.334061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35b00a-937e-4ae2-9417-8968e9678e72 admin admin] PATH_INFO: `/v3/projects/6c9770a7e871492f8323c85ebb3a2134/users/1eb8daf646c748cfb3c970e151175dc7/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:46.349418 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35b00a-937e-4ae2-9417-8968e9678e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9770a7e871492f8323c85ebb3a2134, user_id=1eb8daf646c748cfb3c970e151175dc7, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:46.352085 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35b00a-937e-4ae2-9417-8968e9678e72 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:46.365898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1031/2073] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:46 2022] PUT /identity/v3/projects/6c9770a7e871492f8323c85ebb3a2134/users/1eb8daf646c748cfb3c970e151175dc7/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:46.375923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92b1d5-e071-4640-8469-b0f1e8f9681a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:46.376149 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92b1d5-e071-4640-8469-b0f1e8f9681a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:46.376429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92b1d5-e071-4640-8469-b0f1e8f9681a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:46.405909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6f92b1d5-e071-4640-8469-b0f1e8f9681a None None] MFA Rules not processed for user `1eb8daf646c748cfb3c970e151175dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:46.407130 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6f92b1d5-e071-4640-8469-b0f1e8f9681a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:46.471125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1043/2074] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:46.476714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35b00a-937e-4ae2-9417-8968e9678e72 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:46.537078 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35b00a-937e-4ae2-9417-8968e9678e72 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:46.541733 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27311d2-b41e-4f9a-947a-9cfabd087ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:46.542337 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27311d2-b41e-4f9a-947a-9cfabd087ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:46.542613 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27311d2-b41e-4f9a-947a-9cfabd087ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:46.542885 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27311d2-b41e-4f9a-947a-9cfabd087ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:46.543516 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27311d2-b41e-4f9a-947a-9cfabd087ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:46.545402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27311d2-b41e-4f9a-947a-9cfabd087ae9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:46.571360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1032/2075] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:46 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:46.575441 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92b1d5-e071-4640-8469-b0f1e8f9681a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:46.586768 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92b1d5-e071-4640-8469-b0f1e8f9681a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:46.599581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:46.645415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76327c0-48d7-48f1-8870-704d6f1fff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:46.645976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76327c0-48d7-48f1-8870-704d6f1fff98 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:46.646260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76327c0-48d7-48f1-8870-704d6f1fff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:46.646563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76327c0-48d7-48f1-8870-704d6f1fff98 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:46.647190 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76327c0-48d7-48f1-8870-704d6f1fff98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:46.649122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76327c0-48d7-48f1-8870-704d6f1fff98 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:46.672388 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1044/2076] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:46 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:46.678219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27311d2-b41e-4f9a-947a-9cfabd087ae9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:46.689674 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27311d2-b41e-4f9a-947a-9cfabd087ae9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:46.694737 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39b026-9a5a-4d65-ae73-a06548a6bb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:46.695385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39b026-9a5a-4d65-ae73-a06548a6bb86 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:46.695613 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39b026-9a5a-4d65-ae73-a06548a6bb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:46.696058 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39b026-9a5a-4d65-ae73-a06548a6bb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:46.696511 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39b026-9a5a-4d65-ae73-a06548a6bb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:46.698134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39b026-9a5a-4d65-ae73-a06548a6bb86 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:46.700357 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:46.711377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1033/2077] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:46.715260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76327c0-48d7-48f1-8870-704d6f1fff98 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:46.727030 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76327c0-48d7-48f1-8870-704d6f1fff98 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:46.732303 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bea1a-46ad-46e2-b457-2f8f9963aaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:46.732977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bea1a-46ad-46e2-b457-2f8f9963aaa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:46.733254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bea1a-46ad-46e2-b457-2f8f9963aaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:46.733547 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bea1a-46ad-46e2-b457-2f8f9963aaa7 admin admin] PATH_INFO: `/v3/projects/fc9cb3b16f64467594eee353f43da7cf/users/1ee5ea4818264ee08231b4b381887767/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:46.749036 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bea1a-46ad-46e2-b457-2f8f9963aaa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9cb3b16f64467594eee353f43da7cf, user_id=1ee5ea4818264ee08231b4b381887767, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:46.751802 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bea1a-46ad-46e2-b457-2f8f9963aaa7 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:46.765332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1045/2078] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:46 2022] PUT /identity/v3/projects/fc9cb3b16f64467594eee353f43da7cf/users/1ee5ea4818264ee08231b4b381887767/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:46.770458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39b026-9a5a-4d65-ae73-a06548a6bb86 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:46.780541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39b026-9a5a-4d65-ae73-a06548a6bb86 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:46.837812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf6337-a599-4802-a7a5-231a9105f9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:46.838494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf6337-a599-4802-a7a5-231a9105f9ab admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:46.838782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf6337-a599-4802-a7a5-231a9105f9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:46.839058 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf6337-a599-4802-a7a5-231a9105f9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:46.839699 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf6337-a599-4802-a7a5-231a9105f9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:46.841277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf6337-a599-4802-a7a5-231a9105f9ab admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:46.854549 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1034/2079] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:46.855843 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bea1a-46ad-46e2-b457-2f8f9963aaa7 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:46.866444 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bea1a-46ad-46e2-b457-2f8f9963aaa7 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:46.871033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3334b-9a8f-417a-b076-cc9aafec8072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:46.871743 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3334b-9a8f-417a-b076-cc9aafec8072 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:46.872126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3334b-9a8f-417a-b076-cc9aafec8072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:46.872427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3334b-9a8f-417a-b076-cc9aafec8072 admin admin] PATH_INFO: `/v3/projects/fc9cb3b16f64467594eee353f43da7cf/users/1ee5ea4818264ee08231b4b381887767/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:46.874420 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3334b-9a8f-417a-b076-cc9aafec8072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9cb3b16f64467594eee353f43da7cf, user_id=1ee5ea4818264ee08231b4b381887767, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:46.877119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3334b-9a8f-417a-b076-cc9aafec8072 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:46.888184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1046/2080] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:46 2022] PUT /identity/v3/projects/fc9cb3b16f64467594eee353f43da7cf/users/1ee5ea4818264ee08231b4b381887767/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:46.901093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7188bbc-0309-46f5-9ea0-78b57a5896fe None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:46.901705 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7188bbc-0309-46f5-9ea0-78b57a5896fe None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:46.901993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7188bbc-0309-46f5-9ea0-78b57a5896fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:46.931158 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b7188bbc-0309-46f5-9ea0-78b57a5896fe None None] MFA Rules not processed for user `1ee5ea4818264ee08231b4b381887767`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:46.932375 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b7188bbc-0309-46f5-9ea0-78b57a5896fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:47.033600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1035/2081] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:47.046240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3334b-9a8f-417a-b076-cc9aafec8072 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:47.048273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e1d3334b-9a8f-417a-b076-cc9aafec8072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:47.140780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3334b-9a8f-417a-b076-cc9aafec8072 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:47.145671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876872a-1d4d-4e6e-b8da-da6b7d4c0648 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:47.146350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876872a-1d4d-4e6e-b8da-da6b7d4c0648 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:47.146576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876872a-1d4d-4e6e-b8da-da6b7d4c0648 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:47.146841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876872a-1d4d-4e6e-b8da-da6b7d4c0648 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:47.156846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876872a-1d4d-4e6e-b8da-da6b7d4c0648 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:47.158333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876872a-1d4d-4e6e-b8da-da6b7d4c0648 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:47.168501 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1047/2082] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:47.631818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7188bbc-0309-46f5-9ea0-78b57a5896fe None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:47.701309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7188bbc-0309-46f5-9ea0-78b57a5896fe None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:47.705919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9fc95-7bd6-402d-9aec-391ae72bb68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:47.707315 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9fc95-7bd6-402d-9aec-391ae72bb68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:47.707616 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9fc95-7bd6-402d-9aec-391ae72bb68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:47.707980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9fc95-7bd6-402d-9aec-391ae72bb68b admin admin] PATH_INFO: `/v3/users/1eb8daf646c748cfb3c970e151175dc7` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:47.709128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9fc95-7bd6-402d-9aec-391ae72bb68b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb8daf646c748cfb3c970e151175dc7)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:47.711093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9fc95-7bd6-402d-9aec-391ae72bb68b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:47.733356 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:47.757702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dae9fc95-7bd6-402d-9aec-391ae72bb68b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb8daf646c748cfb3c970e151175dc7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:47.765010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dae9fc95-7bd6-402d-9aec-391ae72bb68b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb8daf646c748cfb3c970e151175dc7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:47.778117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dae9fc95-7bd6-402d-9aec-391ae72bb68b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb8daf646c748cfb3c970e151175dc7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:47.785103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dae9fc95-7bd6-402d-9aec-391ae72bb68b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb8daf646c748cfb3c970e151175dc7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:47.785795 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dae9fc95-7bd6-402d-9aec-391ae72bb68b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb8daf646c748cfb3c970e151175dc7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:47.791671 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1036/2083] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:47 2022] DELETE /identity/v3/users/1eb8daf646c748cfb3c970e151175dc7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:47.796127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aee727-575f-4b5d-9ebe-a885df0b8b30 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:47.796565 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aee727-575f-4b5d-9ebe-a885df0b8b30 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:47.796673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aee727-575f-4b5d-9ebe-a885df0b8b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:47.816209 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d6aee727-575f-4b5d-9ebe-a885df0b8b30 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:47.817673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d6aee727-575f-4b5d-9ebe-a885df0b8b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:47.874579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1048/2084] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:47.885386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9fc95-7bd6-402d-9aec-391ae72bb68b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:47.886926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-dae9fc95-7bd6-402d-9aec-391ae72bb68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:47.946479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9fc95-7bd6-402d-9aec-391ae72bb68b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:47.950052 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac440-46cf-4311-9a62-c9ed3f777604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:47.950707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac440-46cf-4311-9a62-c9ed3f777604 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:47.950928 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac440-46cf-4311-9a62-c9ed3f777604 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:47.951197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac440-46cf-4311-9a62-c9ed3f777604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:47.960077 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bac440-46cf-4311-9a62-c9ed3f777604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:47.961493 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bac440-46cf-4311-9a62-c9ed3f777604 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:47.970721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1037/2085] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:24:48.275083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aee727-575f-4b5d-9ebe-a885df0b8b30 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:48.277026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d6aee727-575f-4b5d-9ebe-a885df0b8b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:48.287468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac440-46cf-4311-9a62-c9ed3f777604 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:48.289134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-08bac440-46cf-4311-9a62-c9ed3f777604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:48.309997 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aee727-575f-4b5d-9ebe-a885df0b8b30 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:48.316420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac440-46cf-4311-9a62-c9ed3f777604 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:48.316665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5134bc-1e90-426b-8582-196d7d703357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:48.317464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5134bc-1e90-426b-8582-196d7d703357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:48.317773 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5134bc-1e90-426b-8582-196d7d703357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:48.318171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5134bc-1e90-426b-8582-196d7d703357 admin admin] PATH_INFO: `/v3/projects/6c9770a7e871492f8323c85ebb3a2134` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:48.319186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5134bc-1e90-426b-8582-196d7d703357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9770a7e871492f8323c85ebb3a2134)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:48.321075 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5134bc-1e90-426b-8582-196d7d703357 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:48.323579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd13b7-aaf7-4be9-a789-622d49d8c6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:48.324412 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd13b7-aaf7-4be9-a789-622d49d8c6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:48.324910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd13b7-aaf7-4be9-a789-622d49d8c6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:48.325283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd13b7-aaf7-4be9-a789-622d49d8c6a9 admin admin] PATH_INFO: `/v3/users/90cc785cd63744b597899e458a25366b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:48.327472 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd13b7-aaf7-4be9-a789-622d49d8c6a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90cc785cd63744b597899e458a25366b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:48.328164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:48.331660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd13b7-aaf7-4be9-a789-622d49d8c6a9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:48.398503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fb5134bc-1e90-426b-8582-196d7d703357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9770a7e871492f8323c85ebb3a2134', 'request_id': 'req-fb5134bc-1e90-426b-8582-196d7d703357'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:48.405050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d7dd13b7-aaf7-4be9-a789-622d49d8c6a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90cc785cd63744b597899e458a25366b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:48.405478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fb5134bc-1e90-426b-8582-196d7d703357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9770a7e871492f8323c85ebb3a2134', 'request_id': 'req-fb5134bc-1e90-426b-8582-196d7d703357'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:48.414009 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fb5134bc-1e90-426b-8582-196d7d703357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9770a7e871492f8323c85ebb3a2134', 'request_id': 'req-fb5134bc-1e90-426b-8582-196d7d703357'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:48.415110 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d7dd13b7-aaf7-4be9-a789-622d49d8c6a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90cc785cd63744b597899e458a25366b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:48.432207 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fb5134bc-1e90-426b-8582-196d7d703357 admin admin] The token cache is being invalidate because project 6c9770a7e871492f8323c85ebb3a2134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:48.432207 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fb5134bc-1e90-426b-8582-196d7d703357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:48.433072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fb5134bc-1e90-426b-8582-196d7d703357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:48.434929 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1049/2086] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:48 2022] DELETE /identity/v3/projects/6c9770a7e871492f8323c85ebb3a2134 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:48.435273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d7dd13b7-aaf7-4be9-a789-622d49d8c6a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90cc785cd63744b597899e458a25366b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:48.438724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5134bc-1e90-426b-8582-196d7d703357 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:48.440053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fb5134bc-1e90-426b-8582-196d7d703357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:48.448968 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d7dd13b7-aaf7-4be9-a789-622d49d8c6a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90cc785cd63744b597899e458a25366b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:48.450533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d7dd13b7-aaf7-4be9-a789-622d49d8c6a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90cc785cd63744b597899e458a25366b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:48.462344 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1038/2087] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:48 2022] DELETE /identity/v3/users/90cc785cd63744b597899e458a25366b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:48.464360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bec01-5c47-42ab-b6e6-ede55599e6eb None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:48.464691 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bec01-5c47-42ab-b6e6-ede55599e6eb None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:48.465566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bec01-5c47-42ab-b6e6-ede55599e6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:48.490841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d87bec01-5c47-42ab-b6e6-ede55599e6eb None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:48.492417 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d87bec01-5c47-42ab-b6e6-ede55599e6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:48.507935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:48.540645 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5134bc-1e90-426b-8582-196d7d703357 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:48.595293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1039/2088] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:48.606509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bec01-5c47-42ab-b6e6-ede55599e6eb None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:48.608010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d87bec01-5c47-42ab-b6e6-ede55599e6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:48.615161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7625c2b-c9a4-4c34-a05f-ea3468c712a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:48.616660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7625c2b-c9a4-4c34-a05f-ea3468c712a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:48.617096 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7625c2b-c9a4-4c34-a05f-ea3468c712a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:48.617441 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7625c2b-c9a4-4c34-a05f-ea3468c712a9 admin admin] PATH_INFO: `/v3/users/1ee5ea4818264ee08231b4b381887767` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:48.618801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7625c2b-c9a4-4c34-a05f-ea3468c712a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee5ea4818264ee08231b4b381887767)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:48.621002 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7625c2b-c9a4-4c34-a05f-ea3468c712a9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:48.667584 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:48.670664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c7625c2b-c9a4-4c34-a05f-ea3468c712a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee5ea4818264ee08231b4b381887767'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:48.671421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c7625c2b-c9a4-4c34-a05f-ea3468c712a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee5ea4818264ee08231b4b381887767'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:48.677453 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bec01-5c47-42ab-b6e6-ede55599e6eb None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:48.680277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c7625c2b-c9a4-4c34-a05f-ea3468c712a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee5ea4818264ee08231b4b381887767'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:48.681852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cc19b-e49f-4317-b9b8-56a7194160b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:48.682542 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cc19b-e49f-4317-b9b8-56a7194160b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:48.682891 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cc19b-e49f-4317-b9b8-56a7194160b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:48.683168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cc19b-e49f-4317-b9b8-56a7194160b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:48.693074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c7625c2b-c9a4-4c34-a05f-ea3468c712a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee5ea4818264ee08231b4b381887767'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:48.693223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cc19b-e49f-4317-b9b8-56a7194160b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:48.694613 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cc19b-e49f-4317-b9b8-56a7194160b6 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:48.702635 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c7625c2b-c9a4-4c34-a05f-ea3468c712a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee5ea4818264ee08231b4b381887767'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:48.705169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1040/2089] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:48.709606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1050/2090] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:48 2022] DELETE /identity/v3/users/1ee5ea4818264ee08231b4b381887767 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:48.991933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cc19b-e49f-4317-b9b8-56a7194160b6 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:48.992416 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7625c2b-c9a4-4c34-a05f-ea3468c712a9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:48.993714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-552cc19b-e49f-4317-b9b8-56a7194160b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:48.993862 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c7625c2b-c9a4-4c34-a05f-ea3468c712a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:49.007908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cc19b-e49f-4317-b9b8-56a7194160b6 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:49.071432 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e064a0-1837-413d-b165-2cc198708841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:49.072175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e064a0-1837-413d-b165-2cc198708841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:49.072450 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e064a0-1837-413d-b165-2cc198708841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:49.072793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e064a0-1837-413d-b165-2cc198708841 admin admin] PATH_INFO: `/v3/projects/626285bbe1394090aeeaf108d4131075` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:49.074152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e064a0-1837-413d-b165-2cc198708841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=626285bbe1394090aeeaf108d4131075)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:49.076124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e064a0-1837-413d-b165-2cc198708841 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:49.095300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7625c2b-c9a4-4c34-a05f-ea3468c712a9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:49.100418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916bdb3-7de1-4d27-8d6a-fed2238cc4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:49.101055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916bdb3-7de1-4d27-8d6a-fed2238cc4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:49.101338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916bdb3-7de1-4d27-8d6a-fed2238cc4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:49.101613 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916bdb3-7de1-4d27-8d6a-fed2238cc4e4 admin admin] PATH_INFO: `/v3/projects/fc9cb3b16f64467594eee353f43da7cf` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:49.102913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916bdb3-7de1-4d27-8d6a-fed2238cc4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc9cb3b16f64467594eee353f43da7cf)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:49.104842 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916bdb3-7de1-4d27-8d6a-fed2238cc4e4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:49.123389 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b3e064a0-1837-413d-b165-2cc198708841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626285bbe1394090aeeaf108d4131075', 'request_id': 'req-b3e064a0-1837-413d-b165-2cc198708841'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:49.129316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b3e064a0-1837-413d-b165-2cc198708841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626285bbe1394090aeeaf108d4131075', 'request_id': 'req-b3e064a0-1837-413d-b165-2cc198708841'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:49.130436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:49.136101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b3e064a0-1837-413d-b165-2cc198708841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626285bbe1394090aeeaf108d4131075', 'request_id': 'req-b3e064a0-1837-413d-b165-2cc198708841'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:49.151067 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b3e064a0-1837-413d-b165-2cc198708841 admin admin] The token cache is being invalidate because project 626285bbe1394090aeeaf108d4131075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:49.151357 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b3e064a0-1837-413d-b165-2cc198708841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:49.151987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b3e064a0-1837-413d-b165-2cc198708841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:49.153485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1041/2091] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:48 2022] DELETE /identity/v3/projects/626285bbe1394090aeeaf108d4131075 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:49.156441 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2916bdb3-7de1-4d27-8d6a-fed2238cc4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc9cb3b16f64467594eee353f43da7cf', 'request_id': 'req-2916bdb3-7de1-4d27-8d6a-fed2238cc4e4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:49.162690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2916bdb3-7de1-4d27-8d6a-fed2238cc4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc9cb3b16f64467594eee353f43da7cf', 'request_id': 'req-2916bdb3-7de1-4d27-8d6a-fed2238cc4e4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:49.169668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2916bdb3-7de1-4d27-8d6a-fed2238cc4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc9cb3b16f64467594eee353f43da7cf', 'request_id': 'req-2916bdb3-7de1-4d27-8d6a-fed2238cc4e4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:49.184193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2916bdb3-7de1-4d27-8d6a-fed2238cc4e4 admin admin] The token cache is being invalidate because project fc9cb3b16f64467594eee353f43da7cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:49.184487 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2916bdb3-7de1-4d27-8d6a-fed2238cc4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:49.185274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2916bdb3-7de1-4d27-8d6a-fed2238cc4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:49.186939 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1051/2092] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:48 2022] DELETE /identity/v3/projects/fc9cb3b16f64467594eee353f43da7cf => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:49.192608 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333fb77-f85a-4ece-8b73-7d8351865f7c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:49.192895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333fb77-f85a-4ece-8b73-7d8351865f7c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:49.193169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333fb77-f85a-4ece-8b73-7d8351865f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:49.215484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8333fb77-f85a-4ece-8b73-7d8351865f7c None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:49.216739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8333fb77-f85a-4ece-8b73-7d8351865f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:49.284363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1042/2093] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:49.292328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f724a-2a1a-412b-b189-79e090d93c06 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:49.292616 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f724a-2a1a-412b-b189-79e090d93c06 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:49.292889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f724a-2a1a-412b-b189-79e090d93c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:49.313852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-112f724a-2a1a-412b-b189-79e090d93c06 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:49.315117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-112f724a-2a1a-412b-b189-79e090d93c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:49.323785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1052/2094] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:49.328156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333fb77-f85a-4ece-8b73-7d8351865f7c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:49.338970 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333fb77-f85a-4ece-8b73-7d8351865f7c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:49.343695 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14459c5e-6fac-4a09-aa27-4e9fade6fd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:49.344317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14459c5e-6fac-4a09-aa27-4e9fade6fd1b admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:49.344599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14459c5e-6fac-4a09-aa27-4e9fade6fd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:49.344874 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14459c5e-6fac-4a09-aa27-4e9fade6fd1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:49.345557 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14459c5e-6fac-4a09-aa27-4e9fade6fd1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:49.345885 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14459c5e-6fac-4a09-aa27-4e9fade6fd1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:49.348208 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14459c5e-6fac-4a09-aa27-4e9fade6fd1b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:49.360340 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1043/2095] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:24:49.364726 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f724a-2a1a-412b-b189-79e090d93c06 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:49.374030 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f724a-2a1a-412b-b189-79e090d93c06 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:49.379543 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea75ee8-0684-48b0-bb8e-267679866944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:49.380143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea75ee8-0684-48b0-bb8e-267679866944 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:49.380424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea75ee8-0684-48b0-bb8e-267679866944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:49.380694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea75ee8-0684-48b0-bb8e-267679866944 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:49.381322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea75ee8-0684-48b0-bb8e-267679866944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:49.383234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea75ee8-0684-48b0-bb8e-267679866944 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:49.413745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1053/2096] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:49 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:49.415360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14459c5e-6fac-4a09-aa27-4e9fade6fd1b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:49.426030 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14459c5e-6fac-4a09-aa27-4e9fade6fd1b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:49.482641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a06cc4-a64e-4f84-a24a-945453b782fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:49.483249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a06cc4-a64e-4f84-a24a-945453b782fb admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:49.483532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a06cc4-a64e-4f84-a24a-945453b782fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:49.483807 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a06cc4-a64e-4f84-a24a-945453b782fb admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:49.484467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a06cc4-a64e-4f84-a24a-945453b782fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:49.486427 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a06cc4-a64e-4f84-a24a-945453b782fb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:49.509634 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1044/2097] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:49 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:49.513809 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea75ee8-0684-48b0-bb8e-267679866944 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:49.524818 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea75ee8-0684-48b0-bb8e-267679866944 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:49.529526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ac52b-c047-4c1b-bf38-e394f91cad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:49.530163 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac52b-c047-4c1b-bf38-e394f91cad0a admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:49.530444 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac52b-c047-4c1b-bf38-e394f91cad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:49.530717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ac52b-c047-4c1b-bf38-e394f91cad0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:49.531408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ac52b-c047-4c1b-bf38-e394f91cad0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:49.532935 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ac52b-c047-4c1b-bf38-e394f91cad0a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:49.543941 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1054/2098] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:49.547751 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a06cc4-a64e-4f84-a24a-945453b782fb admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:49.558193 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a06cc4-a64e-4f84-a24a-945453b782fb admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:49.562817 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13442122-8101-4fd9-8465-55ad68d97fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:49.563408 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13442122-8101-4fd9-8465-55ad68d97fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:49.563691 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13442122-8101-4fd9-8465-55ad68d97fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:49.563964 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13442122-8101-4fd9-8465-55ad68d97fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:49.564886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13442122-8101-4fd9-8465-55ad68d97fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:49.566442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13442122-8101-4fd9-8465-55ad68d97fcf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:49.578797 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1045/2099] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:49.583976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ac52b-c047-4c1b-bf38-e394f91cad0a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:49.593742 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ac52b-c047-4c1b-bf38-e394f91cad0a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:49.599596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf9912-b202-411c-81d7-1bf73f3160b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:49.600242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf9912-b202-411c-81d7-1bf73f3160b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:49.600546 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf9912-b202-411c-81d7-1bf73f3160b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:49.600816 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf9912-b202-411c-81d7-1bf73f3160b4 admin admin] PATH_INFO: `/v3/projects/d50cde2713b448a19a5c0131ffb2d6ec/users/4ac0e93a056840268a7972e1d1a2f5d6/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:49.609289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:49.618900 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf9912-b202-411c-81d7-1bf73f3160b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50cde2713b448a19a5c0131ffb2d6ec, user_id=4ac0e93a056840268a7972e1d1a2f5d6, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:49.621920 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf9912-b202-411c-81d7-1bf73f3160b4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:49.635300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1055/2100] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:49 2022] PUT /identity/v3/projects/d50cde2713b448a19a5c0131ffb2d6ec/users/4ac0e93a056840268a7972e1d1a2f5d6/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:49.646099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839820f-9eb2-443b-bf97-bc4bbb935a68 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:49.646391 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839820f-9eb2-443b-bf97-bc4bbb935a68 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:49.646663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839820f-9eb2-443b-bf97-bc4bbb935a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:49.675285 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d839820f-9eb2-443b-bf97-bc4bbb935a68 None None] MFA Rules not processed for user `4ac0e93a056840268a7972e1d1a2f5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:49.676494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d839820f-9eb2-443b-bf97-bc4bbb935a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:49.680765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf9912-b202-411c-81d7-1bf73f3160b4 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:49.682457 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-01bf9912-b202-411c-81d7-1bf73f3160b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:49.719704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:49.744899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf9912-b202-411c-81d7-1bf73f3160b4 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:49.746572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1046/2101] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:24:49.748926 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb6b22-4f32-4d03-81f7-3162192ed9ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:49.749535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb6b22-4f32-4d03-81f7-3162192ed9ee service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:49.749850 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb6b22-4f32-4d03-81f7-3162192ed9ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:49.750122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb6b22-4f32-4d03-81f7-3162192ed9ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:49.751171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839820f-9eb2-443b-bf97-bc4bbb935a68 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:49.751898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d2eb6b22-4f32-4d03-81f7-3162192ed9ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:49.814982 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839820f-9eb2-443b-bf97-bc4bbb935a68 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:49.816585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb6b22-4f32-4d03-81f7-3162192ed9ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:49.818055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb6b22-4f32-4d03-81f7-3162192ed9ee service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:49.820265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b316f47-03f1-405e-9aa2-b60971773487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:49.820892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b316f47-03f1-405e-9aa2-b60971773487 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:49.821175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b316f47-03f1-405e-9aa2-b60971773487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:49.821448 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b316f47-03f1-405e-9aa2-b60971773487 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:49.822200 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b316f47-03f1-405e-9aa2-b60971773487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:49.824086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b316f47-03f1-405e-9aa2-b60971773487 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:49.827610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1056/2102] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:49.857014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1047/2103] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:49 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:24:49.858143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb6b22-4f32-4d03-81f7-3162192ed9ee service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:49.869546 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb6b22-4f32-4d03-81f7-3162192ed9ee service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:49.927904 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9ef7b-f902-42c4-b691-8c28c46081c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:49.928507 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ef7b-f902-42c4-b691-8c28c46081c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:49.928789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ef7b-f902-42c4-b691-8c28c46081c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:49.929060 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9ef7b-f902-42c4-b691-8c28c46081c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:49.929720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9ef7b-f902-42c4-b691-8c28c46081c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:49.931629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9ef7b-f902-42c4-b691-8c28c46081c6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:49.952467 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1057/2104] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:49 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:49.956388 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b316f47-03f1-405e-9aa2-b60971773487 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:49.967830 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b316f47-03f1-405e-9aa2-b60971773487 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:49.973299 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb379b-efa5-4449-8ca0-f5ec41a8471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:49.974022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb379b-efa5-4449-8ca0-f5ec41a8471f admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:49.974412 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb379b-efa5-4449-8ca0-f5ec41a8471f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:49.974806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb379b-efa5-4449-8ca0-f5ec41a8471f admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:49.975616 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb379b-efa5-4449-8ca0-f5ec41a8471f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:49.977352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb379b-efa5-4449-8ca0-f5ec41a8471f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:49.988773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1048/2105] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:49.992997 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9ef7b-f902-42c4-b691-8c28c46081c6 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:50.003166 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9ef7b-f902-42c4-b691-8c28c46081c6 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:50.008110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f18c99-02ff-4233-9792-6c69ecb41401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:50.008793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18c99-02ff-4233-9792-6c69ecb41401 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:50.009126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18c99-02ff-4233-9792-6c69ecb41401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:50.009327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18c99-02ff-4233-9792-6c69ecb41401 admin admin] PATH_INFO: `/v3/projects/e1991c3560844fe5b3f7f4c418735845/users/791cbd62bd094221a1a478a7007414bb/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:50.024645 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f18c99-02ff-4233-9792-6c69ecb41401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1991c3560844fe5b3f7f4c418735845, user_id=791cbd62bd094221a1a478a7007414bb, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:50.027362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f18c99-02ff-4233-9792-6c69ecb41401 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:50.041592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1058/2106] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:49 2022] PUT /identity/v3/projects/e1991c3560844fe5b3f7f4c418735845/users/791cbd62bd094221a1a478a7007414bb/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:50.045820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb379b-efa5-4449-8ca0-f5ec41a8471f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:50.057346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb379b-efa5-4449-8ca0-f5ec41a8471f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:50.132024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98186610-6e84-43c1-94a7-d587e251a5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:50.132637 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98186610-6e84-43c1-94a7-d587e251a5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:50.132952 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98186610-6e84-43c1-94a7-d587e251a5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:50.133166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98186610-6e84-43c1-94a7-d587e251a5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:50.133848 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98186610-6e84-43c1-94a7-d587e251a5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:50.135425 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98186610-6e84-43c1-94a7-d587e251a5c9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:50.146957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1049/2107] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:50.150943 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f18c99-02ff-4233-9792-6c69ecb41401 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:50.156534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:50.163749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f18c99-02ff-4233-9792-6c69ecb41401 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:50.168766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dfaa3-18ee-48cd-b100-694277cf0b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:50.169416 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dfaa3-18ee-48cd-b100-694277cf0b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:50.169713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dfaa3-18ee-48cd-b100-694277cf0b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:50.169992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dfaa3-18ee-48cd-b100-694277cf0b3d admin admin] PATH_INFO: `/v3/projects/e1991c3560844fe5b3f7f4c418735845/users/791cbd62bd094221a1a478a7007414bb/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:50.171870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6dfaa3-18ee-48cd-b100-694277cf0b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1991c3560844fe5b3f7f4c418735845, user_id=791cbd62bd094221a1a478a7007414bb, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:50.174502 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6dfaa3-18ee-48cd-b100-694277cf0b3d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:50.185743 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1059/2108] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:50 2022] PUT /identity/v3/projects/e1991c3560844fe5b3f7f4c418735845/users/791cbd62bd094221a1a478a7007414bb/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:50.197664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064967c7-5b83-405f-9579-c047f7f2156f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:50.198001 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064967c7-5b83-405f-9579-c047f7f2156f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:50.198282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064967c7-5b83-405f-9579-c047f7f2156f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:50.227696 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-064967c7-5b83-405f-9579-c047f7f2156f None None] MFA Rules not processed for user `791cbd62bd094221a1a478a7007414bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:50.228966 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-064967c7-5b83-405f-9579-c047f7f2156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:50.270516 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:50.298374 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1050/2109] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:24:50.309610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dfaa3-18ee-48cd-b100-694277cf0b3d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:50.366003 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6dfaa3-18ee-48cd-b100-694277cf0b3d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:50.369510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de748fd5-aca3-492a-b4d6-aa2f711ee0a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:50.370141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de748fd5-aca3-492a-b4d6-aa2f711ee0a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:50.370424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de748fd5-aca3-492a-b4d6-aa2f711ee0a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:50.370698 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de748fd5-aca3-492a-b4d6-aa2f711ee0a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:50.379746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de748fd5-aca3-492a-b4d6-aa2f711ee0a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:50.381226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de748fd5-aca3-492a-b4d6-aa2f711ee0a4 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:50.390648 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1060/2110] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:50.801207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064967c7-5b83-405f-9579-c047f7f2156f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:50.862834 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064967c7-5b83-405f-9579-c047f7f2156f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:50.867349 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe02fc7-9356-46dd-ab10-4bbb4c734843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:50.867967 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe02fc7-9356-46dd-ab10-4bbb4c734843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:50.868249 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe02fc7-9356-46dd-ab10-4bbb4c734843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:50.868524 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe02fc7-9356-46dd-ab10-4bbb4c734843 admin admin] PATH_INFO: `/v3/users/4ac0e93a056840268a7972e1d1a2f5d6` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:50.869635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe02fc7-9356-46dd-ab10-4bbb4c734843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac0e93a056840268a7972e1d1a2f5d6)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:50.871573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe02fc7-9356-46dd-ab10-4bbb4c734843 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:50.918378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cfe02fc7-9356-46dd-ab10-4bbb4c734843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac0e93a056840268a7972e1d1a2f5d6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:50.926131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cfe02fc7-9356-46dd-ab10-4bbb4c734843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac0e93a056840268a7972e1d1a2f5d6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:50.937839 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cfe02fc7-9356-46dd-ab10-4bbb4c734843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac0e93a056840268a7972e1d1a2f5d6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:50.945349 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cfe02fc7-9356-46dd-ab10-4bbb4c734843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac0e93a056840268a7972e1d1a2f5d6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:50.946008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cfe02fc7-9356-46dd-ab10-4bbb4c734843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac0e93a056840268a7972e1d1a2f5d6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:50.951736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1051/2111] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:50 2022] DELETE /identity/v3/users/4ac0e93a056840268a7972e1d1a2f5d6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:50.956938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a4e3-b7f1-4955-9ffe-7197c6b0074f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:50.957223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a4e3-b7f1-4955-9ffe-7197c6b0074f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:50.957500 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a4e3-b7f1-4955-9ffe-7197c6b0074f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:50.977052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-1e29a4e3-b7f1-4955-9ffe-7197c6b0074f None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:50.978280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1e29a4e3-b7f1-4955-9ffe-7197c6b0074f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:51.037084 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1061/2112] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:51.046776 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe02fc7-9356-46dd-ab10-4bbb4c734843 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:51.048174 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cfe02fc7-9356-46dd-ab10-4bbb4c734843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:51.109378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe02fc7-9356-46dd-ab10-4bbb4c734843 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:51.113722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3e5dc-de35-41af-8ffc-d27c0f430799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:51.114324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3e5dc-de35-41af-8ffc-d27c0f430799 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:51.114600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3e5dc-de35-41af-8ffc-d27c0f430799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:51.114864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3e5dc-de35-41af-8ffc-d27c0f430799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:51.123515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3e5dc-de35-41af-8ffc-d27c0f430799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:51.124923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3e5dc-de35-41af-8ffc-d27c0f430799 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:51.130739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:51.135507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1052/2113] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:51.441869 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29a4e3-b7f1-4955-9ffe-7197c6b0074f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:51.443615 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1e29a4e3-b7f1-4955-9ffe-7197c6b0074f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:51.460119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29a4e3-b7f1-4955-9ffe-7197c6b0074f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:51.465977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2ac8e-3af7-4c58-9022-16282b9b979c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:51.466639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2ac8e-3af7-4c58-9022-16282b9b979c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:51.467360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2ac8e-3af7-4c58-9022-16282b9b979c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:51.467360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2ac8e-3af7-4c58-9022-16282b9b979c admin admin] PATH_INFO: `/v3/projects/d50cde2713b448a19a5c0131ffb2d6ec` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:51.468633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2ac8e-3af7-4c58-9022-16282b9b979c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50cde2713b448a19a5c0131ffb2d6ec)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:51.472866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2ac8e-3af7-4c58-9022-16282b9b979c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:51.527879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fdc2ac8e-3af7-4c58-9022-16282b9b979c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50cde2713b448a19a5c0131ffb2d6ec', 'request_id': 'req-fdc2ac8e-3af7-4c58-9022-16282b9b979c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:51.535874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fdc2ac8e-3af7-4c58-9022-16282b9b979c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50cde2713b448a19a5c0131ffb2d6ec', 'request_id': 'req-fdc2ac8e-3af7-4c58-9022-16282b9b979c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:51.542958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fdc2ac8e-3af7-4c58-9022-16282b9b979c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50cde2713b448a19a5c0131ffb2d6ec', 'request_id': 'req-fdc2ac8e-3af7-4c58-9022-16282b9b979c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:51.557395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fdc2ac8e-3af7-4c58-9022-16282b9b979c admin admin] The token cache is being invalidate because project d50cde2713b448a19a5c0131ffb2d6ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:51.557711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fdc2ac8e-3af7-4c58-9022-16282b9b979c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:51.558358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fdc2ac8e-3af7-4c58-9022-16282b9b979c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:51.560150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1062/2114] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:51 2022] DELETE /identity/v3/projects/d50cde2713b448a19a5c0131ffb2d6ec => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:51.564258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3e5dc-de35-41af-8ffc-d27c0f430799 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:51.574591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3e5dc-de35-41af-8ffc-d27c0f430799 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:51.645539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1440f-1c1c-4756-9ae2-bc3216d3366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:51.646197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1440f-1c1c-4756-9ae2-bc3216d3366d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:51.646474 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1440f-1c1c-4756-9ae2-bc3216d3366d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:51.646744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1440f-1c1c-4756-9ae2-bc3216d3366d admin admin] PATH_INFO: `/v3/users/791cbd62bd094221a1a478a7007414bb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:51.647964 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1440f-1c1c-4756-9ae2-bc3216d3366d admin admin] RBAC: Authorizing `identity:delete_user(user_id=791cbd62bd094221a1a478a7007414bb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:51.651038 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1440f-1c1c-4756-9ae2-bc3216d3366d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:51.700150 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-35c1440f-1c1c-4756-9ae2-bc3216d3366d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '791cbd62bd094221a1a478a7007414bb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:51.708104 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-35c1440f-1c1c-4756-9ae2-bc3216d3366d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '791cbd62bd094221a1a478a7007414bb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:51.723930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-35c1440f-1c1c-4756-9ae2-bc3216d3366d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '791cbd62bd094221a1a478a7007414bb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:51.731344 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-35c1440f-1c1c-4756-9ae2-bc3216d3366d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '791cbd62bd094221a1a478a7007414bb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:51.732049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-35c1440f-1c1c-4756-9ae2-bc3216d3366d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '791cbd62bd094221a1a478a7007414bb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:51.739052 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1053/2115] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:51 2022] DELETE /identity/v3/users/791cbd62bd094221a1a478a7007414bb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:52.097182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2ac8e-3af7-4c58-9022-16282b9b979c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:52.099137 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fdc2ac8e-3af7-4c58-9022-16282b9b979c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:52.112997 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2ac8e-3af7-4c58-9022-16282b9b979c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:52.125226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:52.172343 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0663f-cb2c-432f-99c6-7654e9abf32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:52.172967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0663f-cb2c-432f-99c6-7654e9abf32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:52.173241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0663f-cb2c-432f-99c6-7654e9abf32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:52.173508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0663f-cb2c-432f-99c6-7654e9abf32d admin admin] PATH_INFO: `/v3/projects/e1991c3560844fe5b3f7f4c418735845` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:52.174636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0663f-cb2c-432f-99c6-7654e9abf32d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1991c3560844fe5b3f7f4c418735845)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:52.176530 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0663f-cb2c-432f-99c6-7654e9abf32d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:52.223705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-68b0663f-cb2c-432f-99c6-7654e9abf32d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1991c3560844fe5b3f7f4c418735845', 'request_id': 'req-68b0663f-cb2c-432f-99c6-7654e9abf32d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:52.229004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-68b0663f-cb2c-432f-99c6-7654e9abf32d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1991c3560844fe5b3f7f4c418735845', 'request_id': 'req-68b0663f-cb2c-432f-99c6-7654e9abf32d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:52.235032 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-68b0663f-cb2c-432f-99c6-7654e9abf32d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1991c3560844fe5b3f7f4c418735845', 'request_id': 'req-68b0663f-cb2c-432f-99c6-7654e9abf32d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:52.247371 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-68b0663f-cb2c-432f-99c6-7654e9abf32d admin admin] The token cache is being invalidate because project e1991c3560844fe5b3f7f4c418735845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:52.247659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-68b0663f-cb2c-432f-99c6-7654e9abf32d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:52.248292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-68b0663f-cb2c-432f-99c6-7654e9abf32d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:52.249769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1063/2116] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:52 2022] DELETE /identity/v3/projects/e1991c3560844fe5b3f7f4c418735845 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:52.255167 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bf4ab-dba5-4ecf-8e74-8b268ec2063d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:52.255638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bf4ab-dba5-4ecf-8e74-8b268ec2063d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:52.255728 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bf4ab-dba5-4ecf-8e74-8b268ec2063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:52.275862 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ba6bf4ab-dba5-4ecf-8e74-8b268ec2063d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:52.277064 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ba6bf4ab-dba5-4ecf-8e74-8b268ec2063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:52.337931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1054/2117] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:52.345750 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2e2bf-fa6c-4a74-b0bb-1778bb9450fa None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:52.346040 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2e2bf-fa6c-4a74-b0bb-1778bb9450fa None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:52.346318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2e2bf-fa6c-4a74-b0bb-1778bb9450fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:52.366543 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-99f2e2bf-fa6c-4a74-b0bb-1778bb9450fa None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:52.367764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-99f2e2bf-fa6c-4a74-b0bb-1778bb9450fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:52.375489 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1064/2118] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:52.380400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bf4ab-dba5-4ecf-8e74-8b268ec2063d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:52.390415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bf4ab-dba5-4ecf-8e74-8b268ec2063d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:52.395813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cf393-3ae4-470d-bbb0-d84799136dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:52.396401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cf393-3ae4-470d-bbb0-d84799136dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:52.396678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cf393-3ae4-470d-bbb0-d84799136dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:52.396951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cf393-3ae4-470d-bbb0-d84799136dc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:52.397589 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cf393-3ae4-470d-bbb0-d84799136dc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:52.397923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cf393-3ae4-470d-bbb0-d84799136dc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:52.399537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cf393-3ae4-470d-bbb0-d84799136dc3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:52.411148 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1055/2119] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:24:52.415469 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2e2bf-fa6c-4a74-b0bb-1778bb9450fa None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:52.425228 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2e2bf-fa6c-4a74-b0bb-1778bb9450fa None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:52.430052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee0c65-40ca-45d0-89b0-8d86a27631d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:52.430654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee0c65-40ca-45d0-89b0-8d86a27631d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:52.430935 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee0c65-40ca-45d0-89b0-8d86a27631d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:52.431207 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee0c65-40ca-45d0-89b0-8d86a27631d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:52.431841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee0c65-40ca-45d0-89b0-8d86a27631d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:52.433902 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee0c65-40ca-45d0-89b0-8d86a27631d6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:52.460790 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1065/2120] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:52 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:52.465241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cf393-3ae4-470d-bbb0-d84799136dc3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:52.475640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cf393-3ae4-470d-bbb0-d84799136dc3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:52.479094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:52.534816 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b615608-12f6-4f49-9067-46b81e89cb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:52.535415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b615608-12f6-4f49-9067-46b81e89cb99 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:52.535718 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b615608-12f6-4f49-9067-46b81e89cb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:52.535990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b615608-12f6-4f49-9067-46b81e89cb99 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:52.536647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b615608-12f6-4f49-9067-46b81e89cb99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:52.538958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b615608-12f6-4f49-9067-46b81e89cb99 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:52.565302 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1056/2121] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:52 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:52.571141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee0c65-40ca-45d0-89b0-8d86a27631d6 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:52.581196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee0c65-40ca-45d0-89b0-8d86a27631d6 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:52.585844 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9727f-f3bf-47ce-9f30-b8ee17a196d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:52.586445 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9727f-f3bf-47ce-9f30-b8ee17a196d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:52.586726 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9727f-f3bf-47ce-9f30-b8ee17a196d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:52.587001 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9727f-f3bf-47ce-9f30-b8ee17a196d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:52.587642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9727f-f3bf-47ce-9f30-b8ee17a196d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:52.589258 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9727f-f3bf-47ce-9f30-b8ee17a196d1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:52.600080 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1066/2122] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:52.604129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b615608-12f6-4f49-9067-46b81e89cb99 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:52.615579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b615608-12f6-4f49-9067-46b81e89cb99 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:52.620288 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997fb25-0d29-45a4-a429-1072ea5225d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:52.620878 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997fb25-0d29-45a4-a429-1072ea5225d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:52.621154 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997fb25-0d29-45a4-a429-1072ea5225d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:52.621420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997fb25-0d29-45a4-a429-1072ea5225d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:52.622087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997fb25-0d29-45a4-a429-1072ea5225d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:52.623702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997fb25-0d29-45a4-a429-1072ea5225d0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:52.635786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1057/2123] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:52.640067 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9727f-f3bf-47ce-9f30-b8ee17a196d1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:52.650682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9727f-f3bf-47ce-9f30-b8ee17a196d1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:52.655591 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f7e0c-60fe-4b21-9366-f1bcef6c3210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:52.656216 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f7e0c-60fe-4b21-9366-f1bcef6c3210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:52.656522 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f7e0c-60fe-4b21-9366-f1bcef6c3210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:52.656776 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f7e0c-60fe-4b21-9366-f1bcef6c3210 admin admin] PATH_INFO: `/v3/projects/e7f6bf644e2a4701b690cdccea037bfb/users/cae5dfdbb99e4e9abc72be2220655854/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:52.672288 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f7e0c-60fe-4b21-9366-f1bcef6c3210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f6bf644e2a4701b690cdccea037bfb, user_id=cae5dfdbb99e4e9abc72be2220655854, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:52.675540 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f7e0c-60fe-4b21-9366-f1bcef6c3210 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:52.690179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1067/2124] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:52 2022] PUT /identity/v3/projects/e7f6bf644e2a4701b690cdccea037bfb/users/cae5dfdbb99e4e9abc72be2220655854/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:52.702646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a1d3a-724d-48e3-9e89-f3b888a4f966 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:52.702986 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a1d3a-724d-48e3-9e89-f3b888a4f966 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:52.703350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a1d3a-724d-48e3-9e89-f3b888a4f966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:52.733093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-187a1d3a-724d-48e3-9e89-f3b888a4f966 None None] MFA Rules not processed for user `cae5dfdbb99e4e9abc72be2220655854`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:52.734327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-187a1d3a-724d-48e3-9e89-f3b888a4f966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:52.806501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1058/2125] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:52.817549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f7e0c-60fe-4b21-9366-f1bcef6c3210 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:52.819272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a10f7e0c-60fe-4b21-9366-f1bcef6c3210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:52.865614 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:52.878575 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f7e0c-60fe-4b21-9366-f1bcef6c3210 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:52.882231 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad9266-1a5b-4167-827a-e00c39ff3172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:52.882835 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad9266-1a5b-4167-827a-e00c39ff3172 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:52.883118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad9266-1a5b-4167-827a-e00c39ff3172 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:52.883391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad9266-1a5b-4167-827a-e00c39ff3172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:52.892011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad9266-1a5b-4167-827a-e00c39ff3172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:52.893726 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad9266-1a5b-4167-827a-e00c39ff3172 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:52.903707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1068/2126] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:54.916151 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a1d3a-724d-48e3-9e89-f3b888a4f966 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:54.917539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-187a1d3a-724d-48e3-9e89-f3b888a4f966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:54.981986 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a1d3a-724d-48e3-9e89-f3b888a4f966 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:54.986392 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831e9e0-0ec6-4acc-8528-3a0090ee79c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:54.987011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831e9e0-0ec6-4acc-8528-3a0090ee79c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:54.987836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831e9e0-0ec6-4acc-8528-3a0090ee79c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:54.988339 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831e9e0-0ec6-4acc-8528-3a0090ee79c7 admin admin] PATH_INFO: `/v3/users/32d8443f651d400da5f935d4ccbd389b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:54.989459 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831e9e0-0ec6-4acc-8528-3a0090ee79c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d8443f651d400da5f935d4ccbd389b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:54.991423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831e9e0-0ec6-4acc-8528-3a0090ee79c7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:55.008638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:55.039289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4831e9e0-0ec6-4acc-8528-3a0090ee79c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d8443f651d400da5f935d4ccbd389b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:55.046783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4831e9e0-0ec6-4acc-8528-3a0090ee79c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d8443f651d400da5f935d4ccbd389b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:55.059296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4831e9e0-0ec6-4acc-8528-3a0090ee79c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d8443f651d400da5f935d4ccbd389b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:55.066464 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4831e9e0-0ec6-4acc-8528-3a0090ee79c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d8443f651d400da5f935d4ccbd389b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:55.067121 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4831e9e0-0ec6-4acc-8528-3a0090ee79c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d8443f651d400da5f935d4ccbd389b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:55.072994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1059/2127] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:54 2022] DELETE /identity/v3/users/32d8443f651d400da5f935d4ccbd389b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:55.077536 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c99b0-e9b1-444e-bd4c-62ff0a757031 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:55.078034 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c99b0-e9b1-444e-bd4c-62ff0a757031 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:55.078125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c99b0-e9b1-444e-bd4c-62ff0a757031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:55.097772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b28c99b0-e9b1-444e-bd4c-62ff0a757031 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:55.099057 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b28c99b0-e9b1-444e-bd4c-62ff0a757031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:55.157908 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1069/2128] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:55.168240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831e9e0-0ec6-4acc-8528-3a0090ee79c7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:55.169733 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4831e9e0-0ec6-4acc-8528-3a0090ee79c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:55.226781 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831e9e0-0ec6-4acc-8528-3a0090ee79c7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:55.230709 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40005a3-08b5-4cd3-a310-2a40602df60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:55.231400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40005a3-08b5-4cd3-a310-2a40602df60c service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:55.231678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40005a3-08b5-4cd3-a310-2a40602df60c service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:55.231946 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40005a3-08b5-4cd3-a310-2a40602df60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:55.242250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40005a3-08b5-4cd3-a310-2a40602df60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:55.243708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40005a3-08b5-4cd3-a310-2a40602df60c service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:55.253077 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1060/2129] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:55.575460 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c99b0-e9b1-444e-bd4c-62ff0a757031 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:55.577142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b28c99b0-e9b1-444e-bd4c-62ff0a757031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:55.591386 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c99b0-e9b1-444e-bd4c-62ff0a757031 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:55.596567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c93fb-d3f3-4ee3-a935-f40f061388e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:55.597507 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c93fb-d3f3-4ee3-a935-f40f061388e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:55.598446 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c93fb-d3f3-4ee3-a935-f40f061388e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:55.598740 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c93fb-d3f3-4ee3-a935-f40f061388e7 admin admin] PATH_INFO: `/v3/projects/c15f771d596749d5829f678b05e9861c` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:55.599903 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c93fb-d3f3-4ee3-a935-f40f061388e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15f771d596749d5829f678b05e9861c)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:55.602142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c93fb-d3f3-4ee3-a935-f40f061388e7 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:55.654288 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-de1c93fb-d3f3-4ee3-a935-f40f061388e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15f771d596749d5829f678b05e9861c', 'request_id': 'req-de1c93fb-d3f3-4ee3-a935-f40f061388e7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:55.660713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-de1c93fb-d3f3-4ee3-a935-f40f061388e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15f771d596749d5829f678b05e9861c', 'request_id': 'req-de1c93fb-d3f3-4ee3-a935-f40f061388e7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:55.667469 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-de1c93fb-d3f3-4ee3-a935-f40f061388e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15f771d596749d5829f678b05e9861c', 'request_id': 'req-de1c93fb-d3f3-4ee3-a935-f40f061388e7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:55.682006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-de1c93fb-d3f3-4ee3-a935-f40f061388e7 admin admin] The token cache is being invalidate because project c15f771d596749d5829f678b05e9861c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:55.682431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-de1c93fb-d3f3-4ee3-a935-f40f061388e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:55.683183 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-de1c93fb-d3f3-4ee3-a935-f40f061388e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:55.684906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1070/2130] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:55 2022] DELETE /identity/v3/projects/c15f771d596749d5829f678b05e9861c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:55.688866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40005a3-08b5-4cd3-a310-2a40602df60c service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:55.699084 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40005a3-08b5-4cd3-a310-2a40602df60c service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:55.765004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb224c-9468-4ed6-b522-a19683c8356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:55.765639 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb224c-9468-4ed6-b522-a19683c8356c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:55.765952 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb224c-9468-4ed6-b522-a19683c8356c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:55.766231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb224c-9468-4ed6-b522-a19683c8356c admin admin] PATH_INFO: `/v3/users/bc81b7b8326b4b60b5ceb230b11b0af7` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:55.767356 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb224c-9468-4ed6-b522-a19683c8356c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc81b7b8326b4b60b5ceb230b11b0af7)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:55.769886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb224c-9468-4ed6-b522-a19683c8356c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:55.814161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:55.821889 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e2eb224c-9468-4ed6-b522-a19683c8356c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc81b7b8326b4b60b5ceb230b11b0af7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:55.830736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e2eb224c-9468-4ed6-b522-a19683c8356c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc81b7b8326b4b60b5ceb230b11b0af7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:55.845758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e2eb224c-9468-4ed6-b522-a19683c8356c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc81b7b8326b4b60b5ceb230b11b0af7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:55.853648 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e2eb224c-9468-4ed6-b522-a19683c8356c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc81b7b8326b4b60b5ceb230b11b0af7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:55.854387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e2eb224c-9468-4ed6-b522-a19683c8356c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc81b7b8326b4b60b5ceb230b11b0af7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:55.861919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1061/2131] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:55 2022] DELETE /identity/v3/users/bc81b7b8326b4b60b5ceb230b11b0af7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:56.153989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c93fb-d3f3-4ee3-a935-f40f061388e7 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:56.155487 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-de1c93fb-d3f3-4ee3-a935-f40f061388e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:56.168967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c93fb-d3f3-4ee3-a935-f40f061388e7 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:56.226066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3d392-d025-4e98-9774-bc0b117e8806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:56.226628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3d392-d025-4e98-9774-bc0b117e8806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:56.226907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3d392-d025-4e98-9774-bc0b117e8806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:56.227179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3d392-d025-4e98-9774-bc0b117e8806 admin admin] PATH_INFO: `/v3/projects/87585d9a2a2c49469b7ec9c5211fc149` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:56.228312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3d392-d025-4e98-9774-bc0b117e8806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87585d9a2a2c49469b7ec9c5211fc149)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:56.230248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3d392-d025-4e98-9774-bc0b117e8806 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:56.241350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:56.282788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-24c3d392-d025-4e98-9774-bc0b117e8806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87585d9a2a2c49469b7ec9c5211fc149', 'request_id': 'req-24c3d392-d025-4e98-9774-bc0b117e8806'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:56.288879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-24c3d392-d025-4e98-9774-bc0b117e8806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87585d9a2a2c49469b7ec9c5211fc149', 'request_id': 'req-24c3d392-d025-4e98-9774-bc0b117e8806'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:56.295932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-24c3d392-d025-4e98-9774-bc0b117e8806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87585d9a2a2c49469b7ec9c5211fc149', 'request_id': 'req-24c3d392-d025-4e98-9774-bc0b117e8806'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:56.308611 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-24c3d392-d025-4e98-9774-bc0b117e8806 admin admin] The token cache is being invalidate because project 87585d9a2a2c49469b7ec9c5211fc149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:56.308903 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-24c3d392-d025-4e98-9774-bc0b117e8806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:56.309523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-24c3d392-d025-4e98-9774-bc0b117e8806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:56.311103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1071/2132] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:56 2022] DELETE /identity/v3/projects/87585d9a2a2c49469b7ec9c5211fc149 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:56.318055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910366-8142-4f2a-bac3-f5c4d9466c52 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:56.318539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910366-8142-4f2a-bac3-f5c4d9466c52 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:56.318656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910366-8142-4f2a-bac3-f5c4d9466c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:56.340827 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7d910366-8142-4f2a-bac3-f5c4d9466c52 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:56.342118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7d910366-8142-4f2a-bac3-f5c4d9466c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:56.405059 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1062/2133] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:56.413434 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547ea8a-63d7-41f7-9090-9e43543ed3f7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:56.413739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547ea8a-63d7-41f7-9090-9e43543ed3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:56.414038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547ea8a-63d7-41f7-9090-9e43543ed3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:56.434503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b547ea8a-63d7-41f7-9090-9e43543ed3f7 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:56.435719 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b547ea8a-63d7-41f7-9090-9e43543ed3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:56.443869 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1072/2134] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:56.448150 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910366-8142-4f2a-bac3-f5c4d9466c52 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:56.459054 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910366-8142-4f2a-bac3-f5c4d9466c52 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:56.463615 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53bb05-3392-43bd-a6ec-5312cf1e5fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:56.464203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53bb05-3392-43bd-a6ec-5312cf1e5fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:56.464481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53bb05-3392-43bd-a6ec-5312cf1e5fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:56.464751 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53bb05-3392-43bd-a6ec-5312cf1e5fa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:56.465388 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53bb05-3392-43bd-a6ec-5312cf1e5fa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:56.465708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53bb05-3392-43bd-a6ec-5312cf1e5fa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:56.467373 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53bb05-3392-43bd-a6ec-5312cf1e5fa9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:56.479539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1063/2135] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:24:56.484297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547ea8a-63d7-41f7-9090-9e43543ed3f7 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:56.493962 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547ea8a-63d7-41f7-9090-9e43543ed3f7 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:56.498515 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185747d-42a9-4e4b-9ff8-2658ea5e01d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:56.499099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185747d-42a9-4e4b-9ff8-2658ea5e01d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:56.499378 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185747d-42a9-4e4b-9ff8-2658ea5e01d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:56.499645 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185747d-42a9-4e4b-9ff8-2658ea5e01d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:56.500259 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185747d-42a9-4e4b-9ff8-2658ea5e01d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:56.502154 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185747d-42a9-4e4b-9ff8-2658ea5e01d0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:56.529937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1073/2136] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:56 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:56.534803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53bb05-3392-43bd-a6ec-5312cf1e5fa9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:56.544755 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53bb05-3392-43bd-a6ec-5312cf1e5fa9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:56.601813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c4eb7-9a4d-4583-ad13-e15d87b3ef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:56.602421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c4eb7-9a4d-4583-ad13-e15d87b3ef0d admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:56.602703 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c4eb7-9a4d-4583-ad13-e15d87b3ef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:56.602978 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c4eb7-9a4d-4583-ad13-e15d87b3ef0d admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:56.603617 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c4eb7-9a4d-4583-ad13-e15d87b3ef0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:56.605531 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c4eb7-9a4d-4583-ad13-e15d87b3ef0d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:56.636072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1064/2137] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:56 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:56.637271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185747d-42a9-4e4b-9ff8-2658ea5e01d0 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:56.648083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185747d-42a9-4e4b-9ff8-2658ea5e01d0 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:56.652715 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415ed7c-e75c-405a-bd51-0b456493613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:56.653315 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415ed7c-e75c-405a-bd51-0b456493613a admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:56.653594 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415ed7c-e75c-405a-bd51-0b456493613a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:56.653899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415ed7c-e75c-405a-bd51-0b456493613a admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:56.654534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415ed7c-e75c-405a-bd51-0b456493613a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:56.656142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415ed7c-e75c-405a-bd51-0b456493613a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:56.667265 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1074/2138] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:56.671954 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c4eb7-9a4d-4583-ad13-e15d87b3ef0d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:56.682874 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c4eb7-9a4d-4583-ad13-e15d87b3ef0d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:56.687959 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0fc41-07a6-4c5e-b18f-253399bc06df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:56.688586 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0fc41-07a6-4c5e-b18f-253399bc06df admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:56.688865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0fc41-07a6-4c5e-b18f-253399bc06df admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:56.689140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0fc41-07a6-4c5e-b18f-253399bc06df admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:56.689806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0fc41-07a6-4c5e-b18f-253399bc06df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:56.691939 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0fc41-07a6-4c5e-b18f-253399bc06df admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:56.702977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1065/2139] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:56.707074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415ed7c-e75c-405a-bd51-0b456493613a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:56.717100 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415ed7c-e75c-405a-bd51-0b456493613a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:56.722561 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f43c8-c855-4302-81f7-d6d5027ddb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:56.723206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f43c8-c855-4302-81f7-d6d5027ddb7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:56.723491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f43c8-c855-4302-81f7-d6d5027ddb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:56.723794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f43c8-c855-4302-81f7-d6d5027ddb7d admin admin] PATH_INFO: `/v3/projects/e999c0de592a4151bba9bb4bb6842ab3/users/d242f53defb745b9b63ed7227a48c21c/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:56.738740 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f43c8-c855-4302-81f7-d6d5027ddb7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e999c0de592a4151bba9bb4bb6842ab3, user_id=d242f53defb745b9b63ed7227a48c21c, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:56.741296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f43c8-c855-4302-81f7-d6d5027ddb7d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:56.753640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1075/2140] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:56 2022] PUT /identity/v3/projects/e999c0de592a4151bba9bb4bb6842ab3/users/d242f53defb745b9b63ed7227a48c21c/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:56.764824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecd25e-f759-4ac1-a435-fa4e47201e54 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:56.765105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecd25e-f759-4ac1-a435-fa4e47201e54 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:56.765373 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecd25e-f759-4ac1-a435-fa4e47201e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:56.793765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b0ecd25e-f759-4ac1-a435-fa4e47201e54 None None] MFA Rules not processed for user `d242f53defb745b9b63ed7227a48c21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:56.794958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b0ecd25e-f759-4ac1-a435-fa4e47201e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:56.804777 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:56.859547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1066/2141] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:56.872779 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f43c8-c855-4302-81f7-d6d5027ddb7d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:56.874486 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c85f43c8-c855-4302-81f7-d6d5027ddb7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:56.930558 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f43c8-c855-4302-81f7-d6d5027ddb7d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:56.934170 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debaa8c-3bc5-4b0a-ae6c-223a8bf3d7f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:56.934759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debaa8c-3bc5-4b0a-ae6c-223a8bf3d7f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:56.935041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debaa8c-3bc5-4b0a-ae6c-223a8bf3d7f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:56.935316 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debaa8c-3bc5-4b0a-ae6c-223a8bf3d7f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:56.943642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debaa8c-3bc5-4b0a-ae6c-223a8bf3d7f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:56.945030 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debaa8c-3bc5-4b0a-ae6c-223a8bf3d7f9 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:56.953537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1076/2142] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:56.976540 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecd25e-f759-4ac1-a435-fa4e47201e54 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:57.040125 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecd25e-f759-4ac1-a435-fa4e47201e54 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:57.044635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87f36e-228a-4581-b440-72cf1a58e101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:57.045257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87f36e-228a-4581-b440-72cf1a58e101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:57.045537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87f36e-228a-4581-b440-72cf1a58e101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:57.045851 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87f36e-228a-4581-b440-72cf1a58e101 admin admin] PATH_INFO: `/v3/users/d242f53defb745b9b63ed7227a48c21c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:57.046981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87f36e-228a-4581-b440-72cf1a58e101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d242f53defb745b9b63ed7227a48c21c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:57.048893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87f36e-228a-4581-b440-72cf1a58e101 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:57.092909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7e87f36e-228a-4581-b440-72cf1a58e101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd242f53defb745b9b63ed7227a48c21c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:57.101046 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7e87f36e-228a-4581-b440-72cf1a58e101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd242f53defb745b9b63ed7227a48c21c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:57.113556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7e87f36e-228a-4581-b440-72cf1a58e101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd242f53defb745b9b63ed7227a48c21c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:57.120387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7e87f36e-228a-4581-b440-72cf1a58e101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd242f53defb745b9b63ed7227a48c21c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:57.121046 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7e87f36e-228a-4581-b440-72cf1a58e101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd242f53defb745b9b63ed7227a48c21c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:57.126836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1067/2143] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:56 2022] DELETE /identity/v3/users/d242f53defb745b9b63ed7227a48c21c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:57.131378 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65435c-d899-4dce-991a-19d05902e637 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:57.131665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65435c-d899-4dce-991a-19d05902e637 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:57.131944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65435c-d899-4dce-991a-19d05902e637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:57.152177 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4c65435c-d899-4dce-991a-19d05902e637 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:57.153383 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4c65435c-d899-4dce-991a-19d05902e637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:57.187719 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:57.219588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1077/2144] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:57.231585 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87f36e-228a-4581-b440-72cf1a58e101 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:57.232984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7e87f36e-228a-4581-b440-72cf1a58e101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:57.273905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:57.299875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87f36e-228a-4581-b440-72cf1a58e101 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:57.303480 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168073a-f760-41f5-b24c-7a0e946e3512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:57.304085 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168073a-f760-41f5-b24c-7a0e946e3512 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:57.304371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168073a-f760-41f5-b24c-7a0e946e3512 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:57.304647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168073a-f760-41f5-b24c-7a0e946e3512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:57.314417 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168073a-f760-41f5-b24c-7a0e946e3512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:57.316353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168073a-f760-41f5-b24c-7a0e946e3512 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:57.325791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1068/2145] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:57.598244 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65435c-d899-4dce-991a-19d05902e637 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:57.599664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4c65435c-d899-4dce-991a-19d05902e637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:57.611785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65435c-d899-4dce-991a-19d05902e637 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:57.616533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24785fad-4b3d-47e3-bba8-9e113036f541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:57.617169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24785fad-4b3d-47e3-bba8-9e113036f541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:57.617449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24785fad-4b3d-47e3-bba8-9e113036f541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:57.617747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24785fad-4b3d-47e3-bba8-9e113036f541 admin admin] PATH_INFO: `/v3/projects/e999c0de592a4151bba9bb4bb6842ab3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:57.618936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24785fad-4b3d-47e3-bba8-9e113036f541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e999c0de592a4151bba9bb4bb6842ab3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:57.620834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24785fad-4b3d-47e3-bba8-9e113036f541 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:57.668682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-24785fad-4b3d-47e3-bba8-9e113036f541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e999c0de592a4151bba9bb4bb6842ab3', 'request_id': 'req-24785fad-4b3d-47e3-bba8-9e113036f541'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:57.674221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-24785fad-4b3d-47e3-bba8-9e113036f541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e999c0de592a4151bba9bb4bb6842ab3', 'request_id': 'req-24785fad-4b3d-47e3-bba8-9e113036f541'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:57.680897 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-24785fad-4b3d-47e3-bba8-9e113036f541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e999c0de592a4151bba9bb4bb6842ab3', 'request_id': 'req-24785fad-4b3d-47e3-bba8-9e113036f541'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:57.693465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-24785fad-4b3d-47e3-bba8-9e113036f541 admin admin] The token cache is being invalidate because project e999c0de592a4151bba9bb4bb6842ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:57.693852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-24785fad-4b3d-47e3-bba8-9e113036f541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:57.694474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-24785fad-4b3d-47e3-bba8-9e113036f541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:57.695965 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1078/2146] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:57 2022] DELETE /identity/v3/projects/e999c0de592a4151bba9bb4bb6842ab3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:57.700726 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e7d51-9347-4a6d-b612-342d781c7eba None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:57.701012 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e7d51-9347-4a6d-b612-342d781c7eba None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:57.701283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e7d51-9347-4a6d-b612-342d781c7eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:57.720939 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ce9e7d51-9347-4a6d-b612-342d781c7eba None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:57.722595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ce9e7d51-9347-4a6d-b612-342d781c7eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:57.782611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1069/2147] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:57.790575 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d2938-d696-43fd-8690-056a26b2c6f0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:57.790862 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d2938-d696-43fd-8690-056a26b2c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:57.791139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d2938-d696-43fd-8690-056a26b2c6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:57.811427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-055d2938-d696-43fd-8690-056a26b2c6f0 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:57.812653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-055d2938-d696-43fd-8690-056a26b2c6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:57.821173 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1079/2148] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:57.825451 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e7d51-9347-4a6d-b612-342d781c7eba None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:57.835286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e7d51-9347-4a6d-b612-342d781c7eba None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:57.840198 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb5e4c-7916-4c18-a5e5-01e3be807bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:57.840846 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb5e4c-7916-4c18-a5e5-01e3be807bef admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:57.841070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb5e4c-7916-4c18-a5e5-01e3be807bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:57.841339 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb5e4c-7916-4c18-a5e5-01e3be807bef admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:57.842024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb5e4c-7916-4c18-a5e5-01e3be807bef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:57.842326 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb5e4c-7916-4c18-a5e5-01e3be807bef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:57.843907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb5e4c-7916-4c18-a5e5-01e3be807bef admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:57.857069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1070/2149] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:24:57.860964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d2938-d696-43fd-8690-056a26b2c6f0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:57.870668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d2938-d696-43fd-8690-056a26b2c6f0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:57.875314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa495d8-93f5-47a6-9867-bccf046793d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:57.875904 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa495d8-93f5-47a6-9867-bccf046793d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:57.876182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa495d8-93f5-47a6-9867-bccf046793d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:57.876451 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa495d8-93f5-47a6-9867-bccf046793d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:57.877081 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa495d8-93f5-47a6-9867-bccf046793d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:57.879527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa495d8-93f5-47a6-9867-bccf046793d3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:57.910417 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1080/2150] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:57 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:57.912484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb5e4c-7916-4c18-a5e5-01e3be807bef admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:57.922523 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb5e4c-7916-4c18-a5e5-01e3be807bef admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:57.978015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781c330-35a0-4f67-83d8-1f92b805d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:57.978611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781c330-35a0-4f67-83d8-1f92b805d5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:57.978897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781c330-35a0-4f67-83d8-1f92b805d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:57.979171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781c330-35a0-4f67-83d8-1f92b805d5f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:57.979822 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781c330-35a0-4f67-83d8-1f92b805d5f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:57.981761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781c330-35a0-4f67-83d8-1f92b805d5f1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:58.003872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1071/2151] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:57 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:24:58.008623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa495d8-93f5-47a6-9867-bccf046793d3 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:58.019170 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa495d8-93f5-47a6-9867-bccf046793d3 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:58.023784 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5132a7d-ac5a-4e8a-80a8-1f73bfd043d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:58.024380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5132a7d-ac5a-4e8a-80a8-1f73bfd043d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:58.024662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5132a7d-ac5a-4e8a-80a8-1f73bfd043d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:58.024937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5132a7d-ac5a-4e8a-80a8-1f73bfd043d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:58.025585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5132a7d-ac5a-4e8a-80a8-1f73bfd043d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:58.027189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5132a7d-ac5a-4e8a-80a8-1f73bfd043d3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:58.037871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1081/2152] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:58.041630 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781c330-35a0-4f67-83d8-1f92b805d5f1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:58.052062 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781c330-35a0-4f67-83d8-1f92b805d5f1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:58.056606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ce039-d5f9-431a-a1b9-5e59609a0c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:58.057188 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ce039-d5f9-431a-a1b9-5e59609a0c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:58.058070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ce039-d5f9-431a-a1b9-5e59609a0c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:58.058356 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ce039-d5f9-431a-a1b9-5e59609a0c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:58.059043 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ce039-d5f9-431a-a1b9-5e59609a0c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:58.060642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ce039-d5f9-431a-a1b9-5e59609a0c23 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:58.072322 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1072/2153] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:58.076281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5132a7d-ac5a-4e8a-80a8-1f73bfd043d3 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:58.086165 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5132a7d-ac5a-4e8a-80a8-1f73bfd043d3 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:58.090779 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff2140-4efb-4e18-86a3-9bd73bc3e2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:58.091475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff2140-4efb-4e18-86a3-9bd73bc3e2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:58.091703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff2140-4efb-4e18-86a3-9bd73bc3e2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:58.091977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff2140-4efb-4e18-86a3-9bd73bc3e2b2 admin admin] PATH_INFO: `/v3/projects/739306f960ff4c068646c3b8a20bfafe/users/b21a2ac6630a4d7fb3102edd66d04848/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:58.107038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff2140-4efb-4e18-86a3-9bd73bc3e2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=739306f960ff4c068646c3b8a20bfafe, user_id=b21a2ac6630a4d7fb3102edd66d04848, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:58.109672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff2140-4efb-4e18-86a3-9bd73bc3e2b2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:58.123191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1082/2154] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:58 2022] PUT /identity/v3/projects/739306f960ff4c068646c3b8a20bfafe/users/b21a2ac6630a4d7fb3102edd66d04848/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:58.133941 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547e114-8353-422a-92dc-55681c07b3b5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:58.134225 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547e114-8353-422a-92dc-55681c07b3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:58.134494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547e114-8353-422a-92dc-55681c07b3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:58.163027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3547e114-8353-422a-92dc-55681c07b3b5 None None] MFA Rules not processed for user `b21a2ac6630a4d7fb3102edd66d04848`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:58.164218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3547e114-8353-422a-92dc-55681c07b3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:58.193194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:58.229946 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1073/2155] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:58.242639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff2140-4efb-4e18-86a3-9bd73bc3e2b2 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:58.244370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a9ff2140-4efb-4e18-86a3-9bd73bc3e2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:58.309850 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:58.322657 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547e114-8353-422a-92dc-55681c07b3b5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:58.323868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3547e114-8353-422a-92dc-55681c07b3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:58.325597 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff2140-4efb-4e18-86a3-9bd73bc3e2b2 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:58.329302 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bdc60-78fa-468b-b91e-52eb707d7486 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6c4a886aec4dd290b13118e2528fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:58.330330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bdc60-78fa-468b-b91e-52eb707d7486 service glance] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:58.330330 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bdc60-78fa-468b-b91e-52eb707d7486 service glance] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:58.330531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bdc60-78fa-468b-b91e-52eb707d7486 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:58.339377 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bdc60-78fa-468b-b91e-52eb707d7486 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:58.340795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bdc60-78fa-468b-b91e-52eb707d7486 service glance] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:58.351520 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1083/2156] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:58.395802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547e114-8353-422a-92dc-55681c07b3b5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:58.400689 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76b1eb-464c-486e-ab58-4ba535e25f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:58.401342 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76b1eb-464c-486e-ab58-4ba535e25f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:58.401625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76b1eb-464c-486e-ab58-4ba535e25f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:58.401937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76b1eb-464c-486e-ab58-4ba535e25f68 admin admin] PATH_INFO: `/v3/users/cae5dfdbb99e4e9abc72be2220655854` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:58.403132 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76b1eb-464c-486e-ab58-4ba535e25f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae5dfdbb99e4e9abc72be2220655854)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:58.405112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76b1eb-464c-486e-ab58-4ba535e25f68 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:58.459982 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cc76b1eb-464c-486e-ab58-4ba535e25f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae5dfdbb99e4e9abc72be2220655854'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:58.468388 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cc76b1eb-464c-486e-ab58-4ba535e25f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae5dfdbb99e4e9abc72be2220655854'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:58.483102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cc76b1eb-464c-486e-ab58-4ba535e25f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae5dfdbb99e4e9abc72be2220655854'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:58.490990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cc76b1eb-464c-486e-ab58-4ba535e25f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae5dfdbb99e4e9abc72be2220655854'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:58.491759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cc76b1eb-464c-486e-ab58-4ba535e25f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae5dfdbb99e4e9abc72be2220655854'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:58.498254 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1074/2157] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:24:58 2022] DELETE /identity/v3/users/cae5dfdbb99e4e9abc72be2220655854 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:24:58.502837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08be801-52fe-4fe7-8f42-7fb706056d81 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:58.503125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08be801-52fe-4fe7-8f42-7fb706056d81 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:58.503399 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08be801-52fe-4fe7-8f42-7fb706056d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:58.524407 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d08be801-52fe-4fe7-8f42-7fb706056d81 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:58.525775 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d08be801-52fe-4fe7-8f42-7fb706056d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:58.589640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1084/2158] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:58.599962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76b1eb-464c-486e-ab58-4ba535e25f68 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:58.601504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cc76b1eb-464c-486e-ab58-4ba535e25f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:58.657067 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:58.662238 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76b1eb-464c-486e-ab58-4ba535e25f68 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:58.667666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260756e7-b7ef-4553-b70c-b304d334c173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:58.668363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260756e7-b7ef-4553-b70c-b304d334c173 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:58.668677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260756e7-b7ef-4553-b70c-b304d334c173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:58.669194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260756e7-b7ef-4553-b70c-b304d334c173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:58.683230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260756e7-b7ef-4553-b70c-b304d334c173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:58.684668 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260756e7-b7ef-4553-b70c-b304d334c173 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:58.694429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1075/2159] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:24:59.021135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08be801-52fe-4fe7-8f42-7fb706056d81 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:59.024322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d08be801-52fe-4fe7-8f42-7fb706056d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:59.036889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08be801-52fe-4fe7-8f42-7fb706056d81 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:59.043839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9daef-e6b7-4b1c-b6cf-92256667c895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:59.044481 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9daef-e6b7-4b1c-b6cf-92256667c895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:59.044760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9daef-e6b7-4b1c-b6cf-92256667c895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:59.045077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9daef-e6b7-4b1c-b6cf-92256667c895 admin admin] PATH_INFO: `/v3/projects/e7f6bf644e2a4701b690cdccea037bfb` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:59.046352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9daef-e6b7-4b1c-b6cf-92256667c895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7f6bf644e2a4701b690cdccea037bfb)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:59.048682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9daef-e6b7-4b1c-b6cf-92256667c895 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:59.098670 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-31e9daef-e6b7-4b1c-b6cf-92256667c895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7f6bf644e2a4701b690cdccea037bfb', 'request_id': 'req-31e9daef-e6b7-4b1c-b6cf-92256667c895'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:59.104134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-31e9daef-e6b7-4b1c-b6cf-92256667c895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7f6bf644e2a4701b690cdccea037bfb', 'request_id': 'req-31e9daef-e6b7-4b1c-b6cf-92256667c895'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:59.110675 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-31e9daef-e6b7-4b1c-b6cf-92256667c895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7f6bf644e2a4701b690cdccea037bfb', 'request_id': 'req-31e9daef-e6b7-4b1c-b6cf-92256667c895'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:59.122720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-31e9daef-e6b7-4b1c-b6cf-92256667c895 admin admin] The token cache is being invalidate because project e7f6bf644e2a4701b690cdccea037bfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:24:59.122953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-31e9daef-e6b7-4b1c-b6cf-92256667c895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:59.123574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-31e9daef-e6b7-4b1c-b6cf-92256667c895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:24:59.125052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1085/2160] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:24:59 2022] DELETE /identity/v3/projects/e7f6bf644e2a4701b690cdccea037bfb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:59.131611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39b03c-ccc0-48a6-a6a9-ffb7add529ac None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:59.131895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39b03c-ccc0-48a6-a6a9-ffb7add529ac None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:59.132171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39b03c-ccc0-48a6-a6a9-ffb7add529ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:59.152709 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cc39b03c-ccc0-48a6-a6a9-ffb7add529ac None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:59.153937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cc39b03c-ccc0-48a6-a6a9-ffb7add529ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:59.214714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1076/2161] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:59.222991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46052d4a-494a-4c14-9111-939ea163723d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:59.223297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46052d4a-494a-4c14-9111-939ea163723d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:59.223578 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46052d4a-494a-4c14-9111-939ea163723d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:59.244622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-46052d4a-494a-4c14-9111-939ea163723d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:59.245836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-46052d4a-494a-4c14-9111-939ea163723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:59.255637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1086/2162] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:59.259929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39b03c-ccc0-48a6-a6a9-ffb7add529ac None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:59.270450 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39b03c-ccc0-48a6-a6a9-ffb7add529ac None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:59.275155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0eed4-7867-4852-a851-c68c436981a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:59.275752 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0eed4-7867-4852-a851-c68c436981a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:59.276028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0eed4-7867-4852-a851-c68c436981a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:59.276298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0eed4-7867-4852-a851-c68c436981a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:59.276988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0eed4-7867-4852-a851-c68c436981a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:24:59.277287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0eed4-7867-4852-a851-c68c436981a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:59.278971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0eed4-7867-4852-a851-c68c436981a6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:59.290889 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1077/2163] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:24:59.297651 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46052d4a-494a-4c14-9111-939ea163723d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:59.307807 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46052d4a-494a-4c14-9111-939ea163723d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:59.312730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690c88e-4ed6-4edb-b0bd-807be56ee30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:59.313324 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690c88e-4ed6-4edb-b0bd-807be56ee30c admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:59.313599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690c88e-4ed6-4edb-b0bd-807be56ee30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:59.313898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690c88e-4ed6-4edb-b0bd-807be56ee30c admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:59.314531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690c88e-4ed6-4edb-b0bd-807be56ee30c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:59.317346 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690c88e-4ed6-4edb-b0bd-807be56ee30c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:59.344371 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1087/2164] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:24:59 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:24:59.348940 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0eed4-7867-4852-a851-c68c436981a6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:59.359362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0eed4-7867-4852-a851-c68c436981a6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:59.434673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb8132-7555-46e1-9fb1-46f6785301e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:59.435294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb8132-7555-46e1-9fb1-46f6785301e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:59.435570 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb8132-7555-46e1-9fb1-46f6785301e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:59.435835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb8132-7555-46e1-9fb1-46f6785301e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:59.436502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb8132-7555-46e1-9fb1-46f6785301e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:59.438486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb8132-7555-46e1-9fb1-46f6785301e1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:59.462525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1078/2165] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:24:59 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:24:59.466802 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690c88e-4ed6-4edb-b0bd-807be56ee30c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:59.478319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690c88e-4ed6-4edb-b0bd-807be56ee30c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:59.482876 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba98364-8bc1-4177-8525-dd602de5fc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:59.483471 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba98364-8bc1-4177-8525-dd602de5fc93 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:59.483751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba98364-8bc1-4177-8525-dd602de5fc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:59.484023 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba98364-8bc1-4177-8525-dd602de5fc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:59.484661 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba98364-8bc1-4177-8525-dd602de5fc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:59.486279 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba98364-8bc1-4177-8525-dd602de5fc93 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:59.495992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1088/2166] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:24:59.500012 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb8132-7555-46e1-9fb1-46f6785301e1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:59.514771 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb8132-7555-46e1-9fb1-46f6785301e1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:59.520768 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f00756-f021-4c57-b56d-86ea4dd6c085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:59.521533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f00756-f021-4c57-b56d-86ea4dd6c085 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:59.521854 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f00756-f021-4c57-b56d-86ea4dd6c085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:59.522124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f00756-f021-4c57-b56d-86ea4dd6c085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:59.522826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f00756-f021-4c57-b56d-86ea4dd6c085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:59.524460 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f00756-f021-4c57-b56d-86ea4dd6c085 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:59.536441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1079/2167] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:24:59.540727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba98364-8bc1-4177-8525-dd602de5fc93 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:59.550952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba98364-8bc1-4177-8525-dd602de5fc93 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:59.556192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb77eb-98da-40a6-bcf0-26d41766a376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:59.556906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb77eb-98da-40a6-bcf0-26d41766a376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:59.557190 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb77eb-98da-40a6-bcf0-26d41766a376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:59.557575 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb77eb-98da-40a6-bcf0-26d41766a376 admin admin] PATH_INFO: `/v3/projects/51f0f961f2ff45ac8dd736ac47994cb1/users/9b93275797a4484d97e1251e86fa27c2/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:59.575152 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb77eb-98da-40a6-bcf0-26d41766a376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f0f961f2ff45ac8dd736ac47994cb1, user_id=9b93275797a4484d97e1251e86fa27c2, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:59.577819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb77eb-98da-40a6-bcf0-26d41766a376 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:59.587054 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:59.592208 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1089/2168] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:24:59 2022] PUT /identity/v3/projects/51f0f961f2ff45ac8dd736ac47994cb1/users/9b93275797a4484d97e1251e86fa27c2/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:24:59.603025 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d058f5-ab26-4801-939c-4f45e5fa86a6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:59.603312 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d058f5-ab26-4801-939c-4f45e5fa86a6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:59.603615 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d058f5-ab26-4801-939c-4f45e5fa86a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:59.631716 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-26d058f5-ab26-4801-939c-4f45e5fa86a6 None None] MFA Rules not processed for user `9b93275797a4484d97e1251e86fa27c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:24:59.632921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-26d058f5-ab26-4801-939c-4f45e5fa86a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:59.681815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:59.702331 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1080/2169] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:24:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:24:59.714766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb77eb-98da-40a6-bcf0-26d41766a376 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:24:59.716443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-84fb77eb-98da-40a6-bcf0-26d41766a376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:24:59.785811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb77eb-98da-40a6-bcf0-26d41766a376 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:24:59.789433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f977e-ab27-437c-81fb-a86bd068999c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:24:59.790073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f977e-ab27-437c-81fb-a86bd068999c service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:24:59.790353 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f977e-ab27-437c-81fb-a86bd068999c service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:24:59.790624 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f977e-ab27-437c-81fb-a86bd068999c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:24:59.798839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f977e-ab27-437c-81fb-a86bd068999c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:24:59.800359 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f977e-ab27-437c-81fb-a86bd068999c service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:24:59.808969 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1090/2170] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:24:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:25:09.699393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=6 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:09.805239 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=26 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:21.243074 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d5285-c6b5-4e88-a6d2-3a5b74f80f49 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:21.243594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d5285-c6b5-4e88-a6d2-3a5b74f80f49 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:21.243783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d5285-c6b5-4e88-a6d2-3a5b74f80f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:21.264756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-804d5285-c6b5-4e88-a6d2-3a5b74f80f49 None None] MFA Rules not processed for user `41d1e8b097a14cba91218e7a9b32f6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:25:21.265989 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-804d5285-c6b5-4e88-a6d2-3a5b74f80f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:21.326651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1081/2171] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:25:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:25:26.649128 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f977e-ab27-437c-81fb-a86bd068999c service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:25:26.650617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7c3f977e-ab27-437c-81fb-a86bd068999c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:26.718701 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f977e-ab27-437c-81fb-a86bd068999c service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:25:26.723741 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9eb3c1-6550-440b-9d87-61cfbb5afe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:25:26.724369 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eb3c1-6550-440b-9d87-61cfbb5afe73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:26.724650 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eb3c1-6550-440b-9d87-61cfbb5afe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:26.724927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eb3c1-6550-440b-9d87-61cfbb5afe73 admin admin] PATH_INFO: `/v3/users/b21a2ac6630a4d7fb3102edd66d04848` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:26.726092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9eb3c1-6550-440b-9d87-61cfbb5afe73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b21a2ac6630a4d7fb3102edd66d04848)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:25:26.728058 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9eb3c1-6550-440b-9d87-61cfbb5afe73 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:25:26.784359 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2e9eb3c1-6550-440b-9d87-61cfbb5afe73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b21a2ac6630a4d7fb3102edd66d04848'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:26.785342 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2e9eb3c1-6550-440b-9d87-61cfbb5afe73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b21a2ac6630a4d7fb3102edd66d04848'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:26.793440 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2e9eb3c1-6550-440b-9d87-61cfbb5afe73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b21a2ac6630a4d7fb3102edd66d04848'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:26.806683 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2e9eb3c1-6550-440b-9d87-61cfbb5afe73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b21a2ac6630a4d7fb3102edd66d04848'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:26.813413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2e9eb3c1-6550-440b-9d87-61cfbb5afe73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b21a2ac6630a4d7fb3102edd66d04848'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:26.820271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1091/2172] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:25:26 2022] DELETE /identity/v3/users/b21a2ac6630a4d7fb3102edd66d04848 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:25:26.824966 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647da34-ac37-4ac2-b448-025018d03b38 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:26.825445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647da34-ac37-4ac2-b448-025018d03b38 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:26.825537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647da34-ac37-4ac2-b448-025018d03b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:26.845157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0647da34-ac37-4ac2-b448-025018d03b38 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:25:26.846400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0647da34-ac37-4ac2-b448-025018d03b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:26.919856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1082/2173] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:25:26.928730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9eb3c1-6550-440b-9d87-61cfbb5afe73 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:25:26.930247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2e9eb3c1-6550-440b-9d87-61cfbb5afe73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:26.989093 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9eb3c1-6550-440b-9d87-61cfbb5afe73 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:25:26.992764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd750b1f-a1d6-4fca-a3fb-0ea72ceb2910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:25:26.993371 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd750b1f-a1d6-4fca-a3fb-0ea72ceb2910 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:26.993653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd750b1f-a1d6-4fca-a3fb-0ea72ceb2910 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:26.993964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd750b1f-a1d6-4fca-a3fb-0ea72ceb2910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:27.002896 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd750b1f-a1d6-4fca-a3fb-0ea72ceb2910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:25:27.004450 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd750b1f-a1d6-4fca-a3fb-0ea72ceb2910 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:25:27.013766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1092/2174] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:25:27.278505 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647da34-ac37-4ac2-b448-025018d03b38 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:25:27.280006 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0647da34-ac37-4ac2-b448-025018d03b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:27.292635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647da34-ac37-4ac2-b448-025018d03b38 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:25:27.297934 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8b38c-c8a9-4662-8cb1-e563a67d4654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:25:27.298564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8b38c-c8a9-4662-8cb1-e563a67d4654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:27.298841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8b38c-c8a9-4662-8cb1-e563a67d4654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:27.299123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8b38c-c8a9-4662-8cb1-e563a67d4654 admin admin] PATH_INFO: `/v3/projects/739306f960ff4c068646c3b8a20bfafe` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:27.300275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8b38c-c8a9-4662-8cb1-e563a67d4654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=739306f960ff4c068646c3b8a20bfafe)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:25:27.303608 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8b38c-c8a9-4662-8cb1-e563a67d4654 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:25:27.359393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-76c8b38c-c8a9-4662-8cb1-e563a67d4654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '739306f960ff4c068646c3b8a20bfafe', 'request_id': 'req-76c8b38c-c8a9-4662-8cb1-e563a67d4654'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:27.366539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-76c8b38c-c8a9-4662-8cb1-e563a67d4654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '739306f960ff4c068646c3b8a20bfafe', 'request_id': 'req-76c8b38c-c8a9-4662-8cb1-e563a67d4654'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:27.376785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-76c8b38c-c8a9-4662-8cb1-e563a67d4654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '739306f960ff4c068646c3b8a20bfafe', 'request_id': 'req-76c8b38c-c8a9-4662-8cb1-e563a67d4654'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:27.401578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-76c8b38c-c8a9-4662-8cb1-e563a67d4654 admin admin] The token cache is being invalidate because project 739306f960ff4c068646c3b8a20bfafe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:25:27.401964 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-76c8b38c-c8a9-4662-8cb1-e563a67d4654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:27.402689 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-76c8b38c-c8a9-4662-8cb1-e563a67d4654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:27.413710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1083/2175] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:25:27 2022] DELETE /identity/v3/projects/739306f960ff4c068646c3b8a20bfafe => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:25:35.148541 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd750b1f-a1d6-4fca-a3fb-0ea72ceb2910 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:25:35.150094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fd750b1f-a1d6-4fca-a3fb-0ea72ceb2910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:35.165536 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd750b1f-a1d6-4fca-a3fb-0ea72ceb2910 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:25:35.187221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:35.233890 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d871c-4245-4cb1-a621-4e2835ec6040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:25:35.234544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d871c-4245-4cb1-a621-4e2835ec6040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:35.234831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d871c-4245-4cb1-a621-4e2835ec6040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:35.235093 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d871c-4245-4cb1-a621-4e2835ec6040 admin admin] PATH_INFO: `/v3/users/9b93275797a4484d97e1251e86fa27c2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:35.236437 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d871c-4245-4cb1-a621-4e2835ec6040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b93275797a4484d97e1251e86fa27c2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:25:35.238519 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d871c-4245-4cb1-a621-4e2835ec6040 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:25:35.297157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5c3d871c-4245-4cb1-a621-4e2835ec6040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b93275797a4484d97e1251e86fa27c2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:35.298207 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5c3d871c-4245-4cb1-a621-4e2835ec6040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b93275797a4484d97e1251e86fa27c2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:35.306550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5c3d871c-4245-4cb1-a621-4e2835ec6040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b93275797a4484d97e1251e86fa27c2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:35.319911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5c3d871c-4245-4cb1-a621-4e2835ec6040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b93275797a4484d97e1251e86fa27c2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:35.326836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5c3d871c-4245-4cb1-a621-4e2835ec6040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b93275797a4484d97e1251e86fa27c2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:35.336510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1093/2176] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:25:35 2022] DELETE /identity/v3/users/9b93275797a4484d97e1251e86fa27c2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:25:35.340931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b27b34-5700-46d6-969e-88d73443de15 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:35.341392 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b27b34-5700-46d6-969e-88d73443de15 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:35.341625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b27b34-5700-46d6-969e-88d73443de15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:35.363038 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e7b27b34-5700-46d6-969e-88d73443de15 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:25:35.364990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e7b27b34-5700-46d6-969e-88d73443de15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:35.398156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:35.462594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1084/2177] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:25:35.468911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d871c-4245-4cb1-a621-4e2835ec6040 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:25:35.470370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5c3d871c-4245-4cb1-a621-4e2835ec6040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:35.545241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d871c-4245-4cb1-a621-4e2835ec6040 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:25:35.549210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027c78f-aba6-48c4-8707-cdc69892b1c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:25:35.549901 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027c78f-aba6-48c4-8707-cdc69892b1c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:35.550162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027c78f-aba6-48c4-8707-cdc69892b1c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:35.550454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027c78f-aba6-48c4-8707-cdc69892b1c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:35.562031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027c78f-aba6-48c4-8707-cdc69892b1c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:25:35.563152 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027c78f-aba6-48c4-8707-cdc69892b1c1 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:25:35.574276 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1094/2178] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:25:35.852043 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b27b34-5700-46d6-969e-88d73443de15 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:25:35.853463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e7b27b34-5700-46d6-969e-88d73443de15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:35.874200 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b27b34-5700-46d6-969e-88d73443de15 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:25:35.889024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094a1da-6004-4dfb-b33f-2b1f400f2885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:25:35.889731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094a1da-6004-4dfb-b33f-2b1f400f2885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:35.890012 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094a1da-6004-4dfb-b33f-2b1f400f2885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:35.890286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094a1da-6004-4dfb-b33f-2b1f400f2885 admin admin] PATH_INFO: `/v3/projects/51f0f961f2ff45ac8dd736ac47994cb1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:35.891581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094a1da-6004-4dfb-b33f-2b1f400f2885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f0f961f2ff45ac8dd736ac47994cb1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:25:35.894071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094a1da-6004-4dfb-b33f-2b1f400f2885 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:25:35.977333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4094a1da-6004-4dfb-b33f-2b1f400f2885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f0f961f2ff45ac8dd736ac47994cb1', 'request_id': 'req-4094a1da-6004-4dfb-b33f-2b1f400f2885'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:35.984376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4094a1da-6004-4dfb-b33f-2b1f400f2885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f0f961f2ff45ac8dd736ac47994cb1', 'request_id': 'req-4094a1da-6004-4dfb-b33f-2b1f400f2885'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:35.994484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4094a1da-6004-4dfb-b33f-2b1f400f2885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f0f961f2ff45ac8dd736ac47994cb1', 'request_id': 'req-4094a1da-6004-4dfb-b33f-2b1f400f2885'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:36.013468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4094a1da-6004-4dfb-b33f-2b1f400f2885 admin admin] The token cache is being invalidate because project 51f0f961f2ff45ac8dd736ac47994cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:25:36.014041 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4094a1da-6004-4dfb-b33f-2b1f400f2885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:36.015699 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4094a1da-6004-4dfb-b33f-2b1f400f2885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:25:36.019500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1085/2179] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:25:35 2022] DELETE /identity/v3/projects/51f0f961f2ff45ac8dd736ac47994cb1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:25:36.024392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac8ab7-dcd5-4df2-9c92-54ecd97cb4a5 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:36.024684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac8ab7-dcd5-4df2-9c92-54ecd97cb4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:36.024968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac8ab7-dcd5-4df2-9c92-54ecd97cb4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:36.055050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-00ac8ab7-dcd5-4df2-9c92-54ecd97cb4a5 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:25:36.056530 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-00ac8ab7-dcd5-4df2-9c92-54ecd97cb4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:36.123442 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:36.153733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1095/2180] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:25:36.159618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69a4b7-83ab-47c7-8c0b-1eb609033c92 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:36.160315 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69a4b7-83ab-47c7-8c0b-1eb609033c92 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:36.160315 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69a4b7-83ab-47c7-8c0b-1eb609033c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:36.184350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3a69a4b7-83ab-47c7-8c0b-1eb609033c92 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:25:36.186218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3a69a4b7-83ab-47c7-8c0b-1eb609033c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:36.196569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1086/2181] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:25:36.200803 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac8ab7-dcd5-4df2-9c92-54ecd97cb4a5 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:25:36.211085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac8ab7-dcd5-4df2-9c92-54ecd97cb4a5 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:25:36.215652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3100847-f0dc-4d18-9f4c-c501cbee81fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:25:36.216262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3100847-f0dc-4d18-9f4c-c501cbee81fc admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:36.216541 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3100847-f0dc-4d18-9f4c-c501cbee81fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:36.216815 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3100847-f0dc-4d18-9f4c-c501cbee81fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:36.217461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3100847-f0dc-4d18-9f4c-c501cbee81fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:25:36.217799 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3100847-f0dc-4d18-9f4c-c501cbee81fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:25:36.219560 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3100847-f0dc-4d18-9f4c-c501cbee81fc admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:25:36.232923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1096/2182] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:25:36.237301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69a4b7-83ab-47c7-8c0b-1eb609033c92 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:25:36.248106 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69a4b7-83ab-47c7-8c0b-1eb609033c92 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:25:36.252876 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59576-f5ea-4133-892d-2266e4bc2397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:25:36.253484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59576-f5ea-4133-892d-2266e4bc2397 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:36.253793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59576-f5ea-4133-892d-2266e4bc2397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:36.254095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59576-f5ea-4133-892d-2266e4bc2397 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:36.254930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c59576-f5ea-4133-892d-2266e4bc2397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:25:36.256841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c59576-f5ea-4133-892d-2266e4bc2397 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:25:36.295131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1087/2183] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:25:36 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:25:36.299480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3100847-f0dc-4d18-9f4c-c501cbee81fc admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:25:36.313981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3100847-f0dc-4d18-9f4c-c501cbee81fc admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:25:36.378739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1762d3d-d159-4ae6-bfaf-a5a36386d3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:25:36.379391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1762d3d-d159-4ae6-bfaf-a5a36386d3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:36.379673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1762d3d-d159-4ae6-bfaf-a5a36386d3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:36.379948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1762d3d-d159-4ae6-bfaf-a5a36386d3f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:36.380599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1762d3d-d159-4ae6-bfaf-a5a36386d3f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:25:36.382584 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1762d3d-d159-4ae6-bfaf-a5a36386d3f3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:25:36.411176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1097/2184] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:25:36 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:25:36.416032 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59576-f5ea-4133-892d-2266e4bc2397 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:25:36.432037 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59576-f5ea-4133-892d-2266e4bc2397 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:25:36.439190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313f84e-a61c-4f8d-80d2-069b1bdb28f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:25:36.439907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313f84e-a61c-4f8d-80d2-069b1bdb28f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:36.440256 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313f84e-a61c-4f8d-80d2-069b1bdb28f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:36.440834 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313f84e-a61c-4f8d-80d2-069b1bdb28f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:36.441307 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313f84e-a61c-4f8d-80d2-069b1bdb28f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:25:36.443300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313f84e-a61c-4f8d-80d2-069b1bdb28f6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:25:36.475862 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1088/2185] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:25:36.476489 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1762d3d-d159-4ae6-bfaf-a5a36386d3f3 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:25:36.491645 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1762d3d-d159-4ae6-bfaf-a5a36386d3f3 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:25:36.499139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdaf91-f1bc-498f-8853-6100e98d20b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:25:36.499918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdaf91-f1bc-498f-8853-6100e98d20b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:36.500204 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdaf91-f1bc-498f-8853-6100e98d20b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:36.500523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdaf91-f1bc-498f-8853-6100e98d20b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:36.501166 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdaf91-f1bc-498f-8853-6100e98d20b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:25:36.502938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdaf91-f1bc-498f-8853-6100e98d20b0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:25:36.521810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1098/2186] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:25:36.523764 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313f84e-a61c-4f8d-80d2-069b1bdb28f6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:25:36.534324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313f84e-a61c-4f8d-80d2-069b1bdb28f6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:25:36.539595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465a3e6-d7b2-4399-94c0-97a45e83e37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:25:36.540330 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465a3e6-d7b2-4399-94c0-97a45e83e37f admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:36.540692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465a3e6-d7b2-4399-94c0-97a45e83e37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:36.541058 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465a3e6-d7b2-4399-94c0-97a45e83e37f admin admin] PATH_INFO: `/v3/projects/c4db862f82be4944947e4b7903ae2980/users/4c678c970a1f44ee954a95e82e6d4313/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:36.556552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465a3e6-d7b2-4399-94c0-97a45e83e37f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4db862f82be4944947e4b7903ae2980, user_id=4c678c970a1f44ee954a95e82e6d4313, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:25:36.559363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465a3e6-d7b2-4399-94c0-97a45e83e37f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:25:36.575575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1089/2187] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:25:36 2022] PUT /identity/v3/projects/c4db862f82be4944947e4b7903ae2980/users/4c678c970a1f44ee954a95e82e6d4313/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:25:36.587861 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e35e99-19f4-41e7-b8e7-438b3f506b16 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:36.588277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e35e99-19f4-41e7-b8e7-438b3f506b16 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:36.588564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e35e99-19f4-41e7-b8e7-438b3f506b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:36.619859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-88e35e99-19f4-41e7-b8e7-438b3f506b16 None None] MFA Rules not processed for user `4c678c970a1f44ee954a95e82e6d4313`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:25:36.620748 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-88e35e99-19f4-41e7-b8e7-438b3f506b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:36.686447 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1099/2188] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:25:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:25:36.697728 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465a3e6-d7b2-4399-94c0-97a45e83e37f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:25:36.699420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4465a3e6-d7b2-4399-94c0-97a45e83e37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:36.752723 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:36.757412 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465a3e6-d7b2-4399-94c0-97a45e83e37f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:25:36.761791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e33d5-f20a-4b44-ad6d-45c8feb77c24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:25:36.762432 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e33d5-f20a-4b44-ad6d-45c8feb77c24 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:36.762931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e33d5-f20a-4b44-ad6d-45c8feb77c24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:36.763376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e33d5-f20a-4b44-ad6d-45c8feb77c24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:36.771969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e33d5-f20a-4b44-ad6d-45c8feb77c24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:25:36.773414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e33d5-f20a-4b44-ad6d-45c8feb77c24 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:25:36.782125 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1090/2189] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:25:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:25:38.235040 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cc85e-87da-492a-9bd3-c9ad2622637f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:38.235539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cc85e-87da-492a-9bd3-c9ad2622637f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:38.235628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cc85e-87da-492a-9bd3-c9ad2622637f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:38.256129 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a53cc85e-87da-492a-9bd3-c9ad2622637f None None] MFA Rules not processed for user `4c678c970a1f44ee954a95e82e6d4313`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:25:38.257655 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a53cc85e-87da-492a-9bd3-c9ad2622637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:38.264584 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1100/2190] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:25:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:25:42.727361 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce8fbb-dbbf-47ba-94a7-d7013dc76496 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:42.727934 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce8fbb-dbbf-47ba-94a7-d7013dc76496 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:42.727934 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce8fbb-dbbf-47ba-94a7-d7013dc76496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:42.750363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-01ce8fbb-dbbf-47ba-94a7-d7013dc76496 None None] MFA Rules not processed for user `0b41c6ab73144570a7291dc674d95e66`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:25:42.751574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-01ce8fbb-dbbf-47ba-94a7-d7013dc76496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:42.812874 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1091/2191] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:25:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:25:47.158833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e0389-d5ad-42cc-ac53-435b6fb0b93d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:47.159425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e0389-d5ad-42cc-ac53-435b6fb0b93d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:47.159719 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e0389-d5ad-42cc-ac53-435b6fb0b93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:47.182424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b34e0389-d5ad-42cc-ac53-435b6fb0b93d None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:25:47.183987 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b34e0389-d5ad-42cc-ac53-435b6fb0b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:47.219249 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:47.249148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1101/2192] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Sep 27 17:25:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:25:47.300454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce8fbb-dbbf-47ba-94a7-d7013dc76496 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:25:47.302623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-01ce8fbb-dbbf-47ba-94a7-d7013dc76496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:47.390591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce8fbb-dbbf-47ba-94a7-d7013dc76496 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:25:47.396782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b3c3a-1b81-4ec0-9dfb-3788062ebdd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:25:47.397403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b3c3a-1b81-4ec0-9dfb-3788062ebdd3 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:47.397728 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b3c3a-1b81-4ec0-9dfb-3788062ebdd3 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:47.397986 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b3c3a-1b81-4ec0-9dfb-3788062ebdd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:47.411914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b3c3a-1b81-4ec0-9dfb-3788062ebdd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:25:47.418275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b3c3a-1b81-4ec0-9dfb-3788062ebdd3 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:25:47.445843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1092/2193] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:25:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 17:25:57.242317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=10 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:57.429450 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=61 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:59.869705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182f24b-51de-4ef0-baa7-7d03406925a7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:59.870171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182f24b-51de-4ef0-baa7-7d03406925a7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:59.870274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182f24b-51de-4ef0-baa7-7d03406925a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:59.891194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0182f24b-51de-4ef0-baa7-7d03406925a7 None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:25:59.892412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0182f24b-51de-4ef0-baa7-7d03406925a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:25:59.899999 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1102/2194] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Sep 27 17:25:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:25:59.911815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b3c3a-1b81-4ec0-9dfb-3788062ebdd3 service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:25:59.922178 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b3c3a-1b81-4ec0-9dfb-3788062ebdd3 service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:25:59.928105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c591a-716c-46f0-8c5c-685a386302cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:25:59.928705 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c591a-716c-46f0-8c5c-685a386302cc service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:25:59.928984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c591a-716c-46f0-8c5c-685a386302cc service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:25:59.929256 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c591a-716c-46f0-8c5c-685a386302cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:25:59.937551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c591a-716c-46f0-8c5c-685a386302cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:25:59.939083 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c591a-716c-46f0-8c5c-685a386302cc service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:25:59.948126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1093/2195] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:25:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 17:26:00.505818 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1110de4-409e-4081-b5ec-7f4d12920a9e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:00.506092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1110de4-409e-4081-b5ec-7f4d12920a9e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:00.506360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1110de4-409e-4081-b5ec-7f4d12920a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:00.527292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b1110de4-409e-4081-b5ec-7f4d12920a9e None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:00.528511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b1110de4-409e-4081-b5ec-7f4d12920a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:00.536329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1103/2196] 10.222.0.57 () {58 vars in 967 bytes} [Tue Sep 27 17:26:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:26:00.549950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c591a-716c-46f0-8c5c-685a386302cc service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:00.560890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c591a-716c-46f0-8c5c-685a386302cc service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:00.566712 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec7c5e-3840-4305-b4dd-556bd425d92c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:00.567310 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec7c5e-3840-4305-b4dd-556bd425d92c service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:00.567662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec7c5e-3840-4305-b4dd-556bd425d92c service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:00.568008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec7c5e-3840-4305-b4dd-556bd425d92c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:00.577446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec7c5e-3840-4305-b4dd-556bd425d92c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:00.579063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec7c5e-3840-4305-b4dd-556bd425d92c service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:00.589942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1094/2197] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:26:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 17:26:00.874073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c72a9-6d08-4f00-8ae2-657dc54f56e0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:00.874073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c72a9-6d08-4f00-8ae2-657dc54f56e0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:00.874659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c72a9-6d08-4f00-8ae2-657dc54f56e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:00.894123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ba7c72a9-6d08-4f00-8ae2-657dc54f56e0 None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:00.895636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ba7c72a9-6d08-4f00-8ae2-657dc54f56e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:00.903424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1104/2198] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Sep 27 17:26:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:00.916604 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec7c5e-3840-4305-b4dd-556bd425d92c service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:00.927995 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec7c5e-3840-4305-b4dd-556bd425d92c service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:00.933298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217f4d0-abc8-478d-8ace-61d44513d5a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:00.933993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217f4d0-abc8-478d-8ace-61d44513d5a4 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:00.934342 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217f4d0-abc8-478d-8ace-61d44513d5a4 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:00.934700 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217f4d0-abc8-478d-8ace-61d44513d5a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:00.944569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217f4d0-abc8-478d-8ace-61d44513d5a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:00.946188 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217f4d0-abc8-478d-8ace-61d44513d5a4 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:00.954259 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1095/2199] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:26:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 17:26:01.351772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5edd-d9a6-463f-9ad8-af2372df8f05 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:01.352143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5edd-d9a6-463f-9ad8-af2372df8f05 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:01.352415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5edd-d9a6-463f-9ad8-af2372df8f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:01.373540 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-890d5edd-d9a6-463f-9ad8-af2372df8f05 None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:01.374990 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-890d5edd-d9a6-463f-9ad8-af2372df8f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:01.382931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1105/2200] 10.222.0.57 () {58 vars in 967 bytes} [Tue Sep 27 17:26:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:01.397528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217f4d0-abc8-478d-8ace-61d44513d5a4 service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:01.412369 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217f4d0-abc8-478d-8ace-61d44513d5a4 service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:01.424960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5f133-0a28-4e21-a3c6-bbcb55a33842 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:01.425906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5f133-0a28-4e21-a3c6-bbcb55a33842 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:01.426390 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5f133-0a28-4e21-a3c6-bbcb55a33842 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:01.426871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5f133-0a28-4e21-a3c6-bbcb55a33842 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:01.437459 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5f133-0a28-4e21-a3c6-bbcb55a33842 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:01.439212 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5f133-0a28-4e21-a3c6-bbcb55a33842 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:01.447868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1096/2201] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:26:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 17:26:02.618402 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee289c86-187e-4f15-a510-028ea85b83de None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:02.618932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee289c86-187e-4f15-a510-028ea85b83de None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:02.619109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee289c86-187e-4f15-a510-028ea85b83de None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:02.620532 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1106/2202] 10.222.0.57 () {54 vars in 921 bytes} [Tue Sep 27 17:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:26:02.626185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec280b3-5c87-44c3-a111-766e05b7caf0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:02.626706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec280b3-5c87-44c3-a111-766e05b7caf0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:02.626902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec280b3-5c87-44c3-a111-766e05b7caf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:02.647627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8ec280b3-5c87-44c3-a111-766e05b7caf0 None None] MFA Rules not processed for user `e75b03fde75e411bace8d406237a7e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:02.648940 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8ec280b3-5c87-44c3-a111-766e05b7caf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:02.722878 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1097/2203] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Sep 27 17:26:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:02.735926 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee289c86-187e-4f15-a510-028ea85b83de None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:02.737909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ee289c86-187e-4f15-a510-028ea85b83de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:02.808469 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee289c86-187e-4f15-a510-028ea85b83de None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:02.812085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6506c-1c8f-4215-b1d4-11709d59ef65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6c4a886aec4dd290b13118e2528fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:02.812692 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6506c-1c8f-4215-b1d4-11709d59ef65 service glance] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:02.812972 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6506c-1c8f-4215-b1d4-11709d59ef65 service glance] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:02.813251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6506c-1c8f-4215-b1d4-11709d59ef65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:02.823307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6506c-1c8f-4215-b1d4-11709d59ef65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:02.824727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6506c-1c8f-4215-b1d4-11709d59ef65 service glance] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:02.840333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1107/2204] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:26:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:26:02.908263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f561754-597c-4645-9348-182555c505bf None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:02.908551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f561754-597c-4645-9348-182555c505bf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:02.908828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f561754-597c-4645-9348-182555c505bf None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:02.910808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1098/2205] 10.222.0.57 () {54 vars in 921 bytes} [Tue Sep 27 17:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:26:02.915402 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e669f-ffb8-44b3-9d51-41ad094daa0f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:02.915689 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e669f-ffb8-44b3-9d51-41ad094daa0f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:02.915967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e669f-ffb8-44b3-9d51-41ad094daa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:02.935286 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4e7e669f-ffb8-44b3-9d51-41ad094daa0f None None] MFA Rules not processed for user `008cfc0b27d7448b9c84f8087c969e55`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:02.936476 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4e7e669f-ffb8-44b3-9d51-41ad094daa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:02.986293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1108/2206] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Sep 27 17:26:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:02.998626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f561754-597c-4645-9348-182555c505bf None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:03.000289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2f561754-597c-4645-9348-182555c505bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:03.015109 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f561754-597c-4645-9348-182555c505bf None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:03.018637 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13ebcc-b57a-4916-88ca-cc105d9d22ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:03.019858 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ebcc-b57a-4916-88ca-cc105d9d22ec service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:03.020320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ebcc-b57a-4916-88ca-cc105d9d22ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:03.020599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ebcc-b57a-4916-88ca-cc105d9d22ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:03.027614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13ebcc-b57a-4916-88ca-cc105d9d22ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:03.029022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13ebcc-b57a-4916-88ca-cc105d9d22ec service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:03.037702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1099/2207] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:26:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:26:03.118418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b66240-418b-4a86-991e-72d6c9d01273 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:03.118702 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b66240-418b-4a86-991e-72d6c9d01273 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:03.119588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b66240-418b-4a86-991e-72d6c9d01273 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:03.120935 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1109/2208] 10.222.0.57 () {54 vars in 921 bytes} [Tue Sep 27 17:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:26:03.126218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c74a9-9e45-47bc-b934-f66446dfd24f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:03.126509 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c74a9-9e45-47bc-b934-f66446dfd24f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:03.126780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c74a9-9e45-47bc-b934-f66446dfd24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:03.147277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f48c74a9-9e45-47bc-b934-f66446dfd24f None None] MFA Rules not processed for user `e75b03fde75e411bace8d406237a7e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:03.148776 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f48c74a9-9e45-47bc-b934-f66446dfd24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:03.158255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1100/2209] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Sep 27 17:26:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:03.169144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b66240-418b-4a86-991e-72d6c9d01273 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:03.180185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b66240-418b-4a86-991e-72d6c9d01273 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:03.183839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a790c-1528-4a5d-9792-f89c1c67b3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:03.184431 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a790c-1528-4a5d-9792-f89c1c67b3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:03.184713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a790c-1528-4a5d-9792-f89c1c67b3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:03.184985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a790c-1528-4a5d-9792-f89c1c67b3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:03.195479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a790c-1528-4a5d-9792-f89c1c67b3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:03.196892 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a790c-1528-4a5d-9792-f89c1c67b3f9 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:03.208393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1110/2210] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:26:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:26:03.619280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c74a9-9e45-47bc-b934-f66446dfd24f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:03.687465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c74a9-9e45-47bc-b934-f66446dfd24f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:03.693526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd9ef1-c37b-4254-81bd-da904277ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:03.694696 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd9ef1-c37b-4254-81bd-da904277ba43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:03.694696 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd9ef1-c37b-4254-81bd-da904277ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:03.694696 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd9ef1-c37b-4254-81bd-da904277ba43 admin admin] PATH_INFO: `/v3/users/4c678c970a1f44ee954a95e82e6d4313` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:03.695912 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd9ef1-c37b-4254-81bd-da904277ba43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c678c970a1f44ee954a95e82e6d4313)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:03.697860 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd9ef1-c37b-4254-81bd-da904277ba43 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:03.720387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:03.748505 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-72cd9ef1-c37b-4254-81bd-da904277ba43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c678c970a1f44ee954a95e82e6d4313'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:26:03.756756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-72cd9ef1-c37b-4254-81bd-da904277ba43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c678c970a1f44ee954a95e82e6d4313'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:26:03.768990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-72cd9ef1-c37b-4254-81bd-da904277ba43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c678c970a1f44ee954a95e82e6d4313'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:26:03.777024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-72cd9ef1-c37b-4254-81bd-da904277ba43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c678c970a1f44ee954a95e82e6d4313'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:26:03.777844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-72cd9ef1-c37b-4254-81bd-da904277ba43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c678c970a1f44ee954a95e82e6d4313'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:26:03.789239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1101/2211] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:26:03 2022] DELETE /identity/v3/users/4c678c970a1f44ee954a95e82e6d4313 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:26:03.791256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035185e-3519-4aee-96f6-8944762fe474 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:03.791735 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035185e-3519-4aee-96f6-8944762fe474 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:03.791962 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035185e-3519-4aee-96f6-8944762fe474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:03.818574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7035185e-3519-4aee-96f6-8944762fe474 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:03.819979 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7035185e-3519-4aee-96f6-8944762fe474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:03.884400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1111/2212] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:03.894823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd9ef1-c37b-4254-81bd-da904277ba43 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:03.896381 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-72cd9ef1-c37b-4254-81bd-da904277ba43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:03.966386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd9ef1-c37b-4254-81bd-da904277ba43 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:03.970346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90145d7d-1c1e-4573-b054-031e72c969ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:03.970955 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90145d7d-1c1e-4573-b054-031e72c969ee service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:03.971282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90145d7d-1c1e-4573-b054-031e72c969ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:03.971562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90145d7d-1c1e-4573-b054-031e72c969ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:03.983171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90145d7d-1c1e-4573-b054-031e72c969ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:03.984974 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90145d7d-1c1e-4573-b054-031e72c969ee service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:03.995703 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1102/2213] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:26:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:26:04.181879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035185e-3519-4aee-96f6-8944762fe474 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:04.183304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7035185e-3519-4aee-96f6-8944762fe474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:04.199004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035185e-3519-4aee-96f6-8944762fe474 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:04.203569 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24ecad-059a-49bb-a16d-252c1114648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:04.204209 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24ecad-059a-49bb-a16d-252c1114648d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:04.204485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24ecad-059a-49bb-a16d-252c1114648d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:04.205342 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24ecad-059a-49bb-a16d-252c1114648d admin admin] PATH_INFO: `/v3/projects/c4db862f82be4944947e4b7903ae2980` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:04.205910 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24ecad-059a-49bb-a16d-252c1114648d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4db862f82be4944947e4b7903ae2980)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:04.208773 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24ecad-059a-49bb-a16d-252c1114648d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:04.218975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:04.263608 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6b24ecad-059a-49bb-a16d-252c1114648d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4db862f82be4944947e4b7903ae2980', 'request_id': 'req-6b24ecad-059a-49bb-a16d-252c1114648d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:26:04.270261 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6b24ecad-059a-49bb-a16d-252c1114648d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4db862f82be4944947e4b7903ae2980', 'request_id': 'req-6b24ecad-059a-49bb-a16d-252c1114648d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:26:04.276923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6b24ecad-059a-49bb-a16d-252c1114648d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4db862f82be4944947e4b7903ae2980', 'request_id': 'req-6b24ecad-059a-49bb-a16d-252c1114648d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:26:04.289742 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6b24ecad-059a-49bb-a16d-252c1114648d admin admin] The token cache is being invalidate because project c4db862f82be4944947e4b7903ae2980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:26:04.290034 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6b24ecad-059a-49bb-a16d-252c1114648d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:26:04.290665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6b24ecad-059a-49bb-a16d-252c1114648d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:26:04.292131 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1112/2214] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:26:04 2022] DELETE /identity/v3/projects/c4db862f82be4944947e4b7903ae2980 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:26:04.297204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b0e72-b682-4f3d-b824-de9f7206a047 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:04.297485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b0e72-b682-4f3d-b824-de9f7206a047 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:04.297891 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b0e72-b682-4f3d-b824-de9f7206a047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:04.318337 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0c1b0e72-b682-4f3d-b824-de9f7206a047 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:04.319526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0c1b0e72-b682-4f3d-b824-de9f7206a047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:04.382443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1103/2215] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:04.390122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70714-c78d-4654-9ffa-dccd92876adc None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:04.390404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70714-c78d-4654-9ffa-dccd92876adc None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:04.390680 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70714-c78d-4654-9ffa-dccd92876adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:04.411517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-bfe70714-c78d-4654-9ffa-dccd92876adc None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:04.412704 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bfe70714-c78d-4654-9ffa-dccd92876adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:04.420527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1113/2216] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:04.424760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b0e72-b682-4f3d-b824-de9f7206a047 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:04.436273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b0e72-b682-4f3d-b824-de9f7206a047 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:04.442049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe48395-6064-42a7-9fcf-d6924500c74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:04.442782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe48395-6064-42a7-9fcf-d6924500c74c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:04.443057 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe48395-6064-42a7-9fcf-d6924500c74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:04.443325 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe48395-6064-42a7-9fcf-d6924500c74c admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:04.444058 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe48395-6064-42a7-9fcf-d6924500c74c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:26:04.444289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe48395-6064-42a7-9fcf-d6924500c74c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:04.446400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe48395-6064-42a7-9fcf-d6924500c74c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:04.459658 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1104/2217] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:26:04.464362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe70714-c78d-4654-9ffa-dccd92876adc None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:04.474179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe70714-c78d-4654-9ffa-dccd92876adc None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:04.478947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdcf6a-9c70-4bf0-b653-758a7264c088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:04.479567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdcf6a-9c70-4bf0-b653-758a7264c088 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:04.479844 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdcf6a-9c70-4bf0-b653-758a7264c088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:04.480135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdcf6a-9c70-4bf0-b653-758a7264c088 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:04.480815 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdcf6a-9c70-4bf0-b653-758a7264c088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:04.482762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdcf6a-9c70-4bf0-b653-758a7264c088 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:04.511686 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1114/2218] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:26:04 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:26:04.515838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe48395-6064-42a7-9fcf-d6924500c74c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:04.526365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe48395-6064-42a7-9fcf-d6924500c74c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:04.553000 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:04.584974 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f05b42-b40b-4338-80fd-745c43821d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:04.585580 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f05b42-b40b-4338-80fd-745c43821d63 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:04.585898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f05b42-b40b-4338-80fd-745c43821d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:04.586175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f05b42-b40b-4338-80fd-745c43821d63 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:04.586837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f05b42-b40b-4338-80fd-745c43821d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:04.588747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f05b42-b40b-4338-80fd-745c43821d63 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:04.609293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1105/2219] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:26:04 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:26:04.614219 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdcf6a-9c70-4bf0-b653-758a7264c088 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:04.624210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdcf6a-9c70-4bf0-b653-758a7264c088 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:04.629736 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0866a8-71b2-4d13-acc4-2918ea3b5d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:04.630333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0866a8-71b2-4d13-acc4-2918ea3b5d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:04.630611 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0866a8-71b2-4d13-acc4-2918ea3b5d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:04.630881 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0866a8-71b2-4d13-acc4-2918ea3b5d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:04.631511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0866a8-71b2-4d13-acc4-2918ea3b5d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:04.633116 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0866a8-71b2-4d13-acc4-2918ea3b5d10 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:04.643012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1115/2220] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:26:04.647183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f05b42-b40b-4338-80fd-745c43821d63 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:04.657274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f05b42-b40b-4338-80fd-745c43821d63 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:04.662240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0eb90d-1c15-44a1-bf28-b1773aa2db19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:04.662831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0eb90d-1c15-44a1-bf28-b1773aa2db19 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:04.663113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0eb90d-1c15-44a1-bf28-b1773aa2db19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:04.663390 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0eb90d-1c15-44a1-bf28-b1773aa2db19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:04.664033 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0eb90d-1c15-44a1-bf28-b1773aa2db19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:04.665621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0eb90d-1c15-44a1-bf28-b1773aa2db19 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:04.677757 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1106/2221] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:26:04.681728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0866a8-71b2-4d13-acc4-2918ea3b5d10 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:04.692112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0866a8-71b2-4d13-acc4-2918ea3b5d10 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:04.696662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4648bd-a2c9-470b-b4ee-0824cbc41c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:04.697325 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4648bd-a2c9-470b-b4ee-0824cbc41c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:04.697614 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4648bd-a2c9-470b-b4ee-0824cbc41c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:04.697934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4648bd-a2c9-470b-b4ee-0824cbc41c70 admin admin] PATH_INFO: `/v3/projects/6e6e943c660a415dbbd2438d2174cae4/users/a3fc3346bf004fc7af20e1a523ca3180/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:04.712285 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4648bd-a2c9-470b-b4ee-0824cbc41c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6e943c660a415dbbd2438d2174cae4, user_id=a3fc3346bf004fc7af20e1a523ca3180, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:04.714953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4648bd-a2c9-470b-b4ee-0824cbc41c70 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:04.728578 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1116/2222] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:26:04 2022] PUT /identity/v3/projects/6e6e943c660a415dbbd2438d2174cae4/users/a3fc3346bf004fc7af20e1a523ca3180/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:26:04.733602 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4129982-2016-4182-b82b-378aa0f39abf None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:04.734077 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4129982-2016-4182-b82b-378aa0f39abf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:04.734191 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4129982-2016-4182-b82b-378aa0f39abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:04.753635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a4129982-2016-4182-b82b-378aa0f39abf None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:04.754967 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a4129982-2016-4182-b82b-378aa0f39abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:04.814263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1107/2223] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:04.824199 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4648bd-a2c9-470b-b4ee-0824cbc41c70 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:04.825940 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ee4648bd-a2c9-470b-b4ee-0824cbc41c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:04.885848 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4648bd-a2c9-470b-b4ee-0824cbc41c70 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:04.890902 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf13d-b766-41cb-9905-849fe4b6c321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:04.891516 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf13d-b766-41cb-9905-849fe4b6c321 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:04.891795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf13d-b766-41cb-9905-849fe4b6c321 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:04.892066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf13d-b766-41cb-9905-849fe4b6c321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:04.901660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbf13d-b766-41cb-9905-849fe4b6c321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:04.903095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbf13d-b766-41cb-9905-849fe4b6c321 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:04.913162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1117/2224] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:26:05.717031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4996738-92dd-482a-afe3-f07154bc3c80 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:05.717847 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4996738-92dd-482a-afe3-f07154bc3c80 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:05.718339 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4996738-92dd-482a-afe3-f07154bc3c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:05.732104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640e95b-4ec7-43c9-bd2c-357011cc0cd2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:05.732466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640e95b-4ec7-43c9-bd2c-357011cc0cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:05.732879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640e95b-4ec7-43c9-bd2c-357011cc0cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:05.746686 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c4996738-92dd-482a-afe3-f07154bc3c80 None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:05.747750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c4996738-92dd-482a-afe3-f07154bc3c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:05.768937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a640e95b-4ec7-43c9-bd2c-357011cc0cd2 None None] MFA Rules not processed for user `a3fc3346bf004fc7af20e1a523ca3180`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:05.770360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a640e95b-4ec7-43c9-bd2c-357011cc0cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:05.800217 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:05.822322 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1108/2225] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Sep 27 17:26:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:05.836739 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4996738-92dd-482a-afe3-f07154bc3c80 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:05.838222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c4996738-92dd-482a-afe3-f07154bc3c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:05.856693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1118/2226] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:26:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:26:05.869759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640e95b-4ec7-43c9-bd2c-357011cc0cd2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:05.871432 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a640e95b-4ec7-43c9-bd2c-357011cc0cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:05.899064 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:05.920769 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4996738-92dd-482a-afe3-f07154bc3c80 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:05.926385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2531e9-0c63-4d7c-a290-02650c187edc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:05.927005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2531e9-0c63-4d7c-a290-02650c187edc service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:05.927276 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2531e9-0c63-4d7c-a290-02650c187edc service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:05.927540 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2531e9-0c63-4d7c-a290-02650c187edc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:05.936003 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2531e9-0c63-4d7c-a290-02650c187edc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:05.937543 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2531e9-0c63-4d7c-a290-02650c187edc service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:05.944275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640e95b-4ec7-43c9-bd2c-357011cc0cd2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:05.946004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1109/2227] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:26:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 27 17:26:05.948672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e1705-b24e-4bc0-a582-4f571647ab8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:05.949191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e1705-b24e-4bc0-a582-4f571647ab8b service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:05.949392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e1705-b24e-4bc0-a582-4f571647ab8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:05.949662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e1705-b24e-4bc0-a582-4f571647ab8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:05.959247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e1705-b24e-4bc0-a582-4f571647ab8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:05.960769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e1705-b24e-4bc0-a582-4f571647ab8b service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:05.969921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1119/2228] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:26:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:26:07.544937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53f681-dfa5-47c2-bc78-77e03f47fca4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:07.545575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53f681-dfa5-47c2-bc78-77e03f47fca4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:07.545575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53f681-dfa5-47c2-bc78-77e03f47fca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:07.610912 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7d53f681-dfa5-47c2-bc78-77e03f47fca4 None None] MFA Rules not processed for user `a3fc3346bf004fc7af20e1a523ca3180`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:07.620797 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7d53f681-dfa5-47c2-bc78-77e03f47fca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:07.637943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1110/2229] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:26:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:15.965705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=42 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:17.592796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=11 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:26.124668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3d529-8625-4ff5-9628-353f43bed4d7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:26.125197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3d529-8625-4ff5-9628-353f43bed4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:26.125197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3d529-8625-4ff5-9628-353f43bed4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:26.149376 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4dc3d529-8625-4ff5-9628-353f43bed4d7 None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:26.151039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4dc3d529-8625-4ff5-9628-353f43bed4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:26.160855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1120/2230] 10.222.0.57 () {58 vars in 967 bytes} [Tue Sep 27 17:26:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:26.176570 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53f681-dfa5-47c2-bc78-77e03f47fca4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:26.191487 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53f681-dfa5-47c2-bc78-77e03f47fca4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:26.198502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea80b3-2111-4d59-8d6f-43d8b6d6eded service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:26.199218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea80b3-2111-4d59-8d6f-43d8b6d6eded service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:26.199658 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea80b3-2111-4d59-8d6f-43d8b6d6eded service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:26.200037 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea80b3-2111-4d59-8d6f-43d8b6d6eded service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:26.210402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea80b3-2111-4d59-8d6f-43d8b6d6eded service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:26.212421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea80b3-2111-4d59-8d6f-43d8b6d6eded service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:26.223558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1111/2231] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:26:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 17:26:36.141869 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:36.218793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=6 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:37.851985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3d529-8625-4ff5-9628-353f43bed4d7 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:37.853491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4dc3d529-8625-4ff5-9628-353f43bed4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:37.929601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3d529-8625-4ff5-9628-353f43bed4d7 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:37.934614 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c52b9d-c6c2-4ba2-a101-69e7ced18e23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cedb97f3c84faeaeef2b3209356842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:37.935229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c52b9d-c6c2-4ba2-a101-69e7ced18e23 service placement] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:37.935617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c52b9d-c6c2-4ba2-a101-69e7ced18e23 service placement] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:37.935886 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c52b9d-c6c2-4ba2-a101-69e7ced18e23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:37.937901 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-62c52b9d-c6c2-4ba2-a101-69e7ced18e23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:37.951231 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c52b9d-c6c2-4ba2-a101-69e7ced18e23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:37.952824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c52b9d-c6c2-4ba2-a101-69e7ced18e23 service placement] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:37.965569 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1121/2232] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:26:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:26:38.035584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09ff0-a115-4554-805f-b05e7e61b2ad None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:38.036158 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09ff0-a115-4554-805f-b05e7e61b2ad None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:38.036158 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09ff0-a115-4554-805f-b05e7e61b2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:38.058217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f5d09ff0-a115-4554-805f-b05e7e61b2ad None None] MFA Rules not processed for user `41d1e8b097a14cba91218e7a9b32f6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:38.059433 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f5d09ff0-a115-4554-805f-b05e7e61b2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:38.122389 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1112/2233] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:26:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:47.960799 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=32 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:48.115599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=25 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:48.771757 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23605090-ac12-4f6b-85e6-dabe8949b0b2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:48.771949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23605090-ac12-4f6b-85e6-dabe8949b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:48.772199 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23605090-ac12-4f6b-85e6-dabe8949b0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:48.795347 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-23605090-ac12-4f6b-85e6-dabe8949b0b2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:48.796642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-23605090-ac12-4f6b-85e6-dabe8949b0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:48.805856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1122/2234] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Sep 27 17:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:48.838021 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d09ff0-a115-4554-805f-b05e7e61b2ad None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:48.839479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f5d09ff0-a115-4554-805f-b05e7e61b2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:48.918688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d09ff0-a115-4554-805f-b05e7e61b2ad None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:48.924677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1253b-055f-4059-ad60-3dd274270e04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:48.925410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1253b-055f-4059-ad60-3dd274270e04 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:48.925715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1253b-055f-4059-ad60-3dd274270e04 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:48.926066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1253b-055f-4059-ad60-3dd274270e04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:48.934860 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1253b-055f-4059-ad60-3dd274270e04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:48.936694 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1253b-055f-4059-ad60-3dd274270e04 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:48.947694 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1113/2235] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:26:54.832477 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32432756-aa60-4339-b5e5-e08e69e034e6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:54.833919 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32432756-aa60-4339-b5e5-e08e69e034e6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:54.834195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32432756-aa60-4339-b5e5-e08e69e034e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:54.854761 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-32432756-aa60-4339-b5e5-e08e69e034e6 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:54.855977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-32432756-aa60-4339-b5e5-e08e69e034e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:54.864252 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1123/2236] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Sep 27 17:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:54.878975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1253b-055f-4059-ad60-3dd274270e04 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:54.880455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3bc1253b-055f-4059-ad60-3dd274270e04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:54.896583 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1253b-055f-4059-ad60-3dd274270e04 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:54.903388 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf929a-43c7-48fb-adef-6f1c065021eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:54.903999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf929a-43c7-48fb-adef-6f1c065021eb service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:54.904282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf929a-43c7-48fb-adef-6f1c065021eb service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:54.904556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf929a-43c7-48fb-adef-6f1c065021eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:54.915371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf929a-43c7-48fb-adef-6f1c065021eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:54.917079 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf929a-43c7-48fb-adef-6f1c065021eb service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:54.928226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1114/2237] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:26:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:26:58.114914 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9bb62-c38c-4dac-88ce-f9a18b9cd140 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:58.115437 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9bb62-c38c-4dac-88ce-f9a18b9cd140 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:58.115574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9bb62-c38c-4dac-88ce-f9a18b9cd140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:58.135618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7cb9bb62-c38c-4dac-88ce-f9a18b9cd140 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:26:58.137011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7cb9bb62-c38c-4dac-88ce-f9a18b9cd140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:26:58.146335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1124/2238] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Sep 27 17:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:26:58.160075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf929a-43c7-48fb-adef-6f1c065021eb service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:26:58.171174 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf929a-43c7-48fb-adef-6f1c065021eb service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:26:58.176638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61da572-1681-4c59-b2cb-42763f8f0117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:26:58.177256 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61da572-1681-4c59-b2cb-42763f8f0117 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:26:58.177538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61da572-1681-4c59-b2cb-42763f8f0117 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:26:58.177853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61da572-1681-4c59-b2cb-42763f8f0117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:26:58.185989 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61da572-1681-4c59-b2cb-42763f8f0117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:26:58.187559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61da572-1681-4c59-b2cb-42763f8f0117 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:26:58.197643 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1115/2239] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:27:01.167486 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d4e4-b8f8-4e48-8401-ca9b3c09f733 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:01.167976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d4e4-b8f8-4e48-8401-ca9b3c09f733 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:01.168082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d4e4-b8f8-4e48-8401-ca9b3c09f733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:01.187653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-c9d1d4e4-b8f8-4e48-8401-ca9b3c09f733 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:27:01.188938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c9d1d4e4-b8f8-4e48-8401-ca9b3c09f733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:27:01.196574 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1125/2240] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Sep 27 17:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:27:01.220436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61da572-1681-4c59-b2cb-42763f8f0117 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:27:01.231797 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61da572-1681-4c59-b2cb-42763f8f0117 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:27:01.238184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3918d24-19b1-41ea-92f9-6eeaca982c81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:27:01.238787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3918d24-19b1-41ea-92f9-6eeaca982c81 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:01.239087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3918d24-19b1-41ea-92f9-6eeaca982c81 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:01.239360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3918d24-19b1-41ea-92f9-6eeaca982c81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:01.247728 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3918d24-19b1-41ea-92f9-6eeaca982c81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:27:01.249304 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3918d24-19b1-41ea-92f9-6eeaca982c81 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:27:01.258848 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1116/2241] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:27:04.331870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd422468-438d-4f5c-8eae-b5f75456ea44 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:04.332292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd422468-438d-4f5c-8eae-b5f75456ea44 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:04.332432 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd422468-438d-4f5c-8eae-b5f75456ea44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:04.352041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-cd422468-438d-4f5c-8eae-b5f75456ea44 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:27:04.353246 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cd422468-438d-4f5c-8eae-b5f75456ea44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:27:04.361937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1126/2242] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Sep 27 17:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:27:04.380185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3918d24-19b1-41ea-92f9-6eeaca982c81 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:27:04.391322 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3918d24-19b1-41ea-92f9-6eeaca982c81 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:27:04.396809 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d56d0-80cb-4b50-b615-4caba062d07d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:27:04.397397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d56d0-80cb-4b50-b615-4caba062d07d service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:04.397677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d56d0-80cb-4b50-b615-4caba062d07d service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:04.397979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d56d0-80cb-4b50-b615-4caba062d07d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:04.406043 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d56d0-80cb-4b50-b615-4caba062d07d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:27:04.407781 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d56d0-80cb-4b50-b615-4caba062d07d service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:27:04.417172 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1117/2243] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:27:07.508484 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9b7ec-0ee0-4320-9d15-7e444a6eb429 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:07.508981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9b7ec-0ee0-4320-9d15-7e444a6eb429 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:07.509092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9b7ec-0ee0-4320-9d15-7e444a6eb429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:07.529020 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-41c9b7ec-0ee0-4320-9d15-7e444a6eb429 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:27:07.530255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-41c9b7ec-0ee0-4320-9d15-7e444a6eb429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:27:07.538604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1127/2244] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Sep 27 17:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:27:07.559236 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d56d0-80cb-4b50-b615-4caba062d07d service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:27:07.570769 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d56d0-80cb-4b50-b615-4caba062d07d service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:27:07.576161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d94dcd-a61f-45fb-bb6d-4ec875caf57f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:27:07.576745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d94dcd-a61f-45fb-bb6d-4ec875caf57f service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:07.577025 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d94dcd-a61f-45fb-bb6d-4ec875caf57f service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:07.577298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d94dcd-a61f-45fb-bb6d-4ec875caf57f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:07.585958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d94dcd-a61f-45fb-bb6d-4ec875caf57f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:27:07.587537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d94dcd-a61f-45fb-bb6d-4ec875caf57f service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:27:07.597661 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1118/2245] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:27:17.524149 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=18 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:17.592577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=64 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:19.907036 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064bd72-a03c-4c09-b4f9-65ca5a20b9ad None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:19.907560 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064bd72-a03c-4c09-b4f9-65ca5a20b9ad None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:19.907560 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064bd72-a03c-4c09-b4f9-65ca5a20b9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:19.926991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f064bd72-a03c-4c09-b4f9-65ca5a20b9ad None None] MFA Rules not processed for user `0b41c6ab73144570a7291dc674d95e66`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:27:19.928174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f064bd72-a03c-4c09-b4f9-65ca5a20b9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:27:19.981814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1128/2246] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:27:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:27:28.371267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2b28b-1d59-4e43-a65d-338a0c3b292d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:28.371779 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2b28b-1d59-4e43-a65d-338a0c3b292d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:28.371874 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2b28b-1d59-4e43-a65d-338a0c3b292d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:28.391215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fcd2b28b-1d59-4e43-a65d-338a0c3b292d None None] MFA Rules not processed for user `28c03fdc58424a9793e3df8579a8f78b`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:27:28.392423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fcd2b28b-1d59-4e43-a65d-338a0c3b292d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:27:28.448616 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1119/2247] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:27:28.632014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28f745-db87-48c2-9d8e-f372dc61f1c4 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:28.633002 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28f745-db87-48c2-9d8e-f372dc61f1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:28.633494 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28f745-db87-48c2-9d8e-f372dc61f1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:28.654525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2e28f745-db87-48c2-9d8e-f372dc61f1c4 None None] MFA Rules not processed for user `a3fc3346bf004fc7af20e1a523ca3180`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:27:28.655852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2e28f745-db87-48c2-9d8e-f372dc61f1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:27:28.663725 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1129/2248] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:27:38.441785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=25 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:38.648963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=28 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:49.797822 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997add77-da12-4967-a6c2-da8b16fc4572 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:49.798362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997add77-da12-4967-a6c2-da8b16fc4572 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:49.798494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997add77-da12-4967-a6c2-da8b16fc4572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:49.820222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-997add77-da12-4967-a6c2-da8b16fc4572 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:27:49.821715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-997add77-da12-4967-a6c2-da8b16fc4572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:27:49.830785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1120/2249] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Sep 27 17:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:27:49.846824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28f745-db87-48c2-9d8e-f372dc61f1c4 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:27:49.864963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28f745-db87-48c2-9d8e-f372dc61f1c4 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:27:49.871646 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc80bf-3df5-4d57-87d3-ece24561fc48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:27:49.872300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc80bf-3df5-4d57-87d3-ece24561fc48 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:49.872557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc80bf-3df5-4d57-87d3-ece24561fc48 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:49.872832 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc80bf-3df5-4d57-87d3-ece24561fc48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:49.882585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc80bf-3df5-4d57-87d3-ece24561fc48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:27:49.884257 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc80bf-3df5-4d57-87d3-ece24561fc48 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:27:49.894525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1130/2250] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:27:50.936378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ae44a-e975-4fcf-9e37-8e83355941da None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:50.936948 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ae44a-e975-4fcf-9e37-8e83355941da None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:50.937175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ae44a-e975-4fcf-9e37-8e83355941da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:50.959024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e33ae44a-e975-4fcf-9e37-8e83355941da None None] MFA Rules not processed for user `a817cd3c534f4089b3948bad1c37ed75`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:27:50.960704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e33ae44a-e975-4fcf-9e37-8e83355941da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:27:51.021274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1121/2251] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:27:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:27:51.884204 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559e96e-5bfb-4e7f-8e26-d9bc1bcd0ec5 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:51.884717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559e96e-5bfb-4e7f-8e26-d9bc1bcd0ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:51.884944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559e96e-5bfb-4e7f-8e26-d9bc1bcd0ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:51.904718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d559e96e-5bfb-4e7f-8e26-d9bc1bcd0ec5 None None] MFA Rules not processed for user `41d1e8b097a14cba91218e7a9b32f6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:27:51.906626 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d559e96e-5bfb-4e7f-8e26-d9bc1bcd0ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:27:51.913478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1131/2252] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:27:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:27:53.191152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce9313-5cb6-478b-879b-c82b3b9afa56 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:53.191603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce9313-5cb6-478b-879b-c82b3b9afa56 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:53.191815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce9313-5cb6-478b-879b-c82b3b9afa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:53.212276 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-07ce9313-5cb6-478b-879b-c82b3b9afa56 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:27:53.213484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-07ce9313-5cb6-478b-879b-c82b3b9afa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:27:53.222216 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1122/2253] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Sep 27 17:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:27:53.237239 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559e96e-5bfb-4e7f-8e26-d9bc1bcd0ec5 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:27:53.252050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559e96e-5bfb-4e7f-8e26-d9bc1bcd0ec5 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:27:53.259429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cc476-0bbc-40f2-a9bd-8363f3699523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:27:53.260629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cc476-0bbc-40f2-a9bd-8363f3699523 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:53.260914 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cc476-0bbc-40f2-a9bd-8363f3699523 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:53.261185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cc476-0bbc-40f2-a9bd-8363f3699523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:53.271503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cc476-0bbc-40f2-a9bd-8363f3699523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:27:53.273320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cc476-0bbc-40f2-a9bd-8363f3699523 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:27:53.284580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1132/2254] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:27:56.289934 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958909b1-3c0c-422b-9a25-248cfbe2918d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:56.290478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958909b1-3c0c-422b-9a25-248cfbe2918d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:56.290618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958909b1-3c0c-422b-9a25-248cfbe2918d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:56.315783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-958909b1-3c0c-422b-9a25-248cfbe2918d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:27:56.317087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-958909b1-3c0c-422b-9a25-248cfbe2918d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:27:56.327254 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1123/2255] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Sep 27 17:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:27:56.344468 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cc476-0bbc-40f2-a9bd-8363f3699523 service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:27:56.356964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cc476-0bbc-40f2-a9bd-8363f3699523 service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:27:56.364760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b940539-295e-4133-ae38-ac14ee796ffe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:27:56.365537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b940539-295e-4133-ae38-ac14ee796ffe service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:56.365985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b940539-295e-4133-ae38-ac14ee796ffe service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:56.366382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b940539-295e-4133-ae38-ac14ee796ffe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:56.377010 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b940539-295e-4133-ae38-ac14ee796ffe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:27:56.378764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b940539-295e-4133-ae38-ac14ee796ffe service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:27:56.392707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1133/2256] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:27:59.457894 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd65901-5e51-48a4-826f-37d82e8ec65b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:59.458384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd65901-5e51-48a4-826f-37d82e8ec65b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:59.459196 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd65901-5e51-48a4-826f-37d82e8ec65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:59.480741 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3cd65901-5e51-48a4-826f-37d82e8ec65b None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:27:59.481968 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3cd65901-5e51-48a4-826f-37d82e8ec65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:27:59.490722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1124/2257] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Sep 27 17:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:27:59.505571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b940539-295e-4133-ae38-ac14ee796ffe service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:27:59.517898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b940539-295e-4133-ae38-ac14ee796ffe service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:27:59.523743 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4e676-16da-49d3-b9b3-1c28d49e3cf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:27:59.524351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4e676-16da-49d3-b9b3-1c28d49e3cf1 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:27:59.524650 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4e676-16da-49d3-b9b3-1c28d49e3cf1 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:27:59.524928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4e676-16da-49d3-b9b3-1c28d49e3cf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:27:59.534259 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4e676-16da-49d3-b9b3-1c28d49e3cf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:27:59.535818 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4e676-16da-49d3-b9b3-1c28d49e3cf1 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:27:59.545325 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1134/2258] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:28:03.711915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454e3ac-86db-40db-95d7-e210da8fb1c7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:03.712351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454e3ac-86db-40db-95d7-e210da8fb1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:03.712534 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454e3ac-86db-40db-95d7-e210da8fb1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:03.733211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c454e3ac-86db-40db-95d7-e210da8fb1c7 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:03.734794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c454e3ac-86db-40db-95d7-e210da8fb1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:03.742751 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1125/2259] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Sep 27 17:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:28:03.757563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4e676-16da-49d3-b9b3-1c28d49e3cf1 service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:03.769360 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4e676-16da-49d3-b9b3-1c28d49e3cf1 service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:03.775238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba813a53-d03b-484e-9080-8c1bab2af199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:03.775849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba813a53-d03b-484e-9080-8c1bab2af199 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:03.776130 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba813a53-d03b-484e-9080-8c1bab2af199 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:03.776437 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba813a53-d03b-484e-9080-8c1bab2af199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:03.785372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba813a53-d03b-484e-9080-8c1bab2af199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:03.787473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba813a53-d03b-484e-9080-8c1bab2af199 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:03.799132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1135/2260] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:28:13.727668 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=40 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:13.793951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=33 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:30.720227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454e3ac-86db-40db-95d7-e210da8fb1c7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:30.721909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c454e3ac-86db-40db-95d7-e210da8fb1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:30.733677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454e3ac-86db-40db-95d7-e210da8fb1c7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:30.737446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293dd2b-89e6-41bf-b4a7-7df292d74473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:30.738076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293dd2b-89e6-41bf-b4a7-7df292d74473 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:30.738355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293dd2b-89e6-41bf-b4a7-7df292d74473 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:30.738627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293dd2b-89e6-41bf-b4a7-7df292d74473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:30.740473 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8293dd2b-89e6-41bf-b4a7-7df292d74473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:30.754269 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293dd2b-89e6-41bf-b4a7-7df292d74473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:30.755684 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293dd2b-89e6-41bf-b4a7-7df292d74473 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:30.765169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1126/2261] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:28:32.839336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba813a53-d03b-484e-9080-8c1bab2af199 service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:32.840691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ba813a53-d03b-484e-9080-8c1bab2af199 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:32.912528 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba813a53-d03b-484e-9080-8c1bab2af199 service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:32.916915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6094930-df6a-4782-a532-8fa97a2ecace service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6c4a886aec4dd290b13118e2528fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:32.917913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6094930-df6a-4782-a532-8fa97a2ecace service glance] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:32.918430 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6094930-df6a-4782-a532-8fa97a2ecace service glance] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:32.918895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6094930-df6a-4782-a532-8fa97a2ecace service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:32.921047 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a6094930-df6a-4782-a532-8fa97a2ecace service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:32.936990 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6094930-df6a-4782-a532-8fa97a2ecace service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:32.939480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6094930-df6a-4782-a532-8fa97a2ecace service glance] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:32.952109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1136/2262] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:28:33.191353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293dd2b-89e6-41bf-b4a7-7df292d74473 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:33.204573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293dd2b-89e6-41bf-b4a7-7df292d74473 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:33.209333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6210d-eeb5-4b37-bbcc-b914cd31ddc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:33.210275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6210d-eeb5-4b37-bbcc-b914cd31ddc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:33.210553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6210d-eeb5-4b37-bbcc-b914cd31ddc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:33.210820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6210d-eeb5-4b37-bbcc-b914cd31ddc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:33.212614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-19d6210d-eeb5-4b37-bbcc-b914cd31ddc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:33.228248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6210d-eeb5-4b37-bbcc-b914cd31ddc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:33.230377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6210d-eeb5-4b37-bbcc-b914cd31ddc0 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:33.246354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1127/2263] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:28:34.138907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6094930-df6a-4782-a532-8fa97a2ecace service glance] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:34.140913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a6094930-df6a-4782-a532-8fa97a2ecace service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:34.158432 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6094930-df6a-4782-a532-8fa97a2ecace service glance] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:34.164353 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119ba1a-6b08-482f-a034-d8457754723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:34.165002 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119ba1a-6b08-482f-a034-d8457754723e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:34.165281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119ba1a-6b08-482f-a034-d8457754723e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:34.165981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119ba1a-6b08-482f-a034-d8457754723e admin admin] PATH_INFO: `/v3/users/0b41c6ab73144570a7291dc674d95e66` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:34.167148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119ba1a-6b08-482f-a034-d8457754723e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b41c6ab73144570a7291dc674d95e66)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:34.169124 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119ba1a-6b08-482f-a034-d8457754723e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:34.226411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0119ba1a-6b08-482f-a034-d8457754723e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b41c6ab73144570a7291dc674d95e66'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:34.227070 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0119ba1a-6b08-482f-a034-d8457754723e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b41c6ab73144570a7291dc674d95e66'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:34.235796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0119ba1a-6b08-482f-a034-d8457754723e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b41c6ab73144570a7291dc674d95e66'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:34.247776 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0119ba1a-6b08-482f-a034-d8457754723e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b41c6ab73144570a7291dc674d95e66'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:34.259211 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0119ba1a-6b08-482f-a034-d8457754723e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b41c6ab73144570a7291dc674d95e66'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:34.266380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1137/2264] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:28:34 2022] DELETE /identity/v3/users/0b41c6ab73144570a7291dc674d95e66 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:34.472485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6210d-eeb5-4b37-bbcc-b914cd31ddc0 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:34.486857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6210d-eeb5-4b37-bbcc-b914cd31ddc0 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:34.554460 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf04f3-ecad-43bc-99c3-f7fc1bb3f9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:34.555168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf04f3-ecad-43bc-99c3-f7fc1bb3f9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:34.555514 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf04f3-ecad-43bc-99c3-f7fc1bb3f9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:34.555761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf04f3-ecad-43bc-99c3-f7fc1bb3f9bc admin admin] PATH_INFO: `/v3/projects/170c7ffa38ec452db0de29953a0bf755` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:34.556999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf04f3-ecad-43bc-99c3-f7fc1bb3f9bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=170c7ffa38ec452db0de29953a0bf755)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:34.559044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf04f3-ecad-43bc-99c3-f7fc1bb3f9bc admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:34.626931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-61cf04f3-ecad-43bc-99c3-f7fc1bb3f9bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '170c7ffa38ec452db0de29953a0bf755', 'request_id': 'req-61cf04f3-ecad-43bc-99c3-f7fc1bb3f9bc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:34.633577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-61cf04f3-ecad-43bc-99c3-f7fc1bb3f9bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '170c7ffa38ec452db0de29953a0bf755', 'request_id': 'req-61cf04f3-ecad-43bc-99c3-f7fc1bb3f9bc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:34.639655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-61cf04f3-ecad-43bc-99c3-f7fc1bb3f9bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '170c7ffa38ec452db0de29953a0bf755', 'request_id': 'req-61cf04f3-ecad-43bc-99c3-f7fc1bb3f9bc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:34.653175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-61cf04f3-ecad-43bc-99c3-f7fc1bb3f9bc admin admin] The token cache is being invalidate because project 170c7ffa38ec452db0de29953a0bf755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:28:34.653464 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-61cf04f3-ecad-43bc-99c3-f7fc1bb3f9bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:34.654103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-61cf04f3-ecad-43bc-99c3-f7fc1bb3f9bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:34.655578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1128/2265] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:28:34 2022] DELETE /identity/v3/projects/170c7ffa38ec452db0de29953a0bf755 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:34.661936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb88099-e369-49b7-807d-6446ca4543c6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:34.662358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb88099-e369-49b7-807d-6446ca4543c6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:34.662733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb88099-e369-49b7-807d-6446ca4543c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:34.683615 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6cb88099-e369-49b7-807d-6446ca4543c6 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:34.684801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6cb88099-e369-49b7-807d-6446ca4543c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:34.745831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1138/2266] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:28:34.754063 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ef2e-cbfb-41e1-9b1b-0911d3d14df9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:34.754353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ef2e-cbfb-41e1-9b1b-0911d3d14df9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:34.755625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ef2e-cbfb-41e1-9b1b-0911d3d14df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:34.780469 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-02c8ef2e-cbfb-41e1-9b1b-0911d3d14df9 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:34.782601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-02c8ef2e-cbfb-41e1-9b1b-0911d3d14df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:34.790478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1129/2267] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:28:34.794722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb88099-e369-49b7-807d-6446ca4543c6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:34.804924 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb88099-e369-49b7-807d-6446ca4543c6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:34.809468 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8fa8d-854c-4ad9-90f7-dedf48735b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:34.810082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8fa8d-854c-4ad9-90f7-dedf48735b5e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:34.810354 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8fa8d-854c-4ad9-90f7-dedf48735b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:34.810621 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8fa8d-854c-4ad9-90f7-dedf48735b5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:34.811255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8fa8d-854c-4ad9-90f7-dedf48735b5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:28:34.811551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8fa8d-854c-4ad9-90f7-dedf48735b5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:34.813744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8fa8d-854c-4ad9-90f7-dedf48735b5e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:34.825206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1139/2268] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:28:34.829773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8ef2e-cbfb-41e1-9b1b-0911d3d14df9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:34.838780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8ef2e-cbfb-41e1-9b1b-0911d3d14df9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:34.843872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf85016-10d8-4b4b-9ba9-5fc2c3f7494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:34.844681 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf85016-10d8-4b4b-9ba9-5fc2c3f7494b admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:34.844960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf85016-10d8-4b4b-9ba9-5fc2c3f7494b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:34.845232 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf85016-10d8-4b4b-9ba9-5fc2c3f7494b admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:34.845883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf85016-10d8-4b4b-9ba9-5fc2c3f7494b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:34.848010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf85016-10d8-4b4b-9ba9-5fc2c3f7494b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:34.875118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1130/2269] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:28:34 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:28:34.879414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8fa8d-854c-4ad9-90f7-dedf48735b5e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:34.884514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:34.890743 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8fa8d-854c-4ad9-90f7-dedf48735b5e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:34.947601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f57522-8f21-422b-a36e-bdbb1e858210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:34.948205 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f57522-8f21-422b-a36e-bdbb1e858210 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:34.948486 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f57522-8f21-422b-a36e-bdbb1e858210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:34.948767 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f57522-8f21-422b-a36e-bdbb1e858210 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:34.949390 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f57522-8f21-422b-a36e-bdbb1e858210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:34.951324 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f57522-8f21-422b-a36e-bdbb1e858210 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:34.972849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1140/2270] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:28:34 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:28:34.977031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf85016-10d8-4b4b-9ba9-5fc2c3f7494b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:34.987801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf85016-10d8-4b4b-9ba9-5fc2c3f7494b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:34.992410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc016b4-8865-4b76-a882-3c3ab618bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:34.992994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc016b4-8865-4b76-a882-3c3ab618bdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:34.993273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc016b4-8865-4b76-a882-3c3ab618bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:34.993545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc016b4-8865-4b76-a882-3c3ab618bdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:34.994212 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc016b4-8865-4b76-a882-3c3ab618bdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:34.995803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc016b4-8865-4b76-a882-3c3ab618bdc7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:35.010607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1131/2271] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:28:35.020040 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f57522-8f21-422b-a36e-bdbb1e858210 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:35.029840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f57522-8f21-422b-a36e-bdbb1e858210 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:35.035295 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00e3ab-93d5-4463-9022-0eacd03a9ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:35.035883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00e3ab-93d5-4463-9022-0eacd03a9ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:35.036161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00e3ab-93d5-4463-9022-0eacd03a9ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:35.036435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00e3ab-93d5-4463-9022-0eacd03a9ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:35.037067 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00e3ab-93d5-4463-9022-0eacd03a9ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:35.038670 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00e3ab-93d5-4463-9022-0eacd03a9ff3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:35.049322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1141/2272] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:28:35.053392 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc016b4-8865-4b76-a882-3c3ab618bdc7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:35.063394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc016b4-8865-4b76-a882-3c3ab618bdc7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:35.067946 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf58db-2a4c-4553-b796-87b18b53e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:35.068581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf58db-2a4c-4553-b796-87b18b53e118 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:35.068871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf58db-2a4c-4553-b796-87b18b53e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:35.069138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf58db-2a4c-4553-b796-87b18b53e118 admin admin] PATH_INFO: `/v3/projects/8fb70a25881f4443ae8857ce6800714d/users/69182af74499485291950260f8aa55d5/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:35.084089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf58db-2a4c-4553-b796-87b18b53e118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb70a25881f4443ae8857ce6800714d, user_id=69182af74499485291950260f8aa55d5, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:35.086777 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf58db-2a4c-4553-b796-87b18b53e118 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:35.096587 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:35.101620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1132/2273] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:28:35 2022] PUT /identity/v3/projects/8fb70a25881f4443ae8857ce6800714d/users/69182af74499485291950260f8aa55d5/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:35.111884 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dcc9f-8ebb-4b30-a9f0-81d8dc5bea92 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:35.112169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dcc9f-8ebb-4b30-a9f0-81d8dc5bea92 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:35.112442 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dcc9f-8ebb-4b30-a9f0-81d8dc5bea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:35.139499 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b80dcc9f-8ebb-4b30-a9f0-81d8dc5bea92 None None] MFA Rules not processed for user `69182af74499485291950260f8aa55d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:35.141570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b80dcc9f-8ebb-4b30-a9f0-81d8dc5bea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:35.206713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1142/2274] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:28:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:28:35.211306 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf58db-2a4c-4553-b796-87b18b53e118 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:35.273706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf58db-2a4c-4553-b796-87b18b53e118 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:35.278362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7bed9-79ae-42f0-b747-a1e81a49981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:35.278955 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7bed9-79ae-42f0-b747-a1e81a49981f admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:35.279236 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7bed9-79ae-42f0-b747-a1e81a49981f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:35.279510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7bed9-79ae-42f0-b747-a1e81a49981f admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:35.280133 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7bed9-79ae-42f0-b747-a1e81a49981f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:35.282167 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7bed9-79ae-42f0-b747-a1e81a49981f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:35.308526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1133/2275] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:28:35 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:28:35.313203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dcc9f-8ebb-4b30-a9f0-81d8dc5bea92 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:35.323656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dcc9f-8ebb-4b30-a9f0-81d8dc5bea92 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:35.379152 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3fc72-cc3c-4a19-b008-c5e9786e2104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:35.379763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3fc72-cc3c-4a19-b008-c5e9786e2104 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:35.380044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3fc72-cc3c-4a19-b008-c5e9786e2104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:35.380312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3fc72-cc3c-4a19-b008-c5e9786e2104 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:35.380942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3fc72-cc3c-4a19-b008-c5e9786e2104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:35.382918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3fc72-cc3c-4a19-b008-c5e9786e2104 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:35.399440 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:35.405036 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1143/2276] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:28:35 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:28:35.409719 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7bed9-79ae-42f0-b747-a1e81a49981f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:35.420360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7bed9-79ae-42f0-b747-a1e81a49981f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:35.425589 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8043e-fa36-405e-90b7-1dab1a3b25ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:35.426232 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8043e-fa36-405e-90b7-1dab1a3b25ca admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:35.426520 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8043e-fa36-405e-90b7-1dab1a3b25ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:35.426791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8043e-fa36-405e-90b7-1dab1a3b25ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:35.427457 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8043e-fa36-405e-90b7-1dab1a3b25ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:35.429060 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8043e-fa36-405e-90b7-1dab1a3b25ca admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:35.439661 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1134/2277] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:28:35.443816 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3fc72-cc3c-4a19-b008-c5e9786e2104 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:35.454290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3fc72-cc3c-4a19-b008-c5e9786e2104 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:35.458778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512fef1-05de-4891-8ec0-1ac651e93ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:35.459562 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512fef1-05de-4891-8ec0-1ac651e93ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:35.459843 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512fef1-05de-4891-8ec0-1ac651e93ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:35.460113 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512fef1-05de-4891-8ec0-1ac651e93ac4 admin admin] PATH_INFO: `/v3/projects/a87b38da77f7419090de8fbe92d35040/users/a2ca98a5c42044f9981912369b73efc6/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:35.475351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512fef1-05de-4891-8ec0-1ac651e93ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a87b38da77f7419090de8fbe92d35040, user_id=a2ca98a5c42044f9981912369b73efc6, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:35.478005 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512fef1-05de-4891-8ec0-1ac651e93ac4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:35.491219 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1144/2278] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:28:35 2022] PUT /identity/v3/projects/a87b38da77f7419090de8fbe92d35040/users/a2ca98a5c42044f9981912369b73efc6/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:28:35.495051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8043e-fa36-405e-90b7-1dab1a3b25ca admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:35.505222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8043e-fa36-405e-90b7-1dab1a3b25ca admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:35.561838 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce541d-045d-4464-b311-5dde2c3a2ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:35.562442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce541d-045d-4464-b311-5dde2c3a2ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:35.562722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce541d-045d-4464-b311-5dde2c3a2ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:35.562999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce541d-045d-4464-b311-5dde2c3a2ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:35.563629 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce541d-045d-4464-b311-5dde2c3a2ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:35.565212 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce541d-045d-4464-b311-5dde2c3a2ba1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:35.574853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1135/2279] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:28:35.578980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512fef1-05de-4891-8ec0-1ac651e93ac4 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:35.589008 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512fef1-05de-4891-8ec0-1ac651e93ac4 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:35.594177 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb5ecc-4431-480d-9654-d1b521205907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:35.594809 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb5ecc-4431-480d-9654-d1b521205907 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:35.595082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb5ecc-4431-480d-9654-d1b521205907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:35.595345 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb5ecc-4431-480d-9654-d1b521205907 admin admin] PATH_INFO: `/v3/projects/a87b38da77f7419090de8fbe92d35040/users/a2ca98a5c42044f9981912369b73efc6/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:35.597508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb5ecc-4431-480d-9654-d1b521205907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a87b38da77f7419090de8fbe92d35040, user_id=a2ca98a5c42044f9981912369b73efc6, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:35.600106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb5ecc-4431-480d-9654-d1b521205907 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:35.610563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1145/2280] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:28:35 2022] PUT /identity/v3/projects/a87b38da77f7419090de8fbe92d35040/users/a2ca98a5c42044f9981912369b73efc6/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:28:35.622101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8fc90-3149-4389-a215-ed16a731fcf7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:35.622489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8fc90-3149-4389-a215-ed16a731fcf7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:35.622845 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8fc90-3149-4389-a215-ed16a731fcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:35.653335 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-79e8fc90-3149-4389-a215-ed16a731fcf7 None None] MFA Rules not processed for user `a2ca98a5c42044f9981912369b73efc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:35.654596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-79e8fc90-3149-4389-a215-ed16a731fcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:35.726021 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:35.743628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1136/2281] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:28:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:28:35.753111 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb5ecc-4431-480d-9654-d1b521205907 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:35.755033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5efb5ecc-4431-480d-9654-d1b521205907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:35.821093 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb5ecc-4431-480d-9654-d1b521205907 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:35.825038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86ff11-c5cc-4d4d-97c2-8fc9a965b68d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:35.825584 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86ff11-c5cc-4d4d-97c2-8fc9a965b68d service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:35.825891 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86ff11-c5cc-4d4d-97c2-8fc9a965b68d service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:35.826163 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86ff11-c5cc-4d4d-97c2-8fc9a965b68d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:35.836418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86ff11-c5cc-4d4d-97c2-8fc9a965b68d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:35.837927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86ff11-c5cc-4d4d-97c2-8fc9a965b68d service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:35.848680 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1146/2282] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:28:35.923662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8fc90-3149-4389-a215-ed16a731fcf7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:35.934775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8fc90-3149-4389-a215-ed16a731fcf7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:35.939406 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd7012-f5b4-4719-8a33-51f64102ffa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:35.940030 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd7012-f5b4-4719-8a33-51f64102ffa3 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:35.940307 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd7012-f5b4-4719-8a33-51f64102ffa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:35.940585 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd7012-f5b4-4719-8a33-51f64102ffa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:35.997980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd7012-f5b4-4719-8a33-51f64102ffa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:35.999478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd7012-f5b4-4719-8a33-51f64102ffa3 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:36.009079 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1137/2283] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:28:37.624906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86ff11-c5cc-4d4d-97c2-8fc9a965b68d service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:37.626529 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-de86ff11-c5cc-4d4d-97c2-8fc9a965b68d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:37.692567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86ff11-c5cc-4d4d-97c2-8fc9a965b68d service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:37.697072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e8fb-ac60-460d-8d16-791bba79f5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:37.697708 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e8fb-ac60-460d-8d16-791bba79f5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:37.697995 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e8fb-ac60-460d-8d16-791bba79f5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:37.698267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e8fb-ac60-460d-8d16-791bba79f5db admin admin] PATH_INFO: `/v3/users/a3fc3346bf004fc7af20e1a523ca3180` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:37.699359 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973e8fb-ac60-460d-8d16-791bba79f5db admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3fc3346bf004fc7af20e1a523ca3180)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:37.701255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973e8fb-ac60-460d-8d16-791bba79f5db admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:37.751871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e973e8fb-ac60-460d-8d16-791bba79f5db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3fc3346bf004fc7af20e1a523ca3180'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:37.752572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e973e8fb-ac60-460d-8d16-791bba79f5db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3fc3346bf004fc7af20e1a523ca3180'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:37.761419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e973e8fb-ac60-460d-8d16-791bba79f5db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3fc3346bf004fc7af20e1a523ca3180'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:37.772057 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:37.774862 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e973e8fb-ac60-460d-8d16-791bba79f5db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3fc3346bf004fc7af20e1a523ca3180'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:37.785600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e973e8fb-ac60-460d-8d16-791bba79f5db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3fc3346bf004fc7af20e1a523ca3180'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:37.792590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1147/2284] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:28:37 2022] DELETE /identity/v3/users/a3fc3346bf004fc7af20e1a523ca3180 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:37.971892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd7012-f5b4-4719-8a33-51f64102ffa3 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:37.983230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd7012-f5b4-4719-8a33-51f64102ffa3 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:38.043498 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f0ec4-11dd-4fb2-8455-cd210c0c0129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:38.044135 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f0ec4-11dd-4fb2-8455-cd210c0c0129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:38.044416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f0ec4-11dd-4fb2-8455-cd210c0c0129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:38.044692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f0ec4-11dd-4fb2-8455-cd210c0c0129 admin admin] PATH_INFO: `/v3/projects/6e6e943c660a415dbbd2438d2174cae4` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:38.045890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f0ec4-11dd-4fb2-8455-cd210c0c0129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6e943c660a415dbbd2438d2174cae4)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:38.048314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f0ec4-11dd-4fb2-8455-cd210c0c0129 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:38.097654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cb4f0ec4-11dd-4fb2-8455-cd210c0c0129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6e943c660a415dbbd2438d2174cae4', 'request_id': 'req-cb4f0ec4-11dd-4fb2-8455-cd210c0c0129'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:38.103897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cb4f0ec4-11dd-4fb2-8455-cd210c0c0129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6e943c660a415dbbd2438d2174cae4', 'request_id': 'req-cb4f0ec4-11dd-4fb2-8455-cd210c0c0129'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:38.110948 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cb4f0ec4-11dd-4fb2-8455-cd210c0c0129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6e943c660a415dbbd2438d2174cae4', 'request_id': 'req-cb4f0ec4-11dd-4fb2-8455-cd210c0c0129'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:38.124436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cb4f0ec4-11dd-4fb2-8455-cd210c0c0129 admin admin] The token cache is being invalidate because project 6e6e943c660a415dbbd2438d2174cae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:28:38.125220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cb4f0ec4-11dd-4fb2-8455-cd210c0c0129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:38.125867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cb4f0ec4-11dd-4fb2-8455-cd210c0c0129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:38.127364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1138/2285] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:28:37 2022] DELETE /identity/v3/projects/6e6e943c660a415dbbd2438d2174cae4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:42.034795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e8fb-ac60-460d-8d16-791bba79f5db admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:42.036275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e973e8fb-ac60-460d-8d16-791bba79f5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:42.049419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e8fb-ac60-460d-8d16-791bba79f5db admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:42.104835 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89cca7-1114-42a7-9b67-daa9a6b1650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:42.105467 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89cca7-1114-42a7-9b67-daa9a6b1650d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:42.105782 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89cca7-1114-42a7-9b67-daa9a6b1650d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:42.106059 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89cca7-1114-42a7-9b67-daa9a6b1650d admin admin] PATH_INFO: `/v3/users/69182af74499485291950260f8aa55d5` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:42.107172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89cca7-1114-42a7-9b67-daa9a6b1650d admin admin] RBAC: Authorizing `identity:delete_user(user_id=69182af74499485291950260f8aa55d5)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:42.109226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89cca7-1114-42a7-9b67-daa9a6b1650d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:42.154870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2c89cca7-1114-42a7-9b67-daa9a6b1650d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69182af74499485291950260f8aa55d5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:42.155544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2c89cca7-1114-42a7-9b67-daa9a6b1650d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69182af74499485291950260f8aa55d5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:42.163688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2c89cca7-1114-42a7-9b67-daa9a6b1650d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69182af74499485291950260f8aa55d5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:42.175607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2c89cca7-1114-42a7-9b67-daa9a6b1650d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69182af74499485291950260f8aa55d5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:42.182365 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2c89cca7-1114-42a7-9b67-daa9a6b1650d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69182af74499485291950260f8aa55d5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:42.188978 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1148/2286] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:28:42 2022] DELETE /identity/v3/users/69182af74499485291950260f8aa55d5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:28:42.193421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0688e7b-5f6d-4355-b6a7-dc191e5b5be3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:42.193913 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0688e7b-5f6d-4355-b6a7-dc191e5b5be3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:42.194024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0688e7b-5f6d-4355-b6a7-dc191e5b5be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:42.213403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a0688e7b-5f6d-4355-b6a7-dc191e5b5be3 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:42.214830 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a0688e7b-5f6d-4355-b6a7-dc191e5b5be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:42.233863 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:42.276801 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1139/2287] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:28:42.286726 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89cca7-1114-42a7-9b67-daa9a6b1650d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:42.288122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2c89cca7-1114-42a7-9b67-daa9a6b1650d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:42.344906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89cca7-1114-42a7-9b67-daa9a6b1650d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:42.348820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06af0f-9be8-44a2-9161-9668a91b9342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:42.349418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06af0f-9be8-44a2-9161-9668a91b9342 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:42.349707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06af0f-9be8-44a2-9161-9668a91b9342 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:42.350001 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06af0f-9be8-44a2-9161-9668a91b9342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:42.358820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06af0f-9be8-44a2-9161-9668a91b9342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:42.360238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06af0f-9be8-44a2-9161-9668a91b9342 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:42.369458 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1149/2288] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:28:42.646392 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0688e7b-5f6d-4355-b6a7-dc191e5b5be3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:42.647822 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a0688e7b-5f6d-4355-b6a7-dc191e5b5be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:42.659711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0688e7b-5f6d-4355-b6a7-dc191e5b5be3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:42.664442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:42.665064 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:42.665343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:42.665623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64 admin admin] PATH_INFO: `/v3/projects/8fb70a25881f4443ae8857ce6800714d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:42.666766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb70a25881f4443ae8857ce6800714d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:42.668676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:42.715429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb70a25881f4443ae8857ce6800714d', 'request_id': 'req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:42.721329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb70a25881f4443ae8857ce6800714d', 'request_id': 'req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:42.727512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb70a25881f4443ae8857ce6800714d', 'request_id': 'req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:42.740373 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64 admin admin] The token cache is being invalidate because project 8fb70a25881f4443ae8857ce6800714d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:28:42.740662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:42.741315 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:42.742827 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1140/2289] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:28:42 2022] DELETE /identity/v3/projects/8fb70a25881f4443ae8857ce6800714d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:42.746737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06af0f-9be8-44a2-9161-9668a91b9342 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:42.757320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06af0f-9be8-44a2-9161-9668a91b9342 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:42.761264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:42.819831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ada344-e94f-47e7-95c8-68e1f76aaaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:42.820542 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ada344-e94f-47e7-95c8-68e1f76aaaff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:42.820816 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ada344-e94f-47e7-95c8-68e1f76aaaff admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:42.821088 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ada344-e94f-47e7-95c8-68e1f76aaaff admin admin] PATH_INFO: `/v3/users/a2ca98a5c42044f9981912369b73efc6` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:42.822252 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ada344-e94f-47e7-95c8-68e1f76aaaff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ca98a5c42044f9981912369b73efc6)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:42.824168 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ada344-e94f-47e7-95c8-68e1f76aaaff admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:42.874967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a3ada344-e94f-47e7-95c8-68e1f76aaaff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ca98a5c42044f9981912369b73efc6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:42.876095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a3ada344-e94f-47e7-95c8-68e1f76aaaff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ca98a5c42044f9981912369b73efc6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:42.884024 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a3ada344-e94f-47e7-95c8-68e1f76aaaff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ca98a5c42044f9981912369b73efc6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:42.896845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a3ada344-e94f-47e7-95c8-68e1f76aaaff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ca98a5c42044f9981912369b73efc6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:42.903593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a3ada344-e94f-47e7-95c8-68e1f76aaaff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ca98a5c42044f9981912369b73efc6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:42.910063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1150/2290] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:28:42 2022] DELETE /identity/v3/users/a2ca98a5c42044f9981912369b73efc6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:43.194324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:43.195813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:43.209859 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4e77a-68cc-4c0c-85d0-4dba0d53aa64 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:43.272477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46112f86-5d64-41bf-9809-932f770229c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:43.273026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46112f86-5d64-41bf-9809-932f770229c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:43.273302 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46112f86-5d64-41bf-9809-932f770229c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:43.273574 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46112f86-5d64-41bf-9809-932f770229c1 admin admin] PATH_INFO: `/v3/projects/a87b38da77f7419090de8fbe92d35040` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:43.274800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46112f86-5d64-41bf-9809-932f770229c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a87b38da77f7419090de8fbe92d35040)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:43.277725 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46112f86-5d64-41bf-9809-932f770229c1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:43.339856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-46112f86-5d64-41bf-9809-932f770229c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a87b38da77f7419090de8fbe92d35040', 'request_id': 'req-46112f86-5d64-41bf-9809-932f770229c1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:43.341042 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:43.347253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-46112f86-5d64-41bf-9809-932f770229c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a87b38da77f7419090de8fbe92d35040', 'request_id': 'req-46112f86-5d64-41bf-9809-932f770229c1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:43.355771 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-46112f86-5d64-41bf-9809-932f770229c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a87b38da77f7419090de8fbe92d35040', 'request_id': 'req-46112f86-5d64-41bf-9809-932f770229c1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:43.369135 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-46112f86-5d64-41bf-9809-932f770229c1 admin admin] The token cache is being invalidate because project a87b38da77f7419090de8fbe92d35040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:28:43.369420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-46112f86-5d64-41bf-9809-932f770229c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:43.370115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-46112f86-5d64-41bf-9809-932f770229c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:43.371733 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1141/2291] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:28:43 2022] DELETE /identity/v3/projects/a87b38da77f7419090de8fbe92d35040 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:43.378091 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13583465-f4f9-49e5-b46b-00b48011a734 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:43.378579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13583465-f4f9-49e5-b46b-00b48011a734 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:43.378669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13583465-f4f9-49e5-b46b-00b48011a734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:43.400864 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-13583465-f4f9-49e5-b46b-00b48011a734 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:43.402118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-13583465-f4f9-49e5-b46b-00b48011a734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:43.594703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1151/2292] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:28:43.602745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a201d37-e332-4de1-be1a-1a79057af28b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:43.603028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a201d37-e332-4de1-be1a-1a79057af28b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:43.603301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a201d37-e332-4de1-be1a-1a79057af28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:43.623342 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8a201d37-e332-4de1-be1a-1a79057af28b None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:43.625145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8a201d37-e332-4de1-be1a-1a79057af28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:43.632978 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1142/2293] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:28:43.637307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13583465-f4f9-49e5-b46b-00b48011a734 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:43.647161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13583465-f4f9-49e5-b46b-00b48011a734 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:43.651684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffda81-628d-4945-a9bf-4dd689198f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:43.652281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffda81-628d-4945-a9bf-4dd689198f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:43.652558 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffda81-628d-4945-a9bf-4dd689198f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:43.652825 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffda81-628d-4945-a9bf-4dd689198f89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:43.653459 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffda81-628d-4945-a9bf-4dd689198f89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:28:43.653824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffda81-628d-4945-a9bf-4dd689198f89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:43.655956 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffda81-628d-4945-a9bf-4dd689198f89 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:43.668301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1152/2294] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:28:43.673426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a201d37-e332-4de1-be1a-1a79057af28b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:43.683132 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a201d37-e332-4de1-be1a-1a79057af28b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:43.688656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb33410-ffcc-485d-bca8-e0c3dc1d9911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:43.692698 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33410-ffcc-485d-bca8-e0c3dc1d9911 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:43.692982 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33410-ffcc-485d-bca8-e0c3dc1d9911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:43.693259 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33410-ffcc-485d-bca8-e0c3dc1d9911 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:43.693937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb33410-ffcc-485d-bca8-e0c3dc1d9911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:43.695909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb33410-ffcc-485d-bca8-e0c3dc1d9911 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:43.729816 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1143/2295] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:28:43 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:28:43.734408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffda81-628d-4945-a9bf-4dd689198f89 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:43.747118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffda81-628d-4945-a9bf-4dd689198f89 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:43.756570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:43.813982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da5e45-e080-4dbc-889b-ca4deb9500ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:43.814642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da5e45-e080-4dbc-889b-ca4deb9500ef admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:43.814927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da5e45-e080-4dbc-889b-ca4deb9500ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:43.815195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da5e45-e080-4dbc-889b-ca4deb9500ef admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:43.815834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da5e45-e080-4dbc-889b-ca4deb9500ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:43.818022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da5e45-e080-4dbc-889b-ca4deb9500ef admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:43.846786 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1153/2296] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:28:43 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:28:43.850960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb33410-ffcc-485d-bca8-e0c3dc1d9911 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:43.862634 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb33410-ffcc-485d-bca8-e0c3dc1d9911 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:43.870411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e975cf3-63d4-4cae-8361-513d2c7803c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:43.871632 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e975cf3-63d4-4cae-8361-513d2c7803c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:43.872401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e975cf3-63d4-4cae-8361-513d2c7803c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:43.873132 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e975cf3-63d4-4cae-8361-513d2c7803c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:43.874156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e975cf3-63d4-4cae-8361-513d2c7803c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:43.876100 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e975cf3-63d4-4cae-8361-513d2c7803c8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:43.888288 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1144/2297] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:28:43.892615 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da5e45-e080-4dbc-889b-ca4deb9500ef admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:43.902970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da5e45-e080-4dbc-889b-ca4deb9500ef admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:43.909316 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ac135-670b-40c0-a90d-3a0c973de097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:43.909950 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ac135-670b-40c0-a90d-3a0c973de097 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:43.910232 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ac135-670b-40c0-a90d-3a0c973de097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:43.910503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ac135-670b-40c0-a90d-3a0c973de097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:43.911146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ac135-670b-40c0-a90d-3a0c973de097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:43.912727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ac135-670b-40c0-a90d-3a0c973de097 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:43.924542 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1154/2298] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:28:43.928883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e975cf3-63d4-4cae-8361-513d2c7803c8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:43.939998 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e975cf3-63d4-4cae-8361-513d2c7803c8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:43.941419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ac135-670b-40c0-a90d-3a0c973de097 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:43.943192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e63ac135-670b-40c0-a90d-3a0c973de097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:43.944853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777486a-8abb-4fbb-8592-00744e683719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:43.945556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777486a-8abb-4fbb-8592-00744e683719 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:43.945831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777486a-8abb-4fbb-8592-00744e683719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:43.946111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777486a-8abb-4fbb-8592-00744e683719 admin admin] PATH_INFO: `/v3/projects/42292a81f5ad4da88a205ca1fc589cb3/users/6125efa09a844f0ea7ddec2b1cca88f5/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:43.964655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777486a-8abb-4fbb-8592-00744e683719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42292a81f5ad4da88a205ca1fc589cb3, user_id=6125efa09a844f0ea7ddec2b1cca88f5, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:43.967492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777486a-8abb-4fbb-8592-00744e683719 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:43.982195 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1145/2299] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:28:43 2022] PUT /identity/v3/projects/42292a81f5ad4da88a205ca1fc589cb3/users/6125efa09a844f0ea7ddec2b1cca88f5/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:43.994326 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428531a3-0f74-4e90-b407-919c26fd1c18 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:43.994614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428531a3-0f74-4e90-b407-919c26fd1c18 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:43.994893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428531a3-0f74-4e90-b407-919c26fd1c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:44.023695 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-428531a3-0f74-4e90-b407-919c26fd1c18 None None] MFA Rules not processed for user `6125efa09a844f0ea7ddec2b1cca88f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:44.025020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-428531a3-0f74-4e90-b407-919c26fd1c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:44.038316 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ac135-670b-40c0-a90d-3a0c973de097 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:44.091290 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1146/2300] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:28:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:28:44.096875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428531a3-0f74-4e90-b407-919c26fd1c18 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:44.105492 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29320449-d1e1-425c-951e-4d6b8e72084c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:44.106166 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29320449-d1e1-425c-951e-4d6b8e72084c service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:44.106443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29320449-d1e1-425c-951e-4d6b8e72084c service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:44.106848 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29320449-d1e1-425c-951e-4d6b8e72084c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:44.108645 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-29320449-d1e1-425c-951e-4d6b8e72084c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:44.144412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:44.164745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428531a3-0f74-4e90-b407-919c26fd1c18 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:44.169704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30142c-709d-48c5-a17c-e7c4a6551b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:44.170439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30142c-709d-48c5-a17c-e7c4a6551b5b admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:44.170852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30142c-709d-48c5-a17c-e7c4a6551b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:44.171259 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30142c-709d-48c5-a17c-e7c4a6551b5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:44.171988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30142c-709d-48c5-a17c-e7c4a6551b5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:44.173985 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30142c-709d-48c5-a17c-e7c4a6551b5b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:44.183645 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:44.183812 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29320449-d1e1-425c-951e-4d6b8e72084c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:44.185464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29320449-d1e1-425c-951e-4d6b8e72084c service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:44.199339 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1155/2301] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:28:44.204909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1147/2302] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:28:44 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:28:44.208960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29320449-d1e1-425c-951e-4d6b8e72084c service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:44.222283 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29320449-d1e1-425c-951e-4d6b8e72084c service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:44.289588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366429af-5d2a-4b52-bd95-99cb51f6bcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:44.291150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366429af-5d2a-4b52-bd95-99cb51f6bcb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:44.291434 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366429af-5d2a-4b52-bd95-99cb51f6bcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:44.291703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366429af-5d2a-4b52-bd95-99cb51f6bcb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:44.292346 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366429af-5d2a-4b52-bd95-99cb51f6bcb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:44.294524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366429af-5d2a-4b52-bd95-99cb51f6bcb2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:44.319177 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1156/2303] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:28:44 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:28:44.323428 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30142c-709d-48c5-a17c-e7c4a6551b5b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:44.335857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30142c-709d-48c5-a17c-e7c4a6551b5b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:44.340708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509254d8-ec18-4a3f-9cd3-d70126a978ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:44.341319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509254d8-ec18-4a3f-9cd3-d70126a978ed admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:44.341605 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509254d8-ec18-4a3f-9cd3-d70126a978ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:44.341924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509254d8-ec18-4a3f-9cd3-d70126a978ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:44.342571 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509254d8-ec18-4a3f-9cd3-d70126a978ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:44.345093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509254d8-ec18-4a3f-9cd3-d70126a978ed admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:44.356013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1148/2304] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:28:44.360198 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366429af-5d2a-4b52-bd95-99cb51f6bcb2 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:44.371314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366429af-5d2a-4b52-bd95-99cb51f6bcb2 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:44.382207 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792af062-d4af-41ca-b649-5d072bec169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:44.383961 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792af062-d4af-41ca-b649-5d072bec169c admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:44.384395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792af062-d4af-41ca-b649-5d072bec169c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:44.384827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792af062-d4af-41ca-b649-5d072bec169c admin admin] PATH_INFO: `/v3/projects/fd602d4cdd57407d82ffeb9fb36998b0/users/cff90818f1db4680b4275fb7968eabd9/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:44.402729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792af062-d4af-41ca-b649-5d072bec169c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd602d4cdd57407d82ffeb9fb36998b0, user_id=cff90818f1db4680b4275fb7968eabd9, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:44.405720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792af062-d4af-41ca-b649-5d072bec169c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:44.422667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1157/2305] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:28:44 2022] PUT /identity/v3/projects/fd602d4cdd57407d82ffeb9fb36998b0/users/cff90818f1db4680b4275fb7968eabd9/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:28:44.427219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509254d8-ec18-4a3f-9cd3-d70126a978ed admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:44.441066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509254d8-ec18-4a3f-9cd3-d70126a978ed admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:44.497773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812294b-3f77-4afe-b21b-2c47ca504207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:44.498409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812294b-3f77-4afe-b21b-2c47ca504207 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:44.498690 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812294b-3f77-4afe-b21b-2c47ca504207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:44.498964 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812294b-3f77-4afe-b21b-2c47ca504207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:44.500429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812294b-3f77-4afe-b21b-2c47ca504207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:44.502061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812294b-3f77-4afe-b21b-2c47ca504207 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:44.511664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1149/2306] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:28:44.516767 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792af062-d4af-41ca-b649-5d072bec169c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:44.526894 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792af062-d4af-41ca-b649-5d072bec169c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:44.531718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655bdae-6286-4ba8-b2b5-5e6840987545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:44.532365 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655bdae-6286-4ba8-b2b5-5e6840987545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:44.532648 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655bdae-6286-4ba8-b2b5-5e6840987545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:44.532927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655bdae-6286-4ba8-b2b5-5e6840987545 admin admin] PATH_INFO: `/v3/projects/fd602d4cdd57407d82ffeb9fb36998b0/users/cff90818f1db4680b4275fb7968eabd9/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:44.534840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655bdae-6286-4ba8-b2b5-5e6840987545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd602d4cdd57407d82ffeb9fb36998b0, user_id=cff90818f1db4680b4275fb7968eabd9, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:44.537426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655bdae-6286-4ba8-b2b5-5e6840987545 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:44.547444 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1158/2307] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:28:44 2022] PUT /identity/v3/projects/fd602d4cdd57407d82ffeb9fb36998b0/users/cff90818f1db4680b4275fb7968eabd9/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:44.557265 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4a5cc-18d8-48b3-bfe3-b5d788d8731f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:44.557550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4a5cc-18d8-48b3-bfe3-b5d788d8731f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:44.557904 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4a5cc-18d8-48b3-bfe3-b5d788d8731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:44.588703 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-23d4a5cc-18d8-48b3-bfe3-b5d788d8731f None None] MFA Rules not processed for user `cff90818f1db4680b4275fb7968eabd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:44.589927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-23d4a5cc-18d8-48b3-bfe3-b5d788d8731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:44.657343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1150/2308] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:28:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:28:44.669456 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655bdae-6286-4ba8-b2b5-5e6840987545 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:44.671214 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a655bdae-6286-4ba8-b2b5-5e6840987545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:44.727909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655bdae-6286-4ba8-b2b5-5e6840987545 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:44.731616 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fe5c4-2816-45f7-8338-86fec927f72e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:44.732210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fe5c4-2816-45f7-8338-86fec927f72e service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:44.732507 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fe5c4-2816-45f7-8338-86fec927f72e service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:44.732764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fe5c4-2816-45f7-8338-86fec927f72e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:44.741726 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fe5c4-2816-45f7-8338-86fec927f72e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:44.743145 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fe5c4-2816-45f7-8338-86fec927f72e service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:44.753215 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1159/2309] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:28:44.846772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4a5cc-18d8-48b3-bfe3-b5d788d8731f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:44.856268 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4a5cc-18d8-48b3-bfe3-b5d788d8731f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:44.860475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c9f66-2ca4-484c-b657-5a678c52a874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:44.861067 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c9f66-2ca4-484c-b657-5a678c52a874 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:44.861346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c9f66-2ca4-484c-b657-5a678c52a874 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:44.861622 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c9f66-2ca4-484c-b657-5a678c52a874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:44.916786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c9f66-2ca4-484c-b657-5a678c52a874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:44.918164 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c9f66-2ca4-484c-b657-5a678c52a874 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:44.925009 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:44.928862 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1151/2310] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:28:49.672634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fe5c4-2816-45f7-8338-86fec927f72e service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:49.699650 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:49.741876 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fe5c4-2816-45f7-8338-86fec927f72e service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:49.746339 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623c51f-179d-4a68-a94b-9bbf5558d204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:49.746954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623c51f-179d-4a68-a94b-9bbf5558d204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:49.747226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623c51f-179d-4a68-a94b-9bbf5558d204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:49.747493 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623c51f-179d-4a68-a94b-9bbf5558d204 admin admin] PATH_INFO: `/v3/users/6125efa09a844f0ea7ddec2b1cca88f5` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:49.748587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623c51f-179d-4a68-a94b-9bbf5558d204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6125efa09a844f0ea7ddec2b1cca88f5)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:49.750505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623c51f-179d-4a68-a94b-9bbf5558d204 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:49.800099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5623c51f-179d-4a68-a94b-9bbf5558d204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6125efa09a844f0ea7ddec2b1cca88f5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:49.800784 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5623c51f-179d-4a68-a94b-9bbf5558d204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6125efa09a844f0ea7ddec2b1cca88f5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:49.808655 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5623c51f-179d-4a68-a94b-9bbf5558d204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6125efa09a844f0ea7ddec2b1cca88f5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:49.821475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5623c51f-179d-4a68-a94b-9bbf5558d204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6125efa09a844f0ea7ddec2b1cca88f5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:49.828877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5623c51f-179d-4a68-a94b-9bbf5558d204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6125efa09a844f0ea7ddec2b1cca88f5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:49.835326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1160/2311] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:28:49 2022] DELETE /identity/v3/users/6125efa09a844f0ea7ddec2b1cca88f5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:49.839625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30014b-6c3a-4c58-98df-acffdfe92246 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:49.840093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30014b-6c3a-4c58-98df-acffdfe92246 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:49.840637 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30014b-6c3a-4c58-98df-acffdfe92246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:49.862465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1b30014b-6c3a-4c58-98df-acffdfe92246 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:49.863754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1b30014b-6c3a-4c58-98df-acffdfe92246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:49.924750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1152/2312] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:28:49.935197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623c51f-179d-4a68-a94b-9bbf5558d204 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:49.936638 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5623c51f-179d-4a68-a94b-9bbf5558d204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:50.001136 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623c51f-179d-4a68-a94b-9bbf5558d204 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:50.005108 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7228b-52d0-4c65-8f05-1253f71e69f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:50.005747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7228b-52d0-4c65-8f05-1253f71e69f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:50.006030 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7228b-52d0-4c65-8f05-1253f71e69f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:50.006931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7228b-52d0-4c65-8f05-1253f71e69f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:50.025226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7228b-52d0-4c65-8f05-1253f71e69f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:50.026899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7228b-52d0-4c65-8f05-1253f71e69f4 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:50.038610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1161/2313] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:28:50.318820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30014b-6c3a-4c58-98df-acffdfe92246 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:50.320747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1b30014b-6c3a-4c58-98df-acffdfe92246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:50.334533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30014b-6c3a-4c58-98df-acffdfe92246 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:50.340251 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e502e9-d978-45da-aaa8-566194df1122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:50.341016 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e502e9-d978-45da-aaa8-566194df1122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:50.348467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e502e9-d978-45da-aaa8-566194df1122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:50.348811 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e502e9-d978-45da-aaa8-566194df1122 admin admin] PATH_INFO: `/v3/projects/42292a81f5ad4da88a205ca1fc589cb3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:50.350467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e502e9-d978-45da-aaa8-566194df1122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42292a81f5ad4da88a205ca1fc589cb3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:50.352478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e502e9-d978-45da-aaa8-566194df1122 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:50.401370 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a7e502e9-d978-45da-aaa8-566194df1122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42292a81f5ad4da88a205ca1fc589cb3', 'request_id': 'req-a7e502e9-d978-45da-aaa8-566194df1122'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:50.406921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a7e502e9-d978-45da-aaa8-566194df1122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42292a81f5ad4da88a205ca1fc589cb3', 'request_id': 'req-a7e502e9-d978-45da-aaa8-566194df1122'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:50.413020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a7e502e9-d978-45da-aaa8-566194df1122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42292a81f5ad4da88a205ca1fc589cb3', 'request_id': 'req-a7e502e9-d978-45da-aaa8-566194df1122'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:50.428485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a7e502e9-d978-45da-aaa8-566194df1122 admin admin] The token cache is being invalidate because project 42292a81f5ad4da88a205ca1fc589cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:28:50.428774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a7e502e9-d978-45da-aaa8-566194df1122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:50.429402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a7e502e9-d978-45da-aaa8-566194df1122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:50.430977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1153/2314] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:28:50 2022] DELETE /identity/v3/projects/42292a81f5ad4da88a205ca1fc589cb3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:50.434976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7228b-52d0-4c65-8f05-1253f71e69f4 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:50.445197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7228b-52d0-4c65-8f05-1253f71e69f4 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:50.486082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:50.502112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7036a38-5c68-4d3f-98dc-bf42ca9e86a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:50.502675 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7036a38-5c68-4d3f-98dc-bf42ca9e86a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:50.502955 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7036a38-5c68-4d3f-98dc-bf42ca9e86a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:50.503228 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7036a38-5c68-4d3f-98dc-bf42ca9e86a6 admin admin] PATH_INFO: `/v3/users/cff90818f1db4680b4275fb7968eabd9` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:50.504337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7036a38-5c68-4d3f-98dc-bf42ca9e86a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cff90818f1db4680b4275fb7968eabd9)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:50.506275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7036a38-5c68-4d3f-98dc-bf42ca9e86a6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:50.550992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7036a38-5c68-4d3f-98dc-bf42ca9e86a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cff90818f1db4680b4275fb7968eabd9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:50.551635 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7036a38-5c68-4d3f-98dc-bf42ca9e86a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cff90818f1db4680b4275fb7968eabd9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:50.557978 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7036a38-5c68-4d3f-98dc-bf42ca9e86a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cff90818f1db4680b4275fb7968eabd9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:50.570525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7036a38-5c68-4d3f-98dc-bf42ca9e86a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cff90818f1db4680b4275fb7968eabd9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:50.577238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7036a38-5c68-4d3f-98dc-bf42ca9e86a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cff90818f1db4680b4275fb7968eabd9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:50.583616 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1162/2315] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:28:50 2022] DELETE /identity/v3/users/cff90818f1db4680b4275fb7968eabd9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:50.631482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e502e9-d978-45da-aaa8-566194df1122 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:50.632910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a7e502e9-d978-45da-aaa8-566194df1122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:50.710833 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e502e9-d978-45da-aaa8-566194df1122 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:50.728354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:50.781664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa53670-e408-412c-98ab-b4753e8c0b1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:50.782916 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa53670-e408-412c-98ab-b4753e8c0b1b service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:50.783196 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa53670-e408-412c-98ab-b4753e8c0b1b service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:50.783484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa53670-e408-412c-98ab-b4753e8c0b1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:50.785212 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5aa53670-e408-412c-98ab-b4753e8c0b1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:50.846515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa53670-e408-412c-98ab-b4753e8c0b1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:50.848887 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa53670-e408-412c-98ab-b4753e8c0b1b service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:50.858873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1154/2316] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:28:50.875882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7036a38-5c68-4d3f-98dc-bf42ca9e86a6 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:50.877461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a7036a38-5c68-4d3f-98dc-bf42ca9e86a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:50.958290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7036a38-5c68-4d3f-98dc-bf42ca9e86a6 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:50.962956 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a14d5-cd2d-47e9-aa49-0cdc10560480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:50.963586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a14d5-cd2d-47e9-aa49-0cdc10560480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:50.963865 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a14d5-cd2d-47e9-aa49-0cdc10560480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:50.964138 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a14d5-cd2d-47e9-aa49-0cdc10560480 admin admin] PATH_INFO: `/v3/projects/fd602d4cdd57407d82ffeb9fb36998b0` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:50.965252 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a14d5-cd2d-47e9-aa49-0cdc10560480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd602d4cdd57407d82ffeb9fb36998b0)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:50.967160 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a14d5-cd2d-47e9-aa49-0cdc10560480 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:51.014691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b00a14d5-cd2d-47e9-aa49-0cdc10560480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd602d4cdd57407d82ffeb9fb36998b0', 'request_id': 'req-b00a14d5-cd2d-47e9-aa49-0cdc10560480'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:51.021104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b00a14d5-cd2d-47e9-aa49-0cdc10560480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd602d4cdd57407d82ffeb9fb36998b0', 'request_id': 'req-b00a14d5-cd2d-47e9-aa49-0cdc10560480'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:51.027663 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b00a14d5-cd2d-47e9-aa49-0cdc10560480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd602d4cdd57407d82ffeb9fb36998b0', 'request_id': 'req-b00a14d5-cd2d-47e9-aa49-0cdc10560480'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:51.030789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:51.043928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b00a14d5-cd2d-47e9-aa49-0cdc10560480 admin admin] The token cache is being invalidate because project fd602d4cdd57407d82ffeb9fb36998b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:28:51.044276 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b00a14d5-cd2d-47e9-aa49-0cdc10560480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:51.045266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b00a14d5-cd2d-47e9-aa49-0cdc10560480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:28:51.046795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1163/2317] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:28:50 2022] DELETE /identity/v3/projects/fd602d4cdd57407d82ffeb9fb36998b0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:51.051904 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93e261-20d5-4ecb-80c8-20c8b4c3246a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:51.052190 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93e261-20d5-4ecb-80c8-20c8b4c3246a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:51.052463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93e261-20d5-4ecb-80c8-20c8b4c3246a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:51.074150 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4e93e261-20d5-4ecb-80c8-20c8b4c3246a None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:51.075356 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4e93e261-20d5-4ecb-80c8-20c8b4c3246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:51.167396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1155/2318] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:28:51.176257 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ab557-ea4b-40f5-ae27-00418ad71915 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:51.176257 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ab557-ea4b-40f5-ae27-00418ad71915 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:51.176589 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ab557-ea4b-40f5-ae27-00418ad71915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:51.206744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e31ab557-ea4b-40f5-ae27-00418ad71915 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:51.208019 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e31ab557-ea4b-40f5-ae27-00418ad71915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:51.216798 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1164/2319] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:28:51.221411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93e261-20d5-4ecb-80c8-20c8b4c3246a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:51.238419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93e261-20d5-4ecb-80c8-20c8b4c3246a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:51.245267 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae3526-a475-402b-a30d-7e99f0cab38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:51.246031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae3526-a475-402b-a30d-7e99f0cab38c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:51.246487 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae3526-a475-402b-a30d-7e99f0cab38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:51.246923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae3526-a475-402b-a30d-7e99f0cab38c admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:51.248291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae3526-a475-402b-a30d-7e99f0cab38c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:28:51.249228 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae3526-a475-402b-a30d-7e99f0cab38c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:51.251371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae3526-a475-402b-a30d-7e99f0cab38c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:51.283354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1156/2320] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:28:51.285189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ab557-ea4b-40f5-ae27-00418ad71915 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:51.296221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ab557-ea4b-40f5-ae27-00418ad71915 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:51.302542 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185389b-23e0-4487-8622-3f4be30f917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:51.303316 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185389b-23e0-4487-8622-3f4be30f917e admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:51.303772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185389b-23e0-4487-8622-3f4be30f917e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:51.304035 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185389b-23e0-4487-8622-3f4be30f917e admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:51.304802 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185389b-23e0-4487-8622-3f4be30f917e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:51.306735 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185389b-23e0-4487-8622-3f4be30f917e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:51.349724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1165/2321] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:28:51 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:28:51.352246 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae3526-a475-402b-a30d-7e99f0cab38c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:51.371044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae3526-a475-402b-a30d-7e99f0cab38c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:51.430923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:51.450973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003fcc16-4ae2-4b18-8507-bda638d58a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:51.451595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fcc16-4ae2-4b18-8507-bda638d58a70 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:51.451875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fcc16-4ae2-4b18-8507-bda638d58a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:51.452148 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fcc16-4ae2-4b18-8507-bda638d58a70 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:51.452962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003fcc16-4ae2-4b18-8507-bda638d58a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:51.456975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003fcc16-4ae2-4b18-8507-bda638d58a70 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:51.492656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1157/2322] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:28:51 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:28:51.493210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185389b-23e0-4487-8622-3f4be30f917e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:51.512956 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185389b-23e0-4487-8622-3f4be30f917e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:51.519508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14479079-f248-48a9-95fc-b6f8821c7349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:51.520407 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479079-f248-48a9-95fc-b6f8821c7349 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:51.520746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479079-f248-48a9-95fc-b6f8821c7349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:51.521026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14479079-f248-48a9-95fc-b6f8821c7349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:51.521759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14479079-f248-48a9-95fc-b6f8821c7349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:51.523494 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14479079-f248-48a9-95fc-b6f8821c7349 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:51.539083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1166/2323] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:28:51.540363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003fcc16-4ae2-4b18-8507-bda638d58a70 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:51.553203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003fcc16-4ae2-4b18-8507-bda638d58a70 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:51.558179 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa434579-8c48-4ef9-9308-c26d5ccd2c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:51.558789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa434579-8c48-4ef9-9308-c26d5ccd2c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:51.559073 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa434579-8c48-4ef9-9308-c26d5ccd2c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:51.559531 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa434579-8c48-4ef9-9308-c26d5ccd2c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:51.560711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa434579-8c48-4ef9-9308-c26d5ccd2c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:51.562788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa434579-8c48-4ef9-9308-c26d5ccd2c8c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:51.581314 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1158/2324] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:28:51.583874 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14479079-f248-48a9-95fc-b6f8821c7349 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:51.595242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14479079-f248-48a9-95fc-b6f8821c7349 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:51.604020 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea8a93-43c0-4cbe-9888-7220803c5006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:51.604957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea8a93-43c0-4cbe-9888-7220803c5006 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:51.605432 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea8a93-43c0-4cbe-9888-7220803c5006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:51.605925 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea8a93-43c0-4cbe-9888-7220803c5006 admin admin] PATH_INFO: `/v3/projects/c70d415018ba4f80a2dcdc1a68189fd0/users/b2fc98b1d41c408885d9d8bafec2478c/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:51.625174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea8a93-43c0-4cbe-9888-7220803c5006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70d415018ba4f80a2dcdc1a68189fd0, user_id=b2fc98b1d41c408885d9d8bafec2478c, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:51.629036 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea8a93-43c0-4cbe-9888-7220803c5006 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:51.651074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1167/2325] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:28:51 2022] PUT /identity/v3/projects/c70d415018ba4f80a2dcdc1a68189fd0/users/b2fc98b1d41c408885d9d8bafec2478c/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:51.662507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5ca7f-f21b-4f2e-bc98-2578ba7f1435 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:51.662793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5ca7f-f21b-4f2e-bc98-2578ba7f1435 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:51.663087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5ca7f-f21b-4f2e-bc98-2578ba7f1435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:51.694018 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-acc5ca7f-f21b-4f2e-bc98-2578ba7f1435 None None] MFA Rules not processed for user `b2fc98b1d41c408885d9d8bafec2478c`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:51.695146 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-acc5ca7f-f21b-4f2e-bc98-2578ba7f1435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:51.726557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b130eac-7906-4366-a4a7-1213b7c61ec7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:51.727948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b130eac-7906-4366-a4a7-1213b7c61ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:51.728229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b130eac-7906-4366-a4a7-1213b7c61ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:51.755080 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0b130eac-7906-4366-a4a7-1213b7c61ec7 None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:51.756335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0b130eac-7906-4366-a4a7-1213b7c61ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:51.778646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1159/2326] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:28:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:28:51.783082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5ca7f-f21b-4f2e-bc98-2578ba7f1435 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:51.827990 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1168/2327] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Sep 27 17:28:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:28:51.861831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5ca7f-f21b-4f2e-bc98-2578ba7f1435 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:51.871254 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e601411-7d59-457f-8557-c75bd6136bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:51.871888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e601411-7d59-457f-8557-c75bd6136bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:51.872172 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e601411-7d59-457f-8557-c75bd6136bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:51.872446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e601411-7d59-457f-8557-c75bd6136bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:51.873099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e601411-7d59-457f-8557-c75bd6136bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:51.877480 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e601411-7d59-457f-8557-c75bd6136bc2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:51.895356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b130eac-7906-4366-a4a7-1213b7c61ec7 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:51.896968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0b130eac-7906-4366-a4a7-1213b7c61ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:51.913377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1160/2328] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:28:51 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:28:51.917223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e601411-7d59-457f-8557-c75bd6136bc2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:51.963956 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:51.982924 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b130eac-7906-4366-a4a7-1213b7c61ec7 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:51.989871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e601411-7d59-457f-8557-c75bd6136bc2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:51.994596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ff3b0-64ba-4b59-8f0d-854750f28e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:51.995312 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ff3b0-64ba-4b59-8f0d-854750f28e06 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:51.995614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ff3b0-64ba-4b59-8f0d-854750f28e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:51.995886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ff3b0-64ba-4b59-8f0d-854750f28e06 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:51.996530 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ff3b0-64ba-4b59-8f0d-854750f28e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:51.998881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ff3b0-64ba-4b59-8f0d-854750f28e06 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:52.022692 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:52.027192 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1161/2329] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:28:51 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:28:52.028014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ff3b0-64ba-4b59-8f0d-854750f28e06 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:52.039731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ff3b0-64ba-4b59-8f0d-854750f28e06 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:52.045957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2deed-cf25-4db5-afbf-47ebbf5ee9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:52.046818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2deed-cf25-4db5-afbf-47ebbf5ee9ad admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:52.047103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2deed-cf25-4db5-afbf-47ebbf5ee9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:52.048435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2deed-cf25-4db5-afbf-47ebbf5ee9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:52.049279 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2deed-cf25-4db5-afbf-47ebbf5ee9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:52.051069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2deed-cf25-4db5-afbf-47ebbf5ee9ad admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:52.058634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fceb894-1267-48d0-bbaf-da56cd10ef0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:52.059349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fceb894-1267-48d0-bbaf-da56cd10ef0f service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:52.060067 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fceb894-1267-48d0-bbaf-da56cd10ef0f service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:52.060067 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fceb894-1267-48d0-bbaf-da56cd10ef0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:52.062524 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1162/2330] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:28:52.066418 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2deed-cf25-4db5-afbf-47ebbf5ee9ad admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:52.080067 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2deed-cf25-4db5-afbf-47ebbf5ee9ad admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:52.085154 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dd4b3-f018-4f98-8d0c-fe6f81ed2be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:52.085943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dd4b3-f018-4f98-8d0c-fe6f81ed2be0 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:52.086075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dd4b3-f018-4f98-8d0c-fe6f81ed2be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:52.086367 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dd4b3-f018-4f98-8d0c-fe6f81ed2be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:52.087014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dd4b3-f018-4f98-8d0c-fe6f81ed2be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:52.088702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44dd4b3-f018-4f98-8d0c-fe6f81ed2be0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:52.104133 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1163/2331] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:28:52.105880 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dd4b3-f018-4f98-8d0c-fe6f81ed2be0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:52.117743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dd4b3-f018-4f98-8d0c-fe6f81ed2be0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:52.123008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f22a2a-3b03-4329-84e0-815298a634e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:52.123562 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fceb894-1267-48d0-bbaf-da56cd10ef0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:52.123685 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f22a2a-3b03-4329-84e0-815298a634e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:52.124065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f22a2a-3b03-4329-84e0-815298a634e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:52.124338 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f22a2a-3b03-4329-84e0-815298a634e3 admin admin] PATH_INFO: `/v3/projects/fede0e935ddd42cf93d72bfaf2daf9c3/users/b005723e57ab4fc490472849244fe1e0/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:52.125148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fceb894-1267-48d0-bbaf-da56cd10ef0f service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:52.133415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1169/2332] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:28:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 27 17:28:52.139225 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f22a2a-3b03-4329-84e0-815298a634e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fede0e935ddd42cf93d72bfaf2daf9c3, user_id=b005723e57ab4fc490472849244fe1e0, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:52.141958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f22a2a-3b03-4329-84e0-815298a634e3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:52.171986 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1164/2333] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:28:52 2022] PUT /identity/v3/projects/fede0e935ddd42cf93d72bfaf2daf9c3/users/b005723e57ab4fc490472849244fe1e0/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:28:52.175193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee3d78-77df-4485-959e-7c69bf754c13 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:52.175394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee3d78-77df-4485-959e-7c69bf754c13 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:52.175717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee3d78-77df-4485-959e-7c69bf754c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:52.216138 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a1ee3d78-77df-4485-959e-7c69bf754c13 None None] MFA Rules not processed for user `b005723e57ab4fc490472849244fe1e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:52.217734 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a1ee3d78-77df-4485-959e-7c69bf754c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:52.348572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f22a2a-3b03-4329-84e0-815298a634e3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:52.348812 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1170/2334] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:28:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:28:52.464545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f22a2a-3b03-4329-84e0-815298a634e3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:52.475319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25010634-cc89-4cad-882d-85a4423e2e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:52.475905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25010634-cc89-4cad-882d-85a4423e2e11 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:52.476080 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25010634-cc89-4cad-882d-85a4423e2e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:52.476398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25010634-cc89-4cad-882d-85a4423e2e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:52.477001 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25010634-cc89-4cad-882d-85a4423e2e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:52.482777 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25010634-cc89-4cad-882d-85a4423e2e11 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:52.519357 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1165/2335] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:28:52 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:28:52.520192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee3d78-77df-4485-959e-7c69bf754c13 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:52.534324 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee3d78-77df-4485-959e-7c69bf754c13 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:52.615986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632736f-e4a5-4aaa-b34f-a972d3eb6290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:52.616622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632736f-e4a5-4aaa-b34f-a972d3eb6290 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:52.617056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632736f-e4a5-4aaa-b34f-a972d3eb6290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:52.617387 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632736f-e4a5-4aaa-b34f-a972d3eb6290 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:52.618254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632736f-e4a5-4aaa-b34f-a972d3eb6290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:52.620397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632736f-e4a5-4aaa-b34f-a972d3eb6290 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:52.629616 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25010634-cc89-4cad-882d-85a4423e2e11 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:52.634866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-25010634-cc89-4cad-882d-85a4423e2e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:52.656585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:52.676567 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1171/2336] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:28:52 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:28:52.680336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632736f-e4a5-4aaa-b34f-a972d3eb6290 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:52.695228 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632736f-e4a5-4aaa-b34f-a972d3eb6290 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:52.703612 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb00153-e45c-4aea-95ab-9e589c532222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:52.708494 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00153-e45c-4aea-95ab-9e589c532222 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:52.709877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00153-e45c-4aea-95ab-9e589c532222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:52.710971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00153-e45c-4aea-95ab-9e589c532222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:52.711746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb00153-e45c-4aea-95ab-9e589c532222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:52.714849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb00153-e45c-4aea-95ab-9e589c532222 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:52.754402 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1172/2337] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:28:52.755521 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb00153-e45c-4aea-95ab-9e589c532222 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:52.759731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bbb00153-e45c-4aea-95ab-9e589c532222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:52.766305 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25010634-cc89-4cad-882d-85a4423e2e11 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:52.770276 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9e8de-84a5-49e8-bb24-bfccd63d90d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:52.771046 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9e8de-84a5-49e8-bb24-bfccd63d90d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:52.771393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9e8de-84a5-49e8-bb24-bfccd63d90d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:52.771741 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9e8de-84a5-49e8-bb24-bfccd63d90d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:52.773966 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-24a9e8de-84a5-49e8-bb24-bfccd63d90d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:52.780484 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb00153-e45c-4aea-95ab-9e589c532222 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:52.796226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177b768-7630-400f-8170-d8fe3c447d35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:52.796863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177b768-7630-400f-8170-d8fe3c447d35 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:52.797144 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177b768-7630-400f-8170-d8fe3c447d35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:52.798356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177b768-7630-400f-8170-d8fe3c447d35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:52.801606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2177b768-7630-400f-8170-d8fe3c447d35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:52.811927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:52.884962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9e8de-84a5-49e8-bb24-bfccd63d90d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:52.887389 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9e8de-84a5-49e8-bb24-bfccd63d90d4 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:52.892521 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177b768-7630-400f-8170-d8fe3c447d35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:52.895384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177b768-7630-400f-8170-d8fe3c447d35 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:52.905951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1173/2338] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:28:52.907465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177b768-7630-400f-8170-d8fe3c447d35 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:52.918792 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177b768-7630-400f-8170-d8fe3c447d35 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:52.925394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29389a52-709f-4c9a-a062-1cb2d5762b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:52.926084 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1166/2339] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:28:52.927100 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29389a52-709f-4c9a-a062-1cb2d5762b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:52.927564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29389a52-709f-4c9a-a062-1cb2d5762b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:52.927990 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29389a52-709f-4c9a-a062-1cb2d5762b3f admin admin] PATH_INFO: `/v3/projects/c8ca12a9432d47d78cc6d41a7f551c42/users/5783e06e85cc4f058040e40ca82564c7/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:52.966011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29389a52-709f-4c9a-a062-1cb2d5762b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ca12a9432d47d78cc6d41a7f551c42, user_id=5783e06e85cc4f058040e40ca82564c7, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:52.974426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29389a52-709f-4c9a-a062-1cb2d5762b3f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:53.014572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1174/2340] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:28:52 2022] PUT /identity/v3/projects/c8ca12a9432d47d78cc6d41a7f551c42/users/5783e06e85cc4f058040e40ca82564c7/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:53.014679 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9e8de-84a5-49e8-bb24-bfccd63d90d4 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:53.035829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9e8de-84a5-49e8-bb24-bfccd63d90d4 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:53.123669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694b4cc-9ab8-4c3f-b3e0-f2914f6efdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:53.124528 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694b4cc-9ab8-4c3f-b3e0-f2914f6efdca admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:53.124907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694b4cc-9ab8-4c3f-b3e0-f2914f6efdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:53.125318 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694b4cc-9ab8-4c3f-b3e0-f2914f6efdca admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:53.126734 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694b4cc-9ab8-4c3f-b3e0-f2914f6efdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:53.129608 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694b4cc-9ab8-4c3f-b3e0-f2914f6efdca admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:53.149598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1167/2341] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:28:53.151049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29389a52-709f-4c9a-a062-1cb2d5762b3f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:53.168831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29389a52-709f-4c9a-a062-1cb2d5762b3f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:53.176766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a1aa3-e1ff-4c4d-ba3f-53a094b2de48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:53.177576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1aa3-e1ff-4c4d-ba3f-53a094b2de48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:53.177992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1aa3-e1ff-4c4d-ba3f-53a094b2de48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:53.178344 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1aa3-e1ff-4c4d-ba3f-53a094b2de48 admin admin] PATH_INFO: `/v3/projects/c8ca12a9432d47d78cc6d41a7f551c42/users/5783e06e85cc4f058040e40ca82564c7/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:53.180534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a1aa3-e1ff-4c4d-ba3f-53a094b2de48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ca12a9432d47d78cc6d41a7f551c42, user_id=5783e06e85cc4f058040e40ca82564c7, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:53.186171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a1aa3-e1ff-4c4d-ba3f-53a094b2de48 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:53.213744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1175/2342] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:28:53 2022] PUT /identity/v3/projects/c8ca12a9432d47d78cc6d41a7f551c42/users/5783e06e85cc4f058040e40ca82564c7/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:28:53.220069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f09bef-f260-4ce4-9636-ab63fbc61433 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:53.220235 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f09bef-f260-4ce4-9636-ab63fbc61433 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:53.220512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f09bef-f260-4ce4-9636-ab63fbc61433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:53.283655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-48f09bef-f260-4ce4-9636-ab63fbc61433 None None] MFA Rules not processed for user `5783e06e85cc4f058040e40ca82564c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:28:53.285207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-48f09bef-f260-4ce4-9636-ab63fbc61433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:28:53.376274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1168/2343] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:28:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:28:53.387793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a1aa3-e1ff-4c4d-ba3f-53a094b2de48 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:53.470313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a1aa3-e1ff-4c4d-ba3f-53a094b2de48 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:53.475222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fc409-5411-44d8-a4dc-3ea75026e797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:53.475849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fc409-5411-44d8-a4dc-3ea75026e797 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:53.476132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fc409-5411-44d8-a4dc-3ea75026e797 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:53.476435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fc409-5411-44d8-a4dc-3ea75026e797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:53.547314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fc409-5411-44d8-a4dc-3ea75026e797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:53.548885 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fc409-5411-44d8-a4dc-3ea75026e797 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:53.561976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1176/2344] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:28:55.245459 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f09bef-f260-4ce4-9636-ab63fbc61433 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:55.258070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f09bef-f260-4ce4-9636-ab63fbc61433 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:55.261675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacf7ae-3cbc-419f-b5b9-e5e727dcbb80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:55.262320 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacf7ae-3cbc-419f-b5b9-e5e727dcbb80 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:55.262599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacf7ae-3cbc-419f-b5b9-e5e727dcbb80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:55.262871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacf7ae-3cbc-419f-b5b9-e5e727dcbb80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:55.316301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:55.336809 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacf7ae-3cbc-419f-b5b9-e5e727dcbb80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:55.338467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cacf7ae-3cbc-419f-b5b9-e5e727dcbb80 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:55.350832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1169/2345] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:28:56.216964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fc409-5411-44d8-a4dc-3ea75026e797 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:28:56.226270 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:56.239838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fc409-5411-44d8-a4dc-3ea75026e797 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:28:56.253359 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f988510-0bdd-4909-80e9-17d3a64e5a07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:28:56.254113 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f988510-0bdd-4909-80e9-17d3a64e5a07 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:28:56.254386 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f988510-0bdd-4909-80e9-17d3a64e5a07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:28:56.254667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f988510-0bdd-4909-80e9-17d3a64e5a07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:28:56.278762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f988510-0bdd-4909-80e9-17d3a64e5a07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:28:56.280230 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f988510-0bdd-4909-80e9-17d3a64e5a07 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:28:56.299816 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1177/2346] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:28:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:00.460026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacf7ae-3cbc-419f-b5b9-e5e727dcbb80 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:00.547024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacf7ae-3cbc-419f-b5b9-e5e727dcbb80 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:00.552876 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8f53a-fc4d-4c5f-bdd9-f3b44e22acae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:00.554018 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8f53a-fc4d-4c5f-bdd9-f3b44e22acae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:00.554541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8f53a-fc4d-4c5f-bdd9-f3b44e22acae admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:00.555077 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8f53a-fc4d-4c5f-bdd9-f3b44e22acae admin admin] PATH_INFO: `/v3/users/b2fc98b1d41c408885d9d8bafec2478c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:00.557517 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8f53a-fc4d-4c5f-bdd9-f3b44e22acae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2fc98b1d41c408885d9d8bafec2478c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:00.559731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8f53a-fc4d-4c5f-bdd9-f3b44e22acae admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:00.638575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-37a8f53a-fc4d-4c5f-bdd9-f3b44e22acae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2fc98b1d41c408885d9d8bafec2478c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:00.651933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-37a8f53a-fc4d-4c5f-bdd9-f3b44e22acae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2fc98b1d41c408885d9d8bafec2478c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:00.674518 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-37a8f53a-fc4d-4c5f-bdd9-f3b44e22acae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2fc98b1d41c408885d9d8bafec2478c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:00.683096 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-37a8f53a-fc4d-4c5f-bdd9-f3b44e22acae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2fc98b1d41c408885d9d8bafec2478c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:00.683991 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-37a8f53a-fc4d-4c5f-bdd9-f3b44e22acae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2fc98b1d41c408885d9d8bafec2478c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:00.692762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1170/2347] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:00 2022] DELETE /identity/v3/users/b2fc98b1d41c408885d9d8bafec2478c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:00.697113 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2d5da-40dd-4b30-9280-0abab59c9717 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:00.697665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2d5da-40dd-4b30-9280-0abab59c9717 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:00.697921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2d5da-40dd-4b30-9280-0abab59c9717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:00.726859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-efb2d5da-40dd-4b30-9280-0abab59c9717 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:00.728329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-efb2d5da-40dd-4b30-9280-0abab59c9717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:00.819774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1178/2348] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:00.830991 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8f53a-fc4d-4c5f-bdd9-f3b44e22acae admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:00.832623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-37a8f53a-fc4d-4c5f-bdd9-f3b44e22acae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:01.003667 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8f53a-fc4d-4c5f-bdd9-f3b44e22acae admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:01.010478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf11c1-631d-4c2d-921c-d087f44b00e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:01.011105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf11c1-631d-4c2d-921c-d087f44b00e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:01.011408 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf11c1-631d-4c2d-921c-d087f44b00e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:01.011678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf11c1-631d-4c2d-921c-d087f44b00e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:01.023261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf11c1-631d-4c2d-921c-d087f44b00e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:01.025486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf11c1-631d-4c2d-921c-d087f44b00e0 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:01.049782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1171/2349] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:01.510147 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2d5da-40dd-4b30-9280-0abab59c9717 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:01.510561 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-efb2d5da-40dd-4b30-9280-0abab59c9717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:01.542714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2d5da-40dd-4b30-9280-0abab59c9717 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:01.562464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:01.563267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:01.563728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:01.564162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2 admin admin] PATH_INFO: `/v3/projects/c70d415018ba4f80a2dcdc1a68189fd0` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:01.567335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70d415018ba4f80a2dcdc1a68189fd0)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:01.571866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:01.688365 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70d415018ba4f80a2dcdc1a68189fd0', 'request_id': 'req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:01.703884 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70d415018ba4f80a2dcdc1a68189fd0', 'request_id': 'req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:01.716968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70d415018ba4f80a2dcdc1a68189fd0', 'request_id': 'req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:01.756329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2 admin admin] The token cache is being invalidate because project c70d415018ba4f80a2dcdc1a68189fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:01.756871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:01.758514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:01.764430 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1179/2350] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:01 2022] DELETE /identity/v3/projects/c70d415018ba4f80a2dcdc1a68189fd0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:01.771959 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf11c1-631d-4c2d-921c-d087f44b00e0 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:01.779994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:01.796559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf11c1-631d-4c2d-921c-d087f44b00e0 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:01.932350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dc4c6-f643-41ae-931d-96cb54250f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:01.932976 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dc4c6-f643-41ae-931d-96cb54250f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:01.933242 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dc4c6-f643-41ae-931d-96cb54250f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:01.933547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dc4c6-f643-41ae-931d-96cb54250f91 admin admin] PATH_INFO: `/v3/users/b005723e57ab4fc490472849244fe1e0` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:01.935569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17dc4c6-f643-41ae-931d-96cb54250f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b005723e57ab4fc490472849244fe1e0)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:01.939324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17dc4c6-f643-41ae-931d-96cb54250f91 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:02.017893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d17dc4c6-f643-41ae-931d-96cb54250f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b005723e57ab4fc490472849244fe1e0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:02.032998 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d17dc4c6-f643-41ae-931d-96cb54250f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b005723e57ab4fc490472849244fe1e0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:02.059937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d17dc4c6-f643-41ae-931d-96cb54250f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b005723e57ab4fc490472849244fe1e0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:02.070197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d17dc4c6-f643-41ae-931d-96cb54250f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b005723e57ab4fc490472849244fe1e0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:02.071003 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d17dc4c6-f643-41ae-931d-96cb54250f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b005723e57ab4fc490472849244fe1e0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:02.078791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1172/2351] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:01 2022] DELETE /identity/v3/users/b005723e57ab4fc490472849244fe1e0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:02.517455 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:02.519060 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:02.549021 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a465ea-37a6-4bc5-9474-13ab99d1d5b2 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:02.681055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a713a-12d0-4043-aa47-2e673033a645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:02.682323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a713a-12d0-4043-aa47-2e673033a645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:02.682323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a713a-12d0-4043-aa47-2e673033a645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:02.682538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a713a-12d0-4043-aa47-2e673033a645 admin admin] PATH_INFO: `/v3/projects/fede0e935ddd42cf93d72bfaf2daf9c3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:02.683951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a713a-12d0-4043-aa47-2e673033a645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fede0e935ddd42cf93d72bfaf2daf9c3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:02.686291 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a713a-12d0-4043-aa47-2e673033a645 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:02.710778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:02.758345 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-351a713a-12d0-4043-aa47-2e673033a645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fede0e935ddd42cf93d72bfaf2daf9c3', 'request_id': 'req-351a713a-12d0-4043-aa47-2e673033a645'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:02.769073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-351a713a-12d0-4043-aa47-2e673033a645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fede0e935ddd42cf93d72bfaf2daf9c3', 'request_id': 'req-351a713a-12d0-4043-aa47-2e673033a645'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:02.782542 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-351a713a-12d0-4043-aa47-2e673033a645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fede0e935ddd42cf93d72bfaf2daf9c3', 'request_id': 'req-351a713a-12d0-4043-aa47-2e673033a645'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:02.807381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-351a713a-12d0-4043-aa47-2e673033a645 admin admin] The token cache is being invalidate because project fede0e935ddd42cf93d72bfaf2daf9c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:02.807381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-351a713a-12d0-4043-aa47-2e673033a645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:02.807381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-351a713a-12d0-4043-aa47-2e673033a645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:02.807381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1180/2352] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:02 2022] DELETE /identity/v3/projects/fede0e935ddd42cf93d72bfaf2daf9c3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:02.809397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dc4c6-f643-41ae-931d-96cb54250f91 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:02.810946 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d17dc4c6-f643-41ae-931d-96cb54250f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:02.838733 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dc4c6-f643-41ae-931d-96cb54250f91 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:02.963837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60f6ae-b1bd-4d26-9cf1-ee7648e5efa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:02.965354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60f6ae-b1bd-4d26-9cf1-ee7648e5efa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:02.965354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60f6ae-b1bd-4d26-9cf1-ee7648e5efa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:02.965354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60f6ae-b1bd-4d26-9cf1-ee7648e5efa5 admin admin] PATH_INFO: `/v3/users/5783e06e85cc4f058040e40ca82564c7` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:02.971077 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60f6ae-b1bd-4d26-9cf1-ee7648e5efa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5783e06e85cc4f058040e40ca82564c7)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:02.977119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60f6ae-b1bd-4d26-9cf1-ee7648e5efa5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:03.017881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:03.065737 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bc60f6ae-b1bd-4d26-9cf1-ee7648e5efa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5783e06e85cc4f058040e40ca82564c7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:03.073268 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bc60f6ae-b1bd-4d26-9cf1-ee7648e5efa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5783e06e85cc4f058040e40ca82564c7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:03.102597 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bc60f6ae-b1bd-4d26-9cf1-ee7648e5efa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5783e06e85cc4f058040e40ca82564c7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:03.113338 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bc60f6ae-b1bd-4d26-9cf1-ee7648e5efa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5783e06e85cc4f058040e40ca82564c7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:03.114674 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bc60f6ae-b1bd-4d26-9cf1-ee7648e5efa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5783e06e85cc4f058040e40ca82564c7'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:03.138845 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1173/2353] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:02 2022] DELETE /identity/v3/users/5783e06e85cc4f058040e40ca82564c7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:03.677182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a713a-12d0-4043-aa47-2e673033a645 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:03.679253 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-351a713a-12d0-4043-aa47-2e673033a645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:03.695480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a713a-12d0-4043-aa47-2e673033a645 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:03.784238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b846d3c-5380-43e9-872b-f379c5d1df06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:03.785860 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b846d3c-5380-43e9-872b-f379c5d1df06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:03.786357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b846d3c-5380-43e9-872b-f379c5d1df06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:03.786840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b846d3c-5380-43e9-872b-f379c5d1df06 admin admin] PATH_INFO: `/v3/projects/c8ca12a9432d47d78cc6d41a7f551c42` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:03.788281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b846d3c-5380-43e9-872b-f379c5d1df06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ca12a9432d47d78cc6d41a7f551c42)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:03.790610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b846d3c-5380-43e9-872b-f379c5d1df06 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:03.895143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3b846d3c-5380-43e9-872b-f379c5d1df06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ca12a9432d47d78cc6d41a7f551c42', 'request_id': 'req-3b846d3c-5380-43e9-872b-f379c5d1df06'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:03.903990 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3b846d3c-5380-43e9-872b-f379c5d1df06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ca12a9432d47d78cc6d41a7f551c42', 'request_id': 'req-3b846d3c-5380-43e9-872b-f379c5d1df06'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:03.912314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3b846d3c-5380-43e9-872b-f379c5d1df06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ca12a9432d47d78cc6d41a7f551c42', 'request_id': 'req-3b846d3c-5380-43e9-872b-f379c5d1df06'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:03.929274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3b846d3c-5380-43e9-872b-f379c5d1df06 admin admin] The token cache is being invalidate because project c8ca12a9432d47d78cc6d41a7f551c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:03.929590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3b846d3c-5380-43e9-872b-f379c5d1df06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:03.931275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3b846d3c-5380-43e9-872b-f379c5d1df06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:03.933252 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1181/2354] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:03 2022] DELETE /identity/v3/projects/c8ca12a9432d47d78cc6d41a7f551c42 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:03.938120 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb159bb1-2b0c-49ce-a85b-e7aee08811e3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:03.938777 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb159bb1-2b0c-49ce-a85b-e7aee08811e3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:03.939794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb159bb1-2b0c-49ce-a85b-e7aee08811e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:03.980736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fb159bb1-2b0c-49ce-a85b-e7aee08811e3 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:03.982126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fb159bb1-2b0c-49ce-a85b-e7aee08811e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:04.057599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1174/2355] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:04.059366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835b3f3-387d-440f-ab2b-c5d19c77eb33 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:04.059653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835b3f3-387d-440f-ab2b-c5d19c77eb33 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:04.059929 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835b3f3-387d-440f-ab2b-c5d19c77eb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:04.088919 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-5835b3f3-387d-440f-ab2b-c5d19c77eb33 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:04.090184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5835b3f3-387d-440f-ab2b-c5d19c77eb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:04.111203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1182/2356] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:04.112504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb159bb1-2b0c-49ce-a85b-e7aee08811e3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:04.124783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb159bb1-2b0c-49ce-a85b-e7aee08811e3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:04.132057 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3adcb7-bb02-4741-b0ed-762ed8d5f211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:04.132808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3adcb7-bb02-4741-b0ed-762ed8d5f211 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:04.133220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3adcb7-bb02-4741-b0ed-762ed8d5f211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:04.133505 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3adcb7-bb02-4741-b0ed-762ed8d5f211 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:04.134201 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3adcb7-bb02-4741-b0ed-762ed8d5f211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:04.134513 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3adcb7-bb02-4741-b0ed-762ed8d5f211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:04.136148 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3adcb7-bb02-4741-b0ed-762ed8d5f211 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:04.150475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1175/2357] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:29:04.154855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835b3f3-387d-440f-ab2b-c5d19c77eb33 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:04.165249 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835b3f3-387d-440f-ab2b-c5d19c77eb33 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:04.171562 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f760ab-34b0-41f0-98c0-00407b5bea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:04.172250 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f760ab-34b0-41f0-98c0-00407b5bea59 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:04.172746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f760ab-34b0-41f0-98c0-00407b5bea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:04.173175 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f760ab-34b0-41f0-98c0-00407b5bea59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:04.173909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f760ab-34b0-41f0-98c0-00407b5bea59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:04.175958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f760ab-34b0-41f0-98c0-00407b5bea59 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:04.206778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1183/2358] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:04 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:04.211126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3adcb7-bb02-4741-b0ed-762ed8d5f211 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:04.223180 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3adcb7-bb02-4741-b0ed-762ed8d5f211 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:04.282755 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ba6f3-3d4c-49d7-bf25-cf866f027bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:04.283292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ba6f3-3d4c-49d7-bf25-cf866f027bda admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:04.283598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ba6f3-3d4c-49d7-bf25-cf866f027bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:04.283872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ba6f3-3d4c-49d7-bf25-cf866f027bda admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:04.284504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ba6f3-3d4c-49d7-bf25-cf866f027bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:04.286445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ba6f3-3d4c-49d7-bf25-cf866f027bda admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:04.307510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1176/2359] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:04 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:04.311913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f760ab-34b0-41f0-98c0-00407b5bea59 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:04.320024 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:04.324172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f760ab-34b0-41f0-98c0-00407b5bea59 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:04.331173 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31572a00-1ae3-4a99-94f8-308346603176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:04.331957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31572a00-1ae3-4a99-94f8-308346603176 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:04.332380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31572a00-1ae3-4a99-94f8-308346603176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:04.332654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31572a00-1ae3-4a99-94f8-308346603176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:04.333442 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31572a00-1ae3-4a99-94f8-308346603176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:04.335262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31572a00-1ae3-4a99-94f8-308346603176 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:04.349305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1184/2360] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:04.350636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ba6f3-3d4c-49d7-bf25-cf866f027bda admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:04.361363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ba6f3-3d4c-49d7-bf25-cf866f027bda admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:04.366175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c845c-0401-4a8b-a91a-bad60169c78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:04.366789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c845c-0401-4a8b-a91a-bad60169c78d admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:04.367072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c845c-0401-4a8b-a91a-bad60169c78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:04.367377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c845c-0401-4a8b-a91a-bad60169c78d admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:04.368021 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c845c-0401-4a8b-a91a-bad60169c78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:04.369630 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c845c-0401-4a8b-a91a-bad60169c78d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:04.384482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1177/2361] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:04.385738 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31572a00-1ae3-4a99-94f8-308346603176 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:04.396458 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31572a00-1ae3-4a99-94f8-308346603176 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:04.401312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879e061-8ea3-4a13-ac65-9ed7f0adbe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:04.402019 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879e061-8ea3-4a13-ac65-9ed7f0adbe4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:04.402304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879e061-8ea3-4a13-ac65-9ed7f0adbe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:04.402580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879e061-8ea3-4a13-ac65-9ed7f0adbe4e admin admin] PATH_INFO: `/v3/projects/dbbfc6fbafc149caacdfdc01a92735a1/users/b00a19a9c03e4523b190923771b9d937/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:04.422750 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879e061-8ea3-4a13-ac65-9ed7f0adbe4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbbfc6fbafc149caacdfdc01a92735a1, user_id=b00a19a9c03e4523b190923771b9d937, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:04.425538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879e061-8ea3-4a13-ac65-9ed7f0adbe4e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:04.445540 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1185/2362] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:04 2022] PUT /identity/v3/projects/dbbfc6fbafc149caacdfdc01a92735a1/users/b00a19a9c03e4523b190923771b9d937/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:04.456162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb3083-8bc5-45f5-b5f3-c9a240cea6b0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:04.456445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb3083-8bc5-45f5-b5f3-c9a240cea6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:04.456714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb3083-8bc5-45f5-b5f3-c9a240cea6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:04.470062 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:04.487758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2acb3083-8bc5-45f5-b5f3-c9a240cea6b0 None None] MFA Rules not processed for user `b00a19a9c03e4523b190923771b9d937`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:04.488965 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2acb3083-8bc5-45f5-b5f3-c9a240cea6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:04.551566 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1178/2363] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:04.555953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879e061-8ea3-4a13-ac65-9ed7f0adbe4e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:04.616839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879e061-8ea3-4a13-ac65-9ed7f0adbe4e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:04.621437 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a42581-a44d-4887-879f-53f41f820865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:04.622061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42581-a44d-4887-879f-53f41f820865 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:04.622344 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42581-a44d-4887-879f-53f41f820865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:04.622620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42581-a44d-4887-879f-53f41f820865 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:04.623256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a42581-a44d-4887-879f-53f41f820865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:04.625174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a42581-a44d-4887-879f-53f41f820865 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:04.650579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1186/2364] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:04 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:04.654792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb3083-8bc5-45f5-b5f3-c9a240cea6b0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:04.666058 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb3083-8bc5-45f5-b5f3-c9a240cea6b0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:04.724538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c5d39-01d1-4c5d-82a2-d91a54a0e24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:04.725168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c5d39-01d1-4c5d-82a2-d91a54a0e24e admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:04.725450 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c5d39-01d1-4c5d-82a2-d91a54a0e24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:04.725748 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c5d39-01d1-4c5d-82a2-d91a54a0e24e admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:04.726386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c5d39-01d1-4c5d-82a2-d91a54a0e24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:04.728288 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c5d39-01d1-4c5d-82a2-d91a54a0e24e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:04.749116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1179/2365] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:04 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:04.753259 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a42581-a44d-4887-879f-53f41f820865 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:04.763454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a42581-a44d-4887-879f-53f41f820865 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:04.768182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc17d62-e66c-47b2-aedb-8fb5f0231399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:04.768781 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc17d62-e66c-47b2-aedb-8fb5f0231399 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:04.769060 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc17d62-e66c-47b2-aedb-8fb5f0231399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:04.769332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc17d62-e66c-47b2-aedb-8fb5f0231399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:04.770023 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc17d62-e66c-47b2-aedb-8fb5f0231399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:04.771602 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc17d62-e66c-47b2-aedb-8fb5f0231399 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:04.782621 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1187/2366] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:04.786456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c5d39-01d1-4c5d-82a2-d91a54a0e24e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:04.796585 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c5d39-01d1-4c5d-82a2-d91a54a0e24e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:04.802052 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30985547-0d53-40cc-8477-02c3d273115c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:04.802593 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30985547-0d53-40cc-8477-02c3d273115c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:04.802868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30985547-0d53-40cc-8477-02c3d273115c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:04.803138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30985547-0d53-40cc-8477-02c3d273115c admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:04.803769 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30985547-0d53-40cc-8477-02c3d273115c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:04.805345 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30985547-0d53-40cc-8477-02c3d273115c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:04.815159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1180/2367] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:04.819079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc17d62-e66c-47b2-aedb-8fb5f0231399 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:04.828980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc17d62-e66c-47b2-aedb-8fb5f0231399 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:04.833729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deeec3f-bdd7-43bf-b05c-e9b584b1b0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:04.834368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deeec3f-bdd7-43bf-b05c-e9b584b1b0a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:04.834646 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deeec3f-bdd7-43bf-b05c-e9b584b1b0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:04.834917 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deeec3f-bdd7-43bf-b05c-e9b584b1b0a8 admin admin] PATH_INFO: `/v3/projects/bbdb9a7d106b4fdeabd98a98fcb602d8/users/ed99bd9579d34b598ccb4995967149bc/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:04.849971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deeec3f-bdd7-43bf-b05c-e9b584b1b0a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbdb9a7d106b4fdeabd98a98fcb602d8, user_id=ed99bd9579d34b598ccb4995967149bc, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:04.852583 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deeec3f-bdd7-43bf-b05c-e9b584b1b0a8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:04.865917 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1188/2368] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:04 2022] PUT /identity/v3/projects/bbdb9a7d106b4fdeabd98a98fcb602d8/users/ed99bd9579d34b598ccb4995967149bc/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:04.876719 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c538f5-b29a-4799-901d-3178bad283b7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:04.877126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c538f5-b29a-4799-901d-3178bad283b7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:04.877466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c538f5-b29a-4799-901d-3178bad283b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:04.907258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-57c538f5-b29a-4799-901d-3178bad283b7 None None] MFA Rules not processed for user `ed99bd9579d34b598ccb4995967149bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:04.908535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-57c538f5-b29a-4799-901d-3178bad283b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:04.982661 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1181/2369] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:04.987432 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deeec3f-bdd7-43bf-b05c-e9b584b1b0a8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:05.057524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deeec3f-bdd7-43bf-b05c-e9b584b1b0a8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:05.062187 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d39c17-fd49-4a77-bf1a-ff0533bcad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:05.062827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d39c17-fd49-4a77-bf1a-ff0533bcad16 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:05.063110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d39c17-fd49-4a77-bf1a-ff0533bcad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:05.063387 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d39c17-fd49-4a77-bf1a-ff0533bcad16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:05.064018 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d39c17-fd49-4a77-bf1a-ff0533bcad16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:05.065912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d39c17-fd49-4a77-bf1a-ff0533bcad16 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:05.093096 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1189/2370] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:04 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:05.098432 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c538f5-b29a-4799-901d-3178bad283b7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:05.105261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:05.110288 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c538f5-b29a-4799-901d-3178bad283b7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:05.175981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb8821-724a-46d0-b5aa-3d1b574ad18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:05.176602 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb8821-724a-46d0-b5aa-3d1b574ad18d admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:05.176882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb8821-724a-46d0-b5aa-3d1b574ad18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:05.177154 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb8821-724a-46d0-b5aa-3d1b574ad18d admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:05.177864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb8821-724a-46d0-b5aa-3d1b574ad18d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:05.180371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb8821-724a-46d0-b5aa-3d1b574ad18d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:05.206210 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1182/2371] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:05 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:05.207944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d39c17-fd49-4a77-bf1a-ff0533bcad16 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:05.215166 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:05.221878 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d39c17-fd49-4a77-bf1a-ff0533bcad16 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:05.229273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54072440-e1d9-42fd-aebc-d229d4c274af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:05.229913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54072440-e1d9-42fd-aebc-d229d4c274af admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:05.230191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54072440-e1d9-42fd-aebc-d229d4c274af admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:05.230461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54072440-e1d9-42fd-aebc-d229d4c274af admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:05.231096 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54072440-e1d9-42fd-aebc-d229d4c274af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:05.232671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54072440-e1d9-42fd-aebc-d229d4c274af admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:05.244322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1190/2372] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:05.248503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb8821-724a-46d0-b5aa-3d1b574ad18d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:05.258923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb8821-724a-46d0-b5aa-3d1b574ad18d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:05.263669 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31620d4-cf70-4422-99ed-689cf32429ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:05.264319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31620d4-cf70-4422-99ed-689cf32429ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:05.264599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31620d4-cf70-4422-99ed-689cf32429ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:05.264871 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31620d4-cf70-4422-99ed-689cf32429ba admin admin] PATH_INFO: `/v3/projects/e5077e9f00af4330a75cf2dd78870790/users/a8e632c491904dcc94607d018a765af2/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:05.280606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31620d4-cf70-4422-99ed-689cf32429ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5077e9f00af4330a75cf2dd78870790, user_id=a8e632c491904dcc94607d018a765af2, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:05.283864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31620d4-cf70-4422-99ed-689cf32429ba admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:05.302384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1183/2373] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:05 2022] PUT /identity/v3/projects/e5077e9f00af4330a75cf2dd78870790/users/a8e632c491904dcc94607d018a765af2/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:05.306956 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54072440-e1d9-42fd-aebc-d229d4c274af admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:05.317263 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54072440-e1d9-42fd-aebc-d229d4c274af admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:05.372674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548258f-1847-4b15-9405-e0776a749cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:05.373272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548258f-1847-4b15-9405-e0776a749cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:05.373546 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548258f-1847-4b15-9405-e0776a749cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:05.373851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548258f-1847-4b15-9405-e0776a749cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:05.374480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548258f-1847-4b15-9405-e0776a749cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:05.376911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548258f-1847-4b15-9405-e0776a749cd0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:05.386773 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1191/2374] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:05.391379 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31620d4-cf70-4422-99ed-689cf32429ba admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:05.401582 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31620d4-cf70-4422-99ed-689cf32429ba admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:05.406554 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67c317-434c-43c5-90da-492e78bf7899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:05.407226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67c317-434c-43c5-90da-492e78bf7899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:05.407475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67c317-434c-43c5-90da-492e78bf7899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:05.407755 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67c317-434c-43c5-90da-492e78bf7899 admin admin] PATH_INFO: `/v3/projects/e5077e9f00af4330a75cf2dd78870790/users/a8e632c491904dcc94607d018a765af2/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:05.409803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67c317-434c-43c5-90da-492e78bf7899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5077e9f00af4330a75cf2dd78870790, user_id=a8e632c491904dcc94607d018a765af2, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:05.412529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67c317-434c-43c5-90da-492e78bf7899 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:05.423726 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1184/2375] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:05 2022] PUT /identity/v3/projects/e5077e9f00af4330a75cf2dd78870790/users/a8e632c491904dcc94607d018a765af2/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:05.435647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c657893-d31a-407e-a6a3-ae0f004957d6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:05.435933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c657893-d31a-407e-a6a3-ae0f004957d6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:05.436205 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c657893-d31a-407e-a6a3-ae0f004957d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:05.464292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-1c657893-d31a-407e-a6a3-ae0f004957d6 None None] MFA Rules not processed for user `a8e632c491904dcc94607d018a765af2`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:05.465488 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1c657893-d31a-407e-a6a3-ae0f004957d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:05.536384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1192/2376] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:05.548702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67c317-434c-43c5-90da-492e78bf7899 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:05.550519 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cd67c317-434c-43c5-90da-492e78bf7899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:05.610298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67c317-434c-43c5-90da-492e78bf7899 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:05.614027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1bd2e-6dc5-483a-8691-8521672264f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:05.614660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1bd2e-6dc5-483a-8691-8521672264f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:05.614935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1bd2e-6dc5-483a-8691-8521672264f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:05.615203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1bd2e-6dc5-483a-8691-8521672264f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:05.672003 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1bd2e-6dc5-483a-8691-8521672264f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:05.674411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1bd2e-6dc5-483a-8691-8521672264f9 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:05.683075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1185/2377] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:05.892192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c657893-d31a-407e-a6a3-ae0f004957d6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:05.894310 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1c657893-d31a-407e-a6a3-ae0f004957d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:05.980079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c657893-d31a-407e-a6a3-ae0f004957d6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:05.984411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17d81a-2816-423f-8b12-161f28773973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:05.985512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17d81a-2816-423f-8b12-161f28773973 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:05.985962 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17d81a-2816-423f-8b12-161f28773973 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:05.986337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17d81a-2816-423f-8b12-161f28773973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:05.988388 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3a17d81a-2816-423f-8b12-161f28773973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:05.999884 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17d81a-2816-423f-8b12-161f28773973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:06.001966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17d81a-2816-423f-8b12-161f28773973 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:06.010953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1193/2378] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:07.197148 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1bd2e-6dc5-483a-8691-8521672264f9 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:07.206552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1bd2e-6dc5-483a-8691-8521672264f9 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:07.210284 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcbbd8-9a5f-4ddd-980f-a361e5cfe5e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:07.210904 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcbbd8-9a5f-4ddd-980f-a361e5cfe5e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:07.211185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcbbd8-9a5f-4ddd-980f-a361e5cfe5e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:07.211461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcbbd8-9a5f-4ddd-980f-a361e5cfe5e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:07.221031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:07.275775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcbbd8-9a5f-4ddd-980f-a361e5cfe5e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:07.277268 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcbbd8-9a5f-4ddd-980f-a361e5cfe5e8 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:07.287277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1186/2379] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:07.529216 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17d81a-2816-423f-8b12-161f28773973 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:07.531533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3a17d81a-2816-423f-8b12-161f28773973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:07.543085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17d81a-2816-423f-8b12-161f28773973 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:07.548375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3c44a-172b-45cf-8273-a9496f1a57b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:07.549238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3c44a-172b-45cf-8273-a9496f1a57b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:07.549516 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3c44a-172b-45cf-8273-a9496f1a57b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:07.549926 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3c44a-172b-45cf-8273-a9496f1a57b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:07.552364 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-88e3c44a-172b-45cf-8273-a9496f1a57b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:07.569373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:07.633530 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3c44a-172b-45cf-8273-a9496f1a57b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:07.635558 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3c44a-172b-45cf-8273-a9496f1a57b5 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:07.648227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1194/2380] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:07.912013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcbbd8-9a5f-4ddd-980f-a361e5cfe5e8 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:07.926174 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcbbd8-9a5f-4ddd-980f-a361e5cfe5e8 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:07.936693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22abbde-123d-4c38-ab2b-e675380d0f0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:07.937405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22abbde-123d-4c38-ab2b-e675380d0f0e service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:07.938548 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22abbde-123d-4c38-ab2b-e675380d0f0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:07.938548 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22abbde-123d-4c38-ab2b-e675380d0f0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:07.949885 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22abbde-123d-4c38-ab2b-e675380d0f0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:07.951940 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22abbde-123d-4c38-ab2b-e675380d0f0e service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:07.962510 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1187/2381] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:10.616511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3c44a-172b-45cf-8273-a9496f1a57b5 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:10.633942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3c44a-172b-45cf-8273-a9496f1a57b5 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:10.637779 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e16236-3fb4-4421-9f61-9251a3f60024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:10.638388 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e16236-3fb4-4421-9f61-9251a3f60024 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:10.638671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e16236-3fb4-4421-9f61-9251a3f60024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:10.639142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e16236-3fb4-4421-9f61-9251a3f60024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:10.641887 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f7e16236-3fb4-4421-9f61-9251a3f60024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:10.654113 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e16236-3fb4-4421-9f61-9251a3f60024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:10.657065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e16236-3fb4-4421-9f61-9251a3f60024 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:10.683537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1195/2382] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:10.862904 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e04e73-5b77-43fe-812c-d3fe9738a504 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:10.864636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e04e73-5b77-43fe-812c-d3fe9738a504 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:10.865278 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e04e73-5b77-43fe-812c-d3fe9738a504 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:10.867494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1188/2383] 10.222.0.57 () {54 vars in 921 bytes} [Tue Sep 27 17:29:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:29:10.873847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe050e3-9a90-40c3-8e6f-c89f526677d8 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:10.874110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe050e3-9a90-40c3-8e6f-c89f526677d8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:10.874634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe050e3-9a90-40c3-8e6f-c89f526677d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:10.916693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-afe050e3-9a90-40c3-8e6f-c89f526677d8 None None] MFA Rules not processed for user `e75b03fde75e411bace8d406237a7e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:10.918083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-afe050e3-9a90-40c3-8e6f-c89f526677d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:11.074479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e04e73-5b77-43fe-812c-d3fe9738a504 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:11.076262 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-69e04e73-5b77-43fe-812c-d3fe9738a504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:11.087948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1196/2384] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Sep 27 17:29:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:11.207448 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e04e73-5b77-43fe-812c-d3fe9738a504 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:11.212287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d8793-6c74-4fa4-8294-63e2dbeda8c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6c4a886aec4dd290b13118e2528fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:11.213031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d8793-6c74-4fa4-8294-63e2dbeda8c4 service glance] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:11.213319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d8793-6c74-4fa4-8294-63e2dbeda8c4 service glance] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:11.213775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d8793-6c74-4fa4-8294-63e2dbeda8c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:11.230093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d8793-6c74-4fa4-8294-63e2dbeda8c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:11.231549 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d8793-6c74-4fa4-8294-63e2dbeda8c4 service glance] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:11.244372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1189/2385] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:11.346458 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bf36e-2d9b-4ef3-9ed3-35832ba762b6 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:11.347137 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bf36e-2d9b-4ef3-9ed3-35832ba762b6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:11.347442 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bf36e-2d9b-4ef3-9ed3-35832ba762b6 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:11.348951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1197/2386] 10.222.0.57 () {54 vars in 921 bytes} [Tue Sep 27 17:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:29:11.355283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cfe2f-e845-45f0-9a8d-43ae9b545386 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:11.355572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cfe2f-e845-45f0-9a8d-43ae9b545386 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:11.355843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cfe2f-e845-45f0-9a8d-43ae9b545386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:11.376889 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ed5cfe2f-e845-45f0-9a8d-43ae9b545386 None None] MFA Rules not processed for user `008cfc0b27d7448b9c84f8087c969e55`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:11.378156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ed5cfe2f-e845-45f0-9a8d-43ae9b545386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:11.385449 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1190/2387] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Sep 27 17:29:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:11.399037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bf36e-2d9b-4ef3-9ed3-35832ba762b6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:11.411083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bf36e-2d9b-4ef3-9ed3-35832ba762b6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:11.424162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042938c7-d441-4689-999e-a25acd4d750c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:11.424784 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042938c7-d441-4689-999e-a25acd4d750c service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:11.425250 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042938c7-d441-4689-999e-a25acd4d750c service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:11.425522 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042938c7-d441-4689-999e-a25acd4d750c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:11.438738 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042938c7-d441-4689-999e-a25acd4d750c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:11.440416 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042938c7-d441-4689-999e-a25acd4d750c service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:11.449991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1198/2388] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:11.546489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204bc03-158a-449f-8be6-c72a755b4f50 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:11.546815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204bc03-158a-449f-8be6-c72a755b4f50 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:11.547120 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204bc03-158a-449f-8be6-c72a755b4f50 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:11.548500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1191/2389] 10.222.0.57 () {54 vars in 921 bytes} [Tue Sep 27 17:29:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 17:29:11.554069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aab88-e73c-4c85-88f3-61954845a82a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:11.554357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aab88-e73c-4c85-88f3-61954845a82a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:11.554630 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aab88-e73c-4c85-88f3-61954845a82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:11.589047 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7a7aab88-e73c-4c85-88f3-61954845a82a None None] MFA Rules not processed for user `e75b03fde75e411bace8d406237a7e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:11.590518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7a7aab88-e73c-4c85-88f3-61954845a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:11.601281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1199/2390] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Sep 27 17:29:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:11.612609 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204bc03-158a-449f-8be6-c72a755b4f50 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:11.623886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204bc03-158a-449f-8be6-c72a755b4f50 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:11.628102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df76f1-2b54-40b6-870b-27b13c0cd135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:11.628700 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df76f1-2b54-40b6-870b-27b13c0cd135 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:11.628977 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df76f1-2b54-40b6-870b-27b13c0cd135 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:11.629390 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df76f1-2b54-40b6-870b-27b13c0cd135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:11.639859 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df76f1-2b54-40b6-870b-27b13c0cd135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:11.641999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df76f1-2b54-40b6-870b-27b13c0cd135 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:11.656452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1192/2391] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:11.657043 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aab88-e73c-4c85-88f3-61954845a82a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:11.658656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7a7aab88-e73c-4c85-88f3-61954845a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:11.725364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df76f1-2b54-40b6-870b-27b13c0cd135 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:11.730345 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a2df76f1-2b54-40b6-870b-27b13c0cd135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:11.747850 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aab88-e73c-4c85-88f3-61954845a82a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:11.752238 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df76f1-2b54-40b6-870b-27b13c0cd135 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:11.754209 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea06ad4-a669-4ad0-b2da-df70bd1238b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cedb97f3c84faeaeef2b3209356842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:11.754887 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea06ad4-a669-4ad0-b2da-df70bd1238b3 service placement] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:11.755233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea06ad4-a669-4ad0-b2da-df70bd1238b3 service placement] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:11.755564 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea06ad4-a669-4ad0-b2da-df70bd1238b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:11.757329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1ea06ad4-a669-4ad0-b2da-df70bd1238b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:11.758217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0125b35-1011-4249-9ef3-fe8c876bef56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cedb97f3c84faeaeef2b3209356842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:11.758814 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0125b35-1011-4249-9ef3-fe8c876bef56 service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:11.759103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0125b35-1011-4249-9ef3-fe8c876bef56 service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:11.759385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0125b35-1011-4249-9ef3-fe8c876bef56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:11.761071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e0125b35-1011-4249-9ef3-fe8c876bef56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:11.769534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea06ad4-a669-4ad0-b2da-df70bd1238b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:11.771203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea06ad4-a669-4ad0-b2da-df70bd1238b3 service placement] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:11.772665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0125b35-1011-4249-9ef3-fe8c876bef56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:11.774261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0125b35-1011-4249-9ef3-fe8c876bef56 service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:11.777026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:11.782908 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1200/2392] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:11.783916 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea06ad4-a669-4ad0-b2da-df70bd1238b3 service placement] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:11.784558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1193/2393] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:11.786006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1ea06ad4-a669-4ad0-b2da-df70bd1238b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:11.805496 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea06ad4-a669-4ad0-b2da-df70bd1238b3 service placement] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:11.810343 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe1f56-cac8-456f-a3eb-8e9b635e9e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:11.811023 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe1f56-cac8-456f-a3eb-8e9b635e9e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:11.811311 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe1f56-cac8-456f-a3eb-8e9b635e9e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:11.811588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe1f56-cac8-456f-a3eb-8e9b635e9e16 admin admin] PATH_INFO: `/v3/users/41d1e8b097a14cba91218e7a9b32f6e0` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:11.813277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe1f56-cac8-456f-a3eb-8e9b635e9e16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d1e8b097a14cba91218e7a9b32f6e0)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:11.815264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe1f56-cac8-456f-a3eb-8e9b635e9e16 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:11.864266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6cfe1f56-cac8-456f-a3eb-8e9b635e9e16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d1e8b097a14cba91218e7a9b32f6e0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:11.864944 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6cfe1f56-cac8-456f-a3eb-8e9b635e9e16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d1e8b097a14cba91218e7a9b32f6e0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:11.872639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6cfe1f56-cac8-456f-a3eb-8e9b635e9e16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d1e8b097a14cba91218e7a9b32f6e0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:11.886310 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6cfe1f56-cac8-456f-a3eb-8e9b635e9e16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d1e8b097a14cba91218e7a9b32f6e0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:11.894261 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6cfe1f56-cac8-456f-a3eb-8e9b635e9e16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d1e8b097a14cba91218e7a9b32f6e0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:11.900583 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1201/2394] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:11 2022] DELETE /identity/v3/users/41d1e8b097a14cba91218e7a9b32f6e0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:12.074424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0125b35-1011-4249-9ef3-fe8c876bef56 service placement] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:12.107607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0125b35-1011-4249-9ef3-fe8c876bef56 service placement] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:12.207785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59227bb-966b-4fba-89ef-37ca9d157d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:12.208614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59227bb-966b-4fba-89ef-37ca9d157d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:12.209092 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59227bb-966b-4fba-89ef-37ca9d157d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:12.209511 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59227bb-966b-4fba-89ef-37ca9d157d15 admin admin] PATH_INFO: `/v3/projects/857d90442c4b4fc8b5b7fdf1f24963de` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:12.211237 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59227bb-966b-4fba-89ef-37ca9d157d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=857d90442c4b4fc8b5b7fdf1f24963de)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:12.214620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59227bb-966b-4fba-89ef-37ca9d157d15 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:12.239232 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:12.336277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe1f56-cac8-456f-a3eb-8e9b635e9e16 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:12.336447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c59227bb-966b-4fba-89ef-37ca9d157d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857d90442c4b4fc8b5b7fdf1f24963de', 'request_id': 'req-c59227bb-966b-4fba-89ef-37ca9d157d15'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:12.338084 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6cfe1f56-cac8-456f-a3eb-8e9b635e9e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:12.346397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c59227bb-966b-4fba-89ef-37ca9d157d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857d90442c4b4fc8b5b7fdf1f24963de', 'request_id': 'req-c59227bb-966b-4fba-89ef-37ca9d157d15'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:12.355684 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c59227bb-966b-4fba-89ef-37ca9d157d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857d90442c4b4fc8b5b7fdf1f24963de', 'request_id': 'req-c59227bb-966b-4fba-89ef-37ca9d157d15'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:12.378201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe1f56-cac8-456f-a3eb-8e9b635e9e16 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:12.398990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c59227bb-966b-4fba-89ef-37ca9d157d15 admin admin] The token cache is being invalidate because project 857d90442c4b4fc8b5b7fdf1f24963de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:12.399605 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c59227bb-966b-4fba-89ef-37ca9d157d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:12.400787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c59227bb-966b-4fba-89ef-37ca9d157d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:12.408361 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1194/2395] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:12 2022] DELETE /identity/v3/projects/857d90442c4b4fc8b5b7fdf1f24963de => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:12.414008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b73f4-9f31-45c5-a6d7-746af4299468 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:12.414317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b73f4-9f31-45c5-a6d7-746af4299468 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:12.414580 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b73f4-9f31-45c5-a6d7-746af4299468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:12.438975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-476b73f4-9f31-45c5-a6d7-746af4299468 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:12.440409 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-476b73f4-9f31-45c5-a6d7-746af4299468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:12.475054 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46820df-fcce-47fd-8c70-212ee8f1dd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:12.475725 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46820df-fcce-47fd-8c70-212ee8f1dd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:12.476006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46820df-fcce-47fd-8c70-212ee8f1dd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:12.476274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46820df-fcce-47fd-8c70-212ee8f1dd5d admin admin] PATH_INFO: `/v3/users/b00a19a9c03e4523b190923771b9d937` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:12.478421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46820df-fcce-47fd-8c70-212ee8f1dd5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00a19a9c03e4523b190923771b9d937)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:12.480447 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46820df-fcce-47fd-8c70-212ee8f1dd5d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:12.532475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1195/2396] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:12.541415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793778-d084-49a5-9ad6-095cfdcccc91 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:12.541966 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793778-d084-49a5-9ad6-095cfdcccc91 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:12.542257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793778-d084-49a5-9ad6-095cfdcccc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:12.547576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b46820df-fcce-47fd-8c70-212ee8f1dd5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00a19a9c03e4523b190923771b9d937'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:12.548243 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b46820df-fcce-47fd-8c70-212ee8f1dd5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00a19a9c03e4523b190923771b9d937'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:12.556091 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b46820df-fcce-47fd-8c70-212ee8f1dd5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00a19a9c03e4523b190923771b9d937'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:12.565406 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6b793778-d084-49a5-9ad6-095cfdcccc91 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:12.566635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6b793778-d084-49a5-9ad6-095cfdcccc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:12.569072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b46820df-fcce-47fd-8c70-212ee8f1dd5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00a19a9c03e4523b190923771b9d937'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:12.571404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:12.575280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1196/2397] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:12.577602 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b46820df-fcce-47fd-8c70-212ee8f1dd5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00a19a9c03e4523b190923771b9d937'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:12.580513 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b793778-d084-49a5-9ad6-095cfdcccc91 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:12.585981 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1202/2398] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:12 2022] DELETE /identity/v3/users/b00a19a9c03e4523b190923771b9d937 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:12.589873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b793778-d084-49a5-9ad6-095cfdcccc91 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:12.590267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c43435-3317-4094-9a69-1a4d6627a575 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:12.590558 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c43435-3317-4094-9a69-1a4d6627a575 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:12.590840 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c43435-3317-4094-9a69-1a4d6627a575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:12.610960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-91c43435-3317-4094-9a69-1a4d6627a575 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:12.612172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-91c43435-3317-4094-9a69-1a4d6627a575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:12.648784 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3b2b9-cfa9-4398-a2ca-aa6f7b9aba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:12.649395 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3b2b9-cfa9-4398-a2ca-aa6f7b9aba91 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:12.649697 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3b2b9-cfa9-4398-a2ca-aa6f7b9aba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:12.649978 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3b2b9-cfa9-4398-a2ca-aa6f7b9aba91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:12.650618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3b2b9-cfa9-4398-a2ca-aa6f7b9aba91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:12.650919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3b2b9-cfa9-4398-a2ca-aa6f7b9aba91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:12.652508 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3b2b9-cfa9-4398-a2ca-aa6f7b9aba91 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:12.664572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1197/2399] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:29:12.668892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3b2b9-cfa9-4398-a2ca-aa6f7b9aba91 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:12.670774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f7a3b2b9-cfa9-4398-a2ca-aa6f7b9aba91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:12.671418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1203/2400] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:12.681993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c43435-3317-4094-9a69-1a4d6627a575 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:12.683306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-91c43435-3317-4094-9a69-1a4d6627a575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:12.683898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3b2b9-cfa9-4398-a2ca-aa6f7b9aba91 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:12.688790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6d87d-46f9-4628-953a-e551a131f830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:12.689389 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6d87d-46f9-4628-953a-e551a131f830 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:12.689666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6d87d-46f9-4628-953a-e551a131f830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:12.689968 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6d87d-46f9-4628-953a-e551a131f830 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:12.690594 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6d87d-46f9-4628-953a-e551a131f830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:12.692476 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6d87d-46f9-4628-953a-e551a131f830 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:12.721001 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1198/2401] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:12 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:12.725151 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6d87d-46f9-4628-953a-e551a131f830 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:12.729621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:12.745648 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c43435-3317-4094-9a69-1a4d6627a575 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:12.794078 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6d87d-46f9-4628-953a-e551a131f830 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:12.798975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77003b64-6aee-4b99-8917-b3fbb42d9b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:12.799585 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77003b64-6aee-4b99-8917-b3fbb42d9b4c admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:12.799866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77003b64-6aee-4b99-8917-b3fbb42d9b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:12.800139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77003b64-6aee-4b99-8917-b3fbb42d9b4c admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:12.800772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77003b64-6aee-4b99-8917-b3fbb42d9b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:12.801169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a2407-e4be-4523-845d-29ec03435d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:12.801811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a2407-e4be-4523-845d-29ec03435d36 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:12.802093 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a2407-e4be-4523-845d-29ec03435d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:12.802367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a2407-e4be-4523-845d-29ec03435d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:12.802733 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77003b64-6aee-4b99-8917-b3fbb42d9b4c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:12.813440 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a2407-e4be-4523-845d-29ec03435d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:12.815644 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a2407-e4be-4523-845d-29ec03435d36 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:12.826548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1204/2402] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:12.829853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1199/2403] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:12 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:12.831118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a2407-e4be-4523-845d-29ec03435d36 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:12.840591 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a2407-e4be-4523-845d-29ec03435d36 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:12.847125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123beabd-cb0b-4fa9-9491-85f4b2b722a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:12.847730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123beabd-cb0b-4fa9-9491-85f4b2b722a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:12.848008 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123beabd-cb0b-4fa9-9491-85f4b2b722a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:12.848279 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123beabd-cb0b-4fa9-9491-85f4b2b722a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:12.848915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123beabd-cb0b-4fa9-9491-85f4b2b722a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:12.850603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123beabd-cb0b-4fa9-9491-85f4b2b722a5 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:12.861473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1205/2404] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:12.865710 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77003b64-6aee-4b99-8917-b3fbb42d9b4c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:12.877392 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77003b64-6aee-4b99-8917-b3fbb42d9b4c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:12.882615 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133aa77-6f10-4557-9459-3b4de4577854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:12.883238 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133aa77-6f10-4557-9459-3b4de4577854 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:12.883524 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133aa77-6f10-4557-9459-3b4de4577854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:12.883800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133aa77-6f10-4557-9459-3b4de4577854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:12.884452 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133aa77-6f10-4557-9459-3b4de4577854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:12.886225 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133aa77-6f10-4557-9459-3b4de4577854 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:12.902116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1200/2405] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:12.903438 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123beabd-cb0b-4fa9-9491-85f4b2b722a5 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:12.917766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123beabd-cb0b-4fa9-9491-85f4b2b722a5 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:12.924149 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f0dc7-f28e-481b-9a65-0426562f17f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:12.925275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f0dc7-f28e-481b-9a65-0426562f17f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:12.925275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f0dc7-f28e-481b-9a65-0426562f17f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:12.925478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f0dc7-f28e-481b-9a65-0426562f17f2 admin admin] PATH_INFO: `/v3/projects/16333e82360448b893993a7af9d8582c/users/2f52998162bb4c5bb238884157b6c101/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:12.942258 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f0dc7-f28e-481b-9a65-0426562f17f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16333e82360448b893993a7af9d8582c, user_id=2f52998162bb4c5bb238884157b6c101, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:12.945709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f0dc7-f28e-481b-9a65-0426562f17f2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:12.961386 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1206/2406] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:12 2022] PUT /identity/v3/projects/16333e82360448b893993a7af9d8582c/users/2f52998162bb4c5bb238884157b6c101/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:12.972092 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319c799-9b8e-48f5-9815-0c6464c98696 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:12.972401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319c799-9b8e-48f5-9815-0c6464c98696 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:12.972661 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319c799-9b8e-48f5-9815-0c6464c98696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:13.013055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b319c799-9b8e-48f5-9815-0c6464c98696 None None] MFA Rules not processed for user `2f52998162bb4c5bb238884157b6c101`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:13.014327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b319c799-9b8e-48f5-9815-0c6464c98696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:13.097629 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1201/2407] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:13.102096 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f0dc7-f28e-481b-9a65-0426562f17f2 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:13.120872 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:13.136439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319c799-9b8e-48f5-9815-0c6464c98696 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:13.137911 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b319c799-9b8e-48f5-9815-0c6464c98696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:13.186835 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f0dc7-f28e-481b-9a65-0426562f17f2 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:13.190870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a45df-3ab0-4fdd-a2f3-24a9a8d71179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:13.191488 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a45df-3ab0-4fdd-a2f3-24a9a8d71179 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:13.191765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a45df-3ab0-4fdd-a2f3-24a9a8d71179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:13.192033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a45df-3ab0-4fdd-a2f3-24a9a8d71179 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:13.192661 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a45df-3ab0-4fdd-a2f3-24a9a8d71179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:13.194573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a45df-3ab0-4fdd-a2f3-24a9a8d71179 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:13.216278 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319c799-9b8e-48f5-9815-0c6464c98696 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:13.221864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a96b6-b312-4c96-9188-e2285cdd3376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:13.222502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a96b6-b312-4c96-9188-e2285cdd3376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:13.222781 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a96b6-b312-4c96-9188-e2285cdd3376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:13.223072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a96b6-b312-4c96-9188-e2285cdd3376 admin admin] PATH_INFO: `/v3/projects/dbbfc6fbafc149caacdfdc01a92735a1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:13.224277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a96b6-b312-4c96-9188-e2285cdd3376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbbfc6fbafc149caacdfdc01a92735a1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:13.228660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1207/2408] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:13 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:13.228827 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a96b6-b312-4c96-9188-e2285cdd3376 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:13.229666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a45df-3ab0-4fdd-a2f3-24a9a8d71179 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:13.239297 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:13.280186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6d6a96b6-b312-4c96-9188-e2285cdd3376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbbfc6fbafc149caacdfdc01a92735a1', 'request_id': 'req-6d6a96b6-b312-4c96-9188-e2285cdd3376'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:13.287277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6d6a96b6-b312-4c96-9188-e2285cdd3376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbbfc6fbafc149caacdfdc01a92735a1', 'request_id': 'req-6d6a96b6-b312-4c96-9188-e2285cdd3376'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:13.294095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6d6a96b6-b312-4c96-9188-e2285cdd3376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbbfc6fbafc149caacdfdc01a92735a1', 'request_id': 'req-6d6a96b6-b312-4c96-9188-e2285cdd3376'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:13.302409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a45df-3ab0-4fdd-a2f3-24a9a8d71179 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:13.309667 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6d6a96b6-b312-4c96-9188-e2285cdd3376 admin admin] The token cache is being invalidate because project dbbfc6fbafc149caacdfdc01a92735a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:13.309999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6d6a96b6-b312-4c96-9188-e2285cdd3376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:13.310642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6d6a96b6-b312-4c96-9188-e2285cdd3376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:13.313126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1202/2409] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:13 2022] DELETE /identity/v3/projects/dbbfc6fbafc149caacdfdc01a92735a1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:13.316885 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a96b6-b312-4c96-9188-e2285cdd3376 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:13.318455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6d6a96b6-b312-4c96-9188-e2285cdd3376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:13.372006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769637b-c3bc-4959-aba5-c0719d89ea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:13.373332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769637b-c3bc-4959-aba5-c0719d89ea14 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:13.373616 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769637b-c3bc-4959-aba5-c0719d89ea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:13.373918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769637b-c3bc-4959-aba5-c0719d89ea14 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:13.374550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769637b-c3bc-4959-aba5-c0719d89ea14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:13.377789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769637b-c3bc-4959-aba5-c0719d89ea14 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:13.398550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a96b6-b312-4c96-9188-e2285cdd3376 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:13.403290 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5ee32-a1f3-4c4f-bbc2-dbaff8bd9134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:13.403933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5ee32-a1f3-4c4f-bbc2-dbaff8bd9134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:13.404288 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5ee32-a1f3-4c4f-bbc2-dbaff8bd9134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:13.404565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5ee32-a1f3-4c4f-bbc2-dbaff8bd9134 admin admin] PATH_INFO: `/v3/users/ed99bd9579d34b598ccb4995967149bc` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:13.405865 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1208/2410] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:13 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:13.405982 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5ee32-a1f3-4c4f-bbc2-dbaff8bd9134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed99bd9579d34b598ccb4995967149bc)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:13.407722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769637b-c3bc-4959-aba5-c0719d89ea14 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:13.409538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d769637b-c3bc-4959-aba5-c0719d89ea14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:13.411511 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5ee32-a1f3-4c4f-bbc2-dbaff8bd9134 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:13.447587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769637b-c3bc-4959-aba5-c0719d89ea14 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:13.459519 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5011692-ee11-4961-b362-07d30ff461a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:13.460774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5011692-ee11-4961-b362-07d30ff461a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:13.461464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5011692-ee11-4961-b362-07d30ff461a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:13.461653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5011692-ee11-4961-b362-07d30ff461a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:13.462487 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5011692-ee11-4961-b362-07d30ff461a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:13.464626 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5011692-ee11-4961-b362-07d30ff461a5 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:13.484954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1209/2411] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:13.484954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5011692-ee11-4961-b362-07d30ff461a5 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:13.493809 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-62c5ee32-a1f3-4c4f-bbc2-dbaff8bd9134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed99bd9579d34b598ccb4995967149bc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:13.496345 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5011692-ee11-4961-b362-07d30ff461a5 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:13.502858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d672bae-ca73-4273-a9ae-741daa04dff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:13.503546 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d672bae-ca73-4273-a9ae-741daa04dff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:13.503685 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-62c5ee32-a1f3-4c4f-bbc2-dbaff8bd9134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed99bd9579d34b598ccb4995967149bc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:13.503967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d672bae-ca73-4273-a9ae-741daa04dff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:13.504280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d672bae-ca73-4273-a9ae-741daa04dff3 admin admin] PATH_INFO: `/v3/projects/227c040c8dcd4ee39df5fc5b505654b1/users/1390ea083f0f4d999b1f5895fac71399/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:13.530016 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-62c5ee32-a1f3-4c4f-bbc2-dbaff8bd9134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed99bd9579d34b598ccb4995967149bc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:13.537348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d672bae-ca73-4273-a9ae-741daa04dff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227c040c8dcd4ee39df5fc5b505654b1, user_id=1390ea083f0f4d999b1f5895fac71399, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:13.541390 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d672bae-ca73-4273-a9ae-741daa04dff3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:13.544835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-62c5ee32-a1f3-4c4f-bbc2-dbaff8bd9134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed99bd9579d34b598ccb4995967149bc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:13.545776 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-62c5ee32-a1f3-4c4f-bbc2-dbaff8bd9134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed99bd9579d34b598ccb4995967149bc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:13.557758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1203/2412] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:13 2022] DELETE /identity/v3/users/ed99bd9579d34b598ccb4995967149bc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:13.559334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5ee32-a1f3-4c4f-bbc2-dbaff8bd9134 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:13.560928 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-62c5ee32-a1f3-4c4f-bbc2-dbaff8bd9134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:13.567476 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1210/2413] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:13 2022] PUT /identity/v3/projects/227c040c8dcd4ee39df5fc5b505654b1/users/1390ea083f0f4d999b1f5895fac71399/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:13.571236 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d672bae-ca73-4273-a9ae-741daa04dff3 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:13.573109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2d672bae-ca73-4273-a9ae-741daa04dff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:13.585979 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:13.591885 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:13.654128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5ee32-a1f3-4c4f-bbc2-dbaff8bd9134 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:13.660203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bfcb2-c592-48f2-a666-4cce2ed72bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:13.660898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bfcb2-c592-48f2-a666-4cce2ed72bed service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:13.661441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bfcb2-c592-48f2-a666-4cce2ed72bed service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:13.661556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bfcb2-c592-48f2-a666-4cce2ed72bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:13.663828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-de9bfcb2-c592-48f2-a666-4cce2ed72bed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:13.699134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d672bae-ca73-4273-a9ae-741daa04dff3 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:13.771339 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bfcb2-c592-48f2-a666-4cce2ed72bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:13.772998 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bfcb2-c592-48f2-a666-4cce2ed72bed service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:13.775276 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af79171-da0f-4197-b88e-33f76f192c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:13.775892 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af79171-da0f-4197-b88e-33f76f192c3a admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:13.776175 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af79171-da0f-4197-b88e-33f76f192c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:13.776449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af79171-da0f-4197-b88e-33f76f192c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:13.777087 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af79171-da0f-4197-b88e-33f76f192c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:13.778879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af79171-da0f-4197-b88e-33f76f192c3a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:13.785360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1204/2414] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:13.786818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05fa65-eaf7-4705-b3ef-86c5c0827027 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:13.787252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05fa65-eaf7-4705-b3ef-86c5c0827027 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:13.787720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05fa65-eaf7-4705-b3ef-86c5c0827027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:13.793491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1211/2415] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:13.794537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af79171-da0f-4197-b88e-33f76f192c3a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:13.807251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af79171-da0f-4197-b88e-33f76f192c3a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:13.812240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65121b6-25a4-40de-b885-f3a09c41d945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:13.812915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65121b6-25a4-40de-b885-f3a09c41d945 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:13.813204 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65121b6-25a4-40de-b885-f3a09c41d945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:13.813474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65121b6-25a4-40de-b885-f3a09c41d945 admin admin] PATH_INFO: `/v3/projects/227c040c8dcd4ee39df5fc5b505654b1/users/1390ea083f0f4d999b1f5895fac71399/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:13.815455 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65121b6-25a4-40de-b885-f3a09c41d945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227c040c8dcd4ee39df5fc5b505654b1, user_id=1390ea083f0f4d999b1f5895fac71399, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:13.818104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65121b6-25a4-40de-b885-f3a09c41d945 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:13.819399 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9b05fa65-eaf7-4705-b3ef-86c5c0827027 None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:13.821512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9b05fa65-eaf7-4705-b3ef-86c5c0827027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:13.828876 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1212/2416] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:13 2022] PUT /identity/v3/projects/227c040c8dcd4ee39df5fc5b505654b1/users/1390ea083f0f4d999b1f5895fac71399/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:13.841131 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df364a44-2cb8-4e99-be58-8087f769b603 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:13.841413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df364a44-2cb8-4e99-be58-8087f769b603 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:13.841722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df364a44-2cb8-4e99-be58-8087f769b603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:13.874952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-df364a44-2cb8-4e99-be58-8087f769b603 None None] MFA Rules not processed for user `1390ea083f0f4d999b1f5895fac71399`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:13.876315 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-df364a44-2cb8-4e99-be58-8087f769b603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:13.908807 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1205/2417] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Sep 27 17:29:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:13.924234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05fa65-eaf7-4705-b3ef-86c5c0827027 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:13.925847 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9b05fa65-eaf7-4705-b3ef-86c5c0827027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:13.961523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1213/2418] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:13.975306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df364a44-2cb8-4e99-be58-8087f769b603 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:13.976730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-df364a44-2cb8-4e99-be58-8087f769b603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:14.004213 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:14.021410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05fa65-eaf7-4705-b3ef-86c5c0827027 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:14.026600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31af7c-8e41-42e7-be97-b2de4c87ab5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:14.027575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31af7c-8e41-42e7-be97-b2de4c87ab5d service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:14.027575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31af7c-8e41-42e7-be97-b2de4c87ab5d service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:14.027788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31af7c-8e41-42e7-be97-b2de4c87ab5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:14.037874 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31af7c-8e41-42e7-be97-b2de4c87ab5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:14.039525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31af7c-8e41-42e7-be97-b2de4c87ab5d service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:14.050478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1206/2419] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:29:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 27 17:29:14.051418 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31af7c-8e41-42e7-be97-b2de4c87ab5d service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:14.052820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6e31af7c-8e41-42e7-be97-b2de4c87ab5d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:14.061639 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:14.084483 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df364a44-2cb8-4e99-be58-8087f769b603 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:14.106309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e9286-5f1b-4ddc-8886-ba156829dae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:14.108044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e9286-5f1b-4ddc-8886-ba156829dae6 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:14.108044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e9286-5f1b-4ddc-8886-ba156829dae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:14.108509 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e9286-5f1b-4ddc-8886-ba156829dae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:14.142791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e9286-5f1b-4ddc-8886-ba156829dae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:14.145847 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e9286-5f1b-4ddc-8886-ba156829dae6 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:14.167435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1214/2420] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:14.168939 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31af7c-8e41-42e7-be97-b2de4c87ab5d service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:14.182737 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421af2a8-b889-4af1-940e-07f31c1f899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:14.183477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421af2a8-b889-4af1-940e-07f31c1f899d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:14.183832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421af2a8-b889-4af1-940e-07f31c1f899d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:14.184195 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421af2a8-b889-4af1-940e-07f31c1f899d admin admin] PATH_INFO: `/v3/projects/bbdb9a7d106b4fdeabd98a98fcb602d8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:14.186458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421af2a8-b889-4af1-940e-07f31c1f899d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbdb9a7d106b4fdeabd98a98fcb602d8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:14.188943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421af2a8-b889-4af1-940e-07f31c1f899d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:14.344627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-421af2a8-b889-4af1-940e-07f31c1f899d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbdb9a7d106b4fdeabd98a98fcb602d8', 'request_id': 'req-421af2a8-b889-4af1-940e-07f31c1f899d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:14.358579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-421af2a8-b889-4af1-940e-07f31c1f899d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbdb9a7d106b4fdeabd98a98fcb602d8', 'request_id': 'req-421af2a8-b889-4af1-940e-07f31c1f899d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:14.364662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e9286-5f1b-4ddc-8886-ba156829dae6 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:14.370880 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-421af2a8-b889-4af1-940e-07f31c1f899d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbdb9a7d106b4fdeabd98a98fcb602d8', 'request_id': 'req-421af2a8-b889-4af1-940e-07f31c1f899d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:14.379099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e9286-5f1b-4ddc-8886-ba156829dae6 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:14.396698 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-421af2a8-b889-4af1-940e-07f31c1f899d admin admin] The token cache is being invalidate because project bbdb9a7d106b4fdeabd98a98fcb602d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:14.397170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-421af2a8-b889-4af1-940e-07f31c1f899d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:14.399198 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-421af2a8-b889-4af1-940e-07f31c1f899d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:14.407536 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1207/2421] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:14 2022] DELETE /identity/v3/projects/bbdb9a7d106b4fdeabd98a98fcb602d8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:14.409521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421af2a8-b889-4af1-940e-07f31c1f899d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:14.411192 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-421af2a8-b889-4af1-940e-07f31c1f899d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:14.512905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421af2a8-b889-4af1-940e-07f31c1f899d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:14.533250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76ef94-6836-496c-bf77-23ac14dcb112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:14.535697 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76ef94-6836-496c-bf77-23ac14dcb112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:14.537147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76ef94-6836-496c-bf77-23ac14dcb112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:14.537637 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76ef94-6836-496c-bf77-23ac14dcb112 admin admin] PATH_INFO: `/v3/users/a8e632c491904dcc94607d018a765af2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:14.540713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76ef94-6836-496c-bf77-23ac14dcb112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e632c491904dcc94607d018a765af2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:14.545373 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76ef94-6836-496c-bf77-23ac14dcb112 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:14.546633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a4550-c487-4c97-9d8d-cd6144b19484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:14.548421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a4550-c487-4c97-9d8d-cd6144b19484 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:14.548960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a4550-c487-4c97-9d8d-cd6144b19484 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:14.550514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a4550-c487-4c97-9d8d-cd6144b19484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:14.555179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d72a4550-c487-4c97-9d8d-cd6144b19484 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:14.637147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:14.660089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2f76ef94-6836-496c-bf77-23ac14dcb112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e632c491904dcc94607d018a765af2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:14.681342 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2f76ef94-6836-496c-bf77-23ac14dcb112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e632c491904dcc94607d018a765af2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:14.695810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a4550-c487-4c97-9d8d-cd6144b19484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:14.699174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a4550-c487-4c97-9d8d-cd6144b19484 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:14.704988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2f76ef94-6836-496c-bf77-23ac14dcb112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e632c491904dcc94607d018a765af2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:14.713905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2f76ef94-6836-496c-bf77-23ac14dcb112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e632c491904dcc94607d018a765af2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:14.714774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2f76ef94-6836-496c-bf77-23ac14dcb112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e632c491904dcc94607d018a765af2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:14.721979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1208/2422] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:14 2022] DELETE /identity/v3/users/a8e632c491904dcc94607d018a765af2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:14.731562 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1215/2423] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:15.383767 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76ef94-6836-496c-bf77-23ac14dcb112 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:15.385328 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2f76ef94-6836-496c-bf77-23ac14dcb112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:15.560181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76ef94-6836-496c-bf77-23ac14dcb112 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:15.569887 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158755af-d5ae-4c86-b992-6f18f6d1a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:15.570637 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158755af-d5ae-4c86-b992-6f18f6d1a487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:15.571007 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158755af-d5ae-4c86-b992-6f18f6d1a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:15.571352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158755af-d5ae-4c86-b992-6f18f6d1a487 admin admin] PATH_INFO: `/v3/projects/e5077e9f00af4330a75cf2dd78870790` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:15.575468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158755af-d5ae-4c86-b992-6f18f6d1a487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5077e9f00af4330a75cf2dd78870790)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:15.579620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158755af-d5ae-4c86-b992-6f18f6d1a487 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:15.662589 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-158755af-d5ae-4c86-b992-6f18f6d1a487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5077e9f00af4330a75cf2dd78870790', 'request_id': 'req-158755af-d5ae-4c86-b992-6f18f6d1a487'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:15.672089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-158755af-d5ae-4c86-b992-6f18f6d1a487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5077e9f00af4330a75cf2dd78870790', 'request_id': 'req-158755af-d5ae-4c86-b992-6f18f6d1a487'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:15.679819 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-158755af-d5ae-4c86-b992-6f18f6d1a487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5077e9f00af4330a75cf2dd78870790', 'request_id': 'req-158755af-d5ae-4c86-b992-6f18f6d1a487'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:15.699036 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-158755af-d5ae-4c86-b992-6f18f6d1a487 admin admin] The token cache is being invalidate because project e5077e9f00af4330a75cf2dd78870790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:15.699283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-158755af-d5ae-4c86-b992-6f18f6d1a487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:15.700201 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-158755af-d5ae-4c86-b992-6f18f6d1a487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:15.703692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1209/2424] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:15 2022] DELETE /identity/v3/projects/e5077e9f00af4330a75cf2dd78870790 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:15.709513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67418ca0-dac5-44e7-9170-90839ce3d317 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:15.710382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67418ca0-dac5-44e7-9170-90839ce3d317 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:15.710894 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67418ca0-dac5-44e7-9170-90839ce3d317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:15.751880 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-67418ca0-dac5-44e7-9170-90839ce3d317 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:15.754923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-67418ca0-dac5-44e7-9170-90839ce3d317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:15.861853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1216/2425] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:15.950343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87b50a-91ac-4e1c-bb2d-d575f350bdf0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:15.950701 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87b50a-91ac-4e1c-bb2d-d575f350bdf0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:15.951070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87b50a-91ac-4e1c-bb2d-d575f350bdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:16.003521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9c87b50a-91ac-4e1c-bb2d-d575f350bdf0 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:16.005374 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9c87b50a-91ac-4e1c-bb2d-d575f350bdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:16.020498 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1210/2426] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:16.029031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67418ca0-dac5-44e7-9170-90839ce3d317 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:16.054300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67418ca0-dac5-44e7-9170-90839ce3d317 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:16.073538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d546c-9759-4e66-8e77-1f25d7813f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:16.077014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d546c-9759-4e66-8e77-1f25d7813f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:16.077514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d546c-9759-4e66-8e77-1f25d7813f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:16.079131 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d546c-9759-4e66-8e77-1f25d7813f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:16.080195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d546c-9759-4e66-8e77-1f25d7813f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:16.080694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d546c-9759-4e66-8e77-1f25d7813f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:16.082915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d546c-9759-4e66-8e77-1f25d7813f46 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:16.100391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1217/2427] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:29:16.105497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87b50a-91ac-4e1c-bb2d-d575f350bdf0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:16.117353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87b50a-91ac-4e1c-bb2d-d575f350bdf0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:16.143719 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa29d8-c0c3-4130-80cb-d4ea43c89415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:16.145460 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa29d8-c0c3-4130-80cb-d4ea43c89415 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:16.146174 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa29d8-c0c3-4130-80cb-d4ea43c89415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:16.146765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa29d8-c0c3-4130-80cb-d4ea43c89415 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:16.147791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa29d8-c0c3-4130-80cb-d4ea43c89415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:16.150759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa29d8-c0c3-4130-80cb-d4ea43c89415 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:16.208181 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d546c-9759-4e66-8e77-1f25d7813f46 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:16.213895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:16.216629 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1211/2428] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:16 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:16.222764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d546c-9759-4e66-8e77-1f25d7813f46 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:16.357001 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74715a4f-2a37-40e3-98eb-8d8802e80a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:16.357796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74715a4f-2a37-40e3-98eb-8d8802e80a2b admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:16.358174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74715a4f-2a37-40e3-98eb-8d8802e80a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:16.358546 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74715a4f-2a37-40e3-98eb-8d8802e80a2b admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:16.359927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74715a4f-2a37-40e3-98eb-8d8802e80a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:16.362139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74715a4f-2a37-40e3-98eb-8d8802e80a2b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:16.463490 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa29d8-c0c3-4130-80cb-d4ea43c89415 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:16.475311 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1218/2429] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:16 2022] POST /identity/v3/users => generated 292 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:16.489555 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa29d8-c0c3-4130-80cb-d4ea43c89415 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:16.508938 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd2caa-d44c-476c-b501-5a4cbb5257d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:16.510401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd2caa-d44c-476c-b501-5a4cbb5257d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:16.511426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd2caa-d44c-476c-b501-5a4cbb5257d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:16.513197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd2caa-d44c-476c-b501-5a4cbb5257d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:16.514817 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd2caa-d44c-476c-b501-5a4cbb5257d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:16.519526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd2caa-d44c-476c-b501-5a4cbb5257d8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:16.564990 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74715a4f-2a37-40e3-98eb-8d8802e80a2b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:16.566105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1212/2430] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:16.589197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74715a4f-2a37-40e3-98eb-8d8802e80a2b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:16.600501 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929f480-331a-4163-a93c-4a4c666e53bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:16.601194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929f480-331a-4163-a93c-4a4c666e53bb admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:16.601465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929f480-331a-4163-a93c-4a4c666e53bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:16.604050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929f480-331a-4163-a93c-4a4c666e53bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:16.607117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929f480-331a-4163-a93c-4a4c666e53bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:16.611104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929f480-331a-4163-a93c-4a4c666e53bb admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:16.645329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd2caa-d44c-476c-b501-5a4cbb5257d8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:16.657263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:16.661085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1219/2431] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:16.671127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd2caa-d44c-476c-b501-5a4cbb5257d8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:16.686735 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e4427-acb0-47e5-b52e-04e37056d534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:16.688162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4427-acb0-47e5-b52e-04e37056d534 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:16.688608 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4427-acb0-47e5-b52e-04e37056d534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:16.689333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4427-acb0-47e5-b52e-04e37056d534 admin admin] PATH_INFO: `/v3/projects/e0c117c8ff164913843251dc745c966f/users/7117d04336084ae4a877df67895c6bb2/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:16.730313 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e4427-acb0-47e5-b52e-04e37056d534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c117c8ff164913843251dc745c966f, user_id=7117d04336084ae4a877df67895c6bb2, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:16.735664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e4427-acb0-47e5-b52e-04e37056d534 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:16.768740 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1213/2432] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:16 2022] PUT /identity/v3/projects/e0c117c8ff164913843251dc745c966f/users/7117d04336084ae4a877df67895c6bb2/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:16.777962 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8dd26-17ea-4aa4-b31b-0d5c06b3df24 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:16.778551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8dd26-17ea-4aa4-b31b-0d5c06b3df24 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:16.778551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8dd26-17ea-4aa4-b31b-0d5c06b3df24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:16.830171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e4f8dd26-17ea-4aa4-b31b-0d5c06b3df24 None None] MFA Rules not processed for user `7117d04336084ae4a877df67895c6bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:16.831472 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e4f8dd26-17ea-4aa4-b31b-0d5c06b3df24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:16.967489 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1220/2433] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:16.972904 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e4427-acb0-47e5-b52e-04e37056d534 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:17.140041 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e4427-acb0-47e5-b52e-04e37056d534 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:17.150676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a942cc-0b94-4649-ae60-15b2a2ee2581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:17.151301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a942cc-0b94-4649-ae60-15b2a2ee2581 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:17.151580 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a942cc-0b94-4649-ae60-15b2a2ee2581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:17.151849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a942cc-0b94-4649-ae60-15b2a2ee2581 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:17.152494 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a942cc-0b94-4649-ae60-15b2a2ee2581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:17.154436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a942cc-0b94-4649-ae60-15b2a2ee2581 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:17.215538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1214/2434] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:16 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:17.220429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8dd26-17ea-4aa4-b31b-0d5c06b3df24 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:17.242796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8dd26-17ea-4aa4-b31b-0d5c06b3df24 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:17.387263 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e89a59-9126-4b6c-a467-32f83facdd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:17.391155 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e89a59-9126-4b6c-a467-32f83facdd05 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:17.394011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e89a59-9126-4b6c-a467-32f83facdd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:17.394882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e89a59-9126-4b6c-a467-32f83facdd05 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:17.397478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e89a59-9126-4b6c-a467-32f83facdd05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:17.405464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e89a59-9126-4b6c-a467-32f83facdd05 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:17.452054 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:17.464131 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1221/2435] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:17 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:17.465387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a942cc-0b94-4649-ae60-15b2a2ee2581 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:17.482742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a942cc-0b94-4649-ae60-15b2a2ee2581 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:17.498782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf34864-1be4-4067-888c-7e89b6ee30a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:17.500105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf34864-1be4-4067-888c-7e89b6ee30a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:17.500830 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf34864-1be4-4067-888c-7e89b6ee30a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:17.501272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf34864-1be4-4067-888c-7e89b6ee30a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:17.501862 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf34864-1be4-4067-888c-7e89b6ee30a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:17.503879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf34864-1be4-4067-888c-7e89b6ee30a5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:17.525287 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1215/2436] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:17.526776 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e89a59-9126-4b6c-a467-32f83facdd05 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:17.547312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e89a59-9126-4b6c-a467-32f83facdd05 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:17.554216 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b2b8c-9d46-4a2d-9b35-0872478f874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:17.556826 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b2b8c-9d46-4a2d-9b35-0872478f874e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:17.557462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b2b8c-9d46-4a2d-9b35-0872478f874e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:17.563927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b2b8c-9d46-4a2d-9b35-0872478f874e admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:17.564946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b2b8c-9d46-4a2d-9b35-0872478f874e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:17.567896 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b2b8c-9d46-4a2d-9b35-0872478f874e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:17.590664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1222/2437] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:17.592184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf34864-1be4-4067-888c-7e89b6ee30a5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:17.605531 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf34864-1be4-4067-888c-7e89b6ee30a5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:17.612291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb30f64-2a6e-461d-980a-56a98848d21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:17.613306 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb30f64-2a6e-461d-980a-56a98848d21e admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:17.613855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb30f64-2a6e-461d-980a-56a98848d21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:17.614360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb30f64-2a6e-461d-980a-56a98848d21e admin admin] PATH_INFO: `/v3/projects/37a89551e17d49adb686ca0d61340094/users/7a2c233d9463407a927e8e25c2b21a30/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:17.645619 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb30f64-2a6e-461d-980a-56a98848d21e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a89551e17d49adb686ca0d61340094, user_id=7a2c233d9463407a927e8e25c2b21a30, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:17.649711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb30f64-2a6e-461d-980a-56a98848d21e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:17.691217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1216/2438] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:17 2022] PUT /identity/v3/projects/37a89551e17d49adb686ca0d61340094/users/7a2c233d9463407a927e8e25c2b21a30/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:17.692789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97573562-292c-4976-a7fb-15ac016febc3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:17.693960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97573562-292c-4976-a7fb-15ac016febc3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:17.694454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97573562-292c-4976-a7fb-15ac016febc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:17.749199 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-97573562-292c-4976-a7fb-15ac016febc3 None None] MFA Rules not processed for user `7a2c233d9463407a927e8e25c2b21a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:17.751914 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-97573562-292c-4976-a7fb-15ac016febc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:17.888394 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1223/2439] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:17.893847 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb30f64-2a6e-461d-980a-56a98848d21e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:18.029888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb30f64-2a6e-461d-980a-56a98848d21e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:18.038858 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23065445-1e98-40aa-8843-4c1a874d7131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:18.039492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23065445-1e98-40aa-8843-4c1a874d7131 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:18.039783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23065445-1e98-40aa-8843-4c1a874d7131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:18.040113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23065445-1e98-40aa-8843-4c1a874d7131 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:18.041201 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23065445-1e98-40aa-8843-4c1a874d7131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:18.042921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23065445-1e98-40aa-8843-4c1a874d7131 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:18.120317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97573562-292c-4976-a7fb-15ac016febc3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:18.122204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1217/2440] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:17 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:18.178791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97573562-292c-4976-a7fb-15ac016febc3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:18.362752 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1af5ee-8ab2-4ac5-aed3-3efd7b176286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:18.363397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1af5ee-8ab2-4ac5-aed3-3efd7b176286 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:18.363678 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1af5ee-8ab2-4ac5-aed3-3efd7b176286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:18.363951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1af5ee-8ab2-4ac5-aed3-3efd7b176286 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:18.364587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1af5ee-8ab2-4ac5-aed3-3efd7b176286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:18.385447 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1af5ee-8ab2-4ac5-aed3-3efd7b176286 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:18.418850 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1224/2441] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:18 2022] POST /identity/v3/users => generated 299 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:18.423618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23065445-1e98-40aa-8843-4c1a874d7131 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:18.435812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23065445-1e98-40aa-8843-4c1a874d7131 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:18.441880 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9c762-dc45-46ea-8878-c92c3790da55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:18.442938 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9c762-dc45-46ea-8878-c92c3790da55 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:18.443295 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9c762-dc45-46ea-8878-c92c3790da55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:18.443653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9c762-dc45-46ea-8878-c92c3790da55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:18.444352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9c762-dc45-46ea-8878-c92c3790da55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:18.446868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9c762-dc45-46ea-8878-c92c3790da55 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:18.467628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1218/2442] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:18.469851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1af5ee-8ab2-4ac5-aed3-3efd7b176286 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:18.486563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1af5ee-8ab2-4ac5-aed3-3efd7b176286 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:18.505187 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ca32d-b621-4784-a9f7-a9cfe646bce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:18.505896 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ca32d-b621-4784-a9f7-a9cfe646bce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:18.506172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ca32d-b621-4784-a9f7-a9cfe646bce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:18.506446 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ca32d-b621-4784-a9f7-a9cfe646bce5 admin admin] PATH_INFO: `/v3/projects/38b2a13d094e4957aac9f9aba52c2d2d/users/8609b763361f4e7cb77fc7d84706c64f/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:18.538818 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ca32d-b621-4784-a9f7-a9cfe646bce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b2a13d094e4957aac9f9aba52c2d2d, user_id=8609b763361f4e7cb77fc7d84706c64f, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:18.543271 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ca32d-b621-4784-a9f7-a9cfe646bce5 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:18.576050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9c762-dc45-46ea-8878-c92c3790da55 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:18.584343 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1225/2443] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:18 2022] PUT /identity/v3/projects/38b2a13d094e4957aac9f9aba52c2d2d/users/8609b763361f4e7cb77fc7d84706c64f/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:18.584941 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:18.589275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9c762-dc45-46ea-8878-c92c3790da55 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:18.721944 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844dc2b-8d63-4e0b-86fc-bdb679dd4b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:18.722754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844dc2b-8d63-4e0b-86fc-bdb679dd4b21 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:18.723038 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844dc2b-8d63-4e0b-86fc-bdb679dd4b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:18.723313 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844dc2b-8d63-4e0b-86fc-bdb679dd4b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:18.723961 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844dc2b-8d63-4e0b-86fc-bdb679dd4b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:18.725567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844dc2b-8d63-4e0b-86fc-bdb679dd4b21 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:18.738129 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1219/2444] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:18.741727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ca32d-b621-4784-a9f7-a9cfe646bce5 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:18.756176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ca32d-b621-4784-a9f7-a9cfe646bce5 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:18.764266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db60886-d7b1-41ee-8469-26b81e99cae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:18.765910 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db60886-d7b1-41ee-8469-26b81e99cae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:18.766668 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db60886-d7b1-41ee-8469-26b81e99cae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:18.767350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db60886-d7b1-41ee-8469-26b81e99cae1 admin admin] PATH_INFO: `/v3/projects/38b2a13d094e4957aac9f9aba52c2d2d/users/8609b763361f4e7cb77fc7d84706c64f/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:18.777788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db60886-d7b1-41ee-8469-26b81e99cae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b2a13d094e4957aac9f9aba52c2d2d, user_id=8609b763361f4e7cb77fc7d84706c64f, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:18.785364 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db60886-d7b1-41ee-8469-26b81e99cae1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:18.807744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1226/2445] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:18 2022] PUT /identity/v3/projects/38b2a13d094e4957aac9f9aba52c2d2d/users/8609b763361f4e7cb77fc7d84706c64f/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:18.820441 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cb5ec-42b6-49b4-93c7-885336a9c7d4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:18.820764 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cb5ec-42b6-49b4-93c7-885336a9c7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:18.821631 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cb5ec-42b6-49b4-93c7-885336a9c7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:18.867049 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7b6cb5ec-42b6-49b4-93c7-885336a9c7d4 None None] MFA Rules not processed for user `8609b763361f4e7cb77fc7d84706c64f`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:18.869028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7b6cb5ec-42b6-49b4-93c7-885336a9c7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:19.111356 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1220/2446] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:19.115221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db60886-d7b1-41ee-8469-26b81e99cae1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:19.117822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0db60886-d7b1-41ee-8469-26b81e99cae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:19.202049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:19.265720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db60886-d7b1-41ee-8469-26b81e99cae1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:19.278640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca81ee-92ba-44fd-b1bd-f7a4cd344e93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:19.279593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca81ee-92ba-44fd-b1bd-f7a4cd344e93 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:19.280281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca81ee-92ba-44fd-b1bd-f7a4cd344e93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:19.281099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca81ee-92ba-44fd-b1bd-f7a4cd344e93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:19.430726 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca81ee-92ba-44fd-b1bd-f7a4cd344e93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:19.432671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca81ee-92ba-44fd-b1bd-f7a4cd344e93 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:19.449950 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1227/2447] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:19.747794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cb5ec-42b6-49b4-93c7-885336a9c7d4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:19.750312 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7b6cb5ec-42b6-49b4-93c7-885336a9c7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:19.859448 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cb5ec-42b6-49b4-93c7-885336a9c7d4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:19.867808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07e382-04d7-449d-9b5f-222ac9174680 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cedb97f3c84faeaeef2b3209356842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:19.868708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07e382-04d7-449d-9b5f-222ac9174680 service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:19.868996 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07e382-04d7-449d-9b5f-222ac9174680 service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:19.869402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07e382-04d7-449d-9b5f-222ac9174680 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:19.871235 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-be07e382-04d7-449d-9b5f-222ac9174680 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:19.947876 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca81ee-92ba-44fd-b1bd-f7a4cd344e93 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:19.949590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b2ca81ee-92ba-44fd-b1bd-f7a4cd344e93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:19.959184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07e382-04d7-449d-9b5f-222ac9174680 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:19.966894 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07e382-04d7-449d-9b5f-222ac9174680 service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:20.057717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1221/2448] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:20.198675 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca81ee-92ba-44fd-b1bd-f7a4cd344e93 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:20.204985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a2190-7019-40f6-8e45-9049fdd01027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:20.205628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a2190-7019-40f6-8e45-9049fdd01027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:20.205993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a2190-7019-40f6-8e45-9049fdd01027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:20.206267 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a2190-7019-40f6-8e45-9049fdd01027 admin admin] PATH_INFO: `/v3/users/a817cd3c534f4089b3948bad1c37ed75` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:20.207687 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a2190-7019-40f6-8e45-9049fdd01027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a817cd3c534f4089b3948bad1c37ed75)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:20.211019 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a2190-7019-40f6-8e45-9049fdd01027 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:20.317501 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-345a2190-7019-40f6-8e45-9049fdd01027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a817cd3c534f4089b3948bad1c37ed75'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:20.318918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-345a2190-7019-40f6-8e45-9049fdd01027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a817cd3c534f4089b3948bad1c37ed75'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:20.331554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-345a2190-7019-40f6-8e45-9049fdd01027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a817cd3c534f4089b3948bad1c37ed75'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:20.382976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-345a2190-7019-40f6-8e45-9049fdd01027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a817cd3c534f4089b3948bad1c37ed75'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:20.404918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-345a2190-7019-40f6-8e45-9049fdd01027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a817cd3c534f4089b3948bad1c37ed75'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:20.420999 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1228/2449] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:19 2022] DELETE /identity/v3/users/a817cd3c534f4089b3948bad1c37ed75 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:20.801928 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07e382-04d7-449d-9b5f-222ac9174680 service placement] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:20.824716 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07e382-04d7-449d-9b5f-222ac9174680 service placement] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:20.852899 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:20.958192 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ba278-f5e6-4146-a169-62119ca6bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:20.959778 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ba278-f5e6-4146-a169-62119ca6bf5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:20.960106 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ba278-f5e6-4146-a169-62119ca6bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:20.960881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ba278-f5e6-4146-a169-62119ca6bf5c admin admin] PATH_INFO: `/v3/projects/657140f6249e40b685211cc602392c54` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:20.962862 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ba278-f5e6-4146-a169-62119ca6bf5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=657140f6249e40b685211cc602392c54)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:20.966787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ba278-f5e6-4146-a169-62119ca6bf5c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:21.069131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e64ba278-f5e6-4146-a169-62119ca6bf5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '657140f6249e40b685211cc602392c54', 'request_id': 'req-e64ba278-f5e6-4146-a169-62119ca6bf5c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:21.082354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e64ba278-f5e6-4146-a169-62119ca6bf5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '657140f6249e40b685211cc602392c54', 'request_id': 'req-e64ba278-f5e6-4146-a169-62119ca6bf5c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:21.094989 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e64ba278-f5e6-4146-a169-62119ca6bf5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '657140f6249e40b685211cc602392c54', 'request_id': 'req-e64ba278-f5e6-4146-a169-62119ca6bf5c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:21.114601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e64ba278-f5e6-4146-a169-62119ca6bf5c admin admin] The token cache is being invalidate because project 657140f6249e40b685211cc602392c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:21.115074 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e64ba278-f5e6-4146-a169-62119ca6bf5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:21.116560 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e64ba278-f5e6-4146-a169-62119ca6bf5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:21.125291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1222/2450] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:20 2022] DELETE /identity/v3/projects/657140f6249e40b685211cc602392c54 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:21.128709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8de66-3435-413c-91b9-234326d2e86d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:21.129326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8de66-3435-413c-91b9-234326d2e86d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:21.129940 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8de66-3435-413c-91b9-234326d2e86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:21.146056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:21.166164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-05c8de66-3435-413c-91b9-234326d2e86d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:21.168354 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-05c8de66-3435-413c-91b9-234326d2e86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:21.311636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1229/2451] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:21.319975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e039e4a-7aec-4e78-ac6e-829518fde57d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:21.320259 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e039e4a-7aec-4e78-ac6e-829518fde57d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:21.320533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e039e4a-7aec-4e78-ac6e-829518fde57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:21.347644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4e039e4a-7aec-4e78-ac6e-829518fde57d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:21.349221 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4e039e4a-7aec-4e78-ac6e-829518fde57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:21.395893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1223/2452] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:21.400349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8de66-3435-413c-91b9-234326d2e86d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:21.413545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e039e4a-7aec-4e78-ac6e-829518fde57d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:21.414412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8de66-3435-413c-91b9-234326d2e86d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:21.415066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4e039e4a-7aec-4e78-ac6e-829518fde57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:21.424467 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7eadd-ad36-4d26-a5db-6546996fdd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:21.425097 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7eadd-ad36-4d26-a5db-6546996fdd94 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:21.425382 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7eadd-ad36-4d26-a5db-6546996fdd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:21.425657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7eadd-ad36-4d26-a5db-6546996fdd94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:21.430317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7eadd-ad36-4d26-a5db-6546996fdd94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:21.430317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7eadd-ad36-4d26-a5db-6546996fdd94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:21.430317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7eadd-ad36-4d26-a5db-6546996fdd94 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:21.445279 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1230/2453] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:29:21.450879 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7eadd-ad36-4d26-a5db-6546996fdd94 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:21.465095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7eadd-ad36-4d26-a5db-6546996fdd94 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:21.474612 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c0453-097a-4f41-9605-33019cad25ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:21.476508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c0453-097a-4f41-9605-33019cad25ac admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:21.477070 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c0453-097a-4f41-9605-33019cad25ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:21.477446 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c0453-097a-4f41-9605-33019cad25ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:21.478226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c0453-097a-4f41-9605-33019cad25ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:21.482296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c0453-097a-4f41-9605-33019cad25ac admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:21.521580 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e039e4a-7aec-4e78-ac6e-829518fde57d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:21.526705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1231/2454] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:21 2022] POST /identity/v3/projects => generated 355 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:21.531136 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c0453-097a-4f41-9605-33019cad25ac admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:21.625855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450d72b-fe66-4c85-b89d-b99248e8875f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:21.626951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450d72b-fe66-4c85-b89d-b99248e8875f service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:21.627388 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450d72b-fe66-4c85-b89d-b99248e8875f service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:21.627841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450d72b-fe66-4c85-b89d-b99248e8875f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:21.631706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5450d72b-fe66-4c85-b89d-b99248e8875f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:21.637955 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c0453-097a-4f41-9605-33019cad25ac admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:21.652043 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f0670-8f70-4ef8-9740-6d1848441af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:21.652818 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f0670-8f70-4ef8-9740-6d1848441af1 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:21.653201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f0670-8f70-4ef8-9740-6d1848441af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:21.653589 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f0670-8f70-4ef8-9740-6d1848441af1 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:21.654073 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:21.654627 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f0670-8f70-4ef8-9740-6d1848441af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:21.657878 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f0670-8f70-4ef8-9740-6d1848441af1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:21.709963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1232/2455] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:21 2022] POST /identity/v3/users => generated 278 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:21.713231 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f0670-8f70-4ef8-9740-6d1848441af1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:21.726955 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f0670-8f70-4ef8-9740-6d1848441af1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:21.735585 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46057ca1-f746-4db5-abc8-27ebec1749b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:21.736786 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46057ca1-f746-4db5-abc8-27ebec1749b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:21.738386 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46057ca1-f746-4db5-abc8-27ebec1749b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:21.738862 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46057ca1-f746-4db5-abc8-27ebec1749b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:21.740501 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46057ca1-f746-4db5-abc8-27ebec1749b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:21.742205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450d72b-fe66-4c85-b89d-b99248e8875f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:21.742355 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46057ca1-f746-4db5-abc8-27ebec1749b5 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:21.746873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450d72b-fe66-4c85-b89d-b99248e8875f service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:21.755290 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1233/2456] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:21.758823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46057ca1-f746-4db5-abc8-27ebec1749b5 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:21.761165 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1224/2457] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:21.785538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46057ca1-f746-4db5-abc8-27ebec1749b5 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:21.810833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1cec-963e-4ecd-9117-d4c510f08031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:21.811462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1cec-963e-4ecd-9117-d4c510f08031 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:21.812406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1cec-963e-4ecd-9117-d4c510f08031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:21.812672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1cec-963e-4ecd-9117-d4c510f08031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:21.813513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e1cec-963e-4ecd-9117-d4c510f08031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:21.815154 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e1cec-963e-4ecd-9117-d4c510f08031 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:21.854759 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1234/2458] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:21.856081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450d72b-fe66-4c85-b89d-b99248e8875f service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:21.871209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450d72b-fe66-4c85-b89d-b99248e8875f service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:21.884258 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3e0b7-7d22-449e-bdc6-4d522ad320ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:21.886837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3e0b7-7d22-449e-bdc6-4d522ad320ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:21.886837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3e0b7-7d22-449e-bdc6-4d522ad320ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:21.886837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3e0b7-7d22-449e-bdc6-4d522ad320ad admin admin] PATH_INFO: `/v3/projects/d672f5faad6b4e7589edb4c0c3cbcc6a/users/80ff60dc52644e87aaf2f97422feaa14/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:21.913040 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3e0b7-7d22-449e-bdc6-4d522ad320ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d672f5faad6b4e7589edb4c0c3cbcc6a, user_id=80ff60dc52644e87aaf2f97422feaa14, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:21.916191 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3e0b7-7d22-449e-bdc6-4d522ad320ad admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:21.966424 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1225/2459] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:21 2022] PUT /identity/v3/projects/d672f5faad6b4e7589edb4c0c3cbcc6a/users/80ff60dc52644e87aaf2f97422feaa14/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:21.969588 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c6a8d-1680-4d4f-ad58-03fb8741d503 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:21.969918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c6a8d-1680-4d4f-ad58-03fb8741d503 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:21.970192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c6a8d-1680-4d4f-ad58-03fb8741d503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:22.048513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d30c6a8d-1680-4d4f-ad58-03fb8741d503 None None] MFA Rules not processed for user `80ff60dc52644e87aaf2f97422feaa14`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:22.059604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d30c6a8d-1680-4d4f-ad58-03fb8741d503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:22.133420 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:22.240885 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1235/2460] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:22.245706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3e0b7-7d22-449e-bdc6-4d522ad320ad admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:22.360040 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3e0b7-7d22-449e-bdc6-4d522ad320ad admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:22.373182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f820e-64e4-4a5f-8ad1-af737838a20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:22.374127 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f820e-64e4-4a5f-8ad1-af737838a20b admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:22.375429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f820e-64e4-4a5f-8ad1-af737838a20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:22.376099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f820e-64e4-4a5f-8ad1-af737838a20b admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:22.377558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f820e-64e4-4a5f-8ad1-af737838a20b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:22.381676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f820e-64e4-4a5f-8ad1-af737838a20b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:22.454362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1226/2461] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:22 2022] POST /identity/v3/projects => generated 355 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:22.458158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c6a8d-1680-4d4f-ad58-03fb8741d503 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:22.471878 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c6a8d-1680-4d4f-ad58-03fb8741d503 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:22.614148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12583141-0670-4d13-aee3-6331725c91fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:22.614834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12583141-0670-4d13-aee3-6331725c91fe admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:22.615266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12583141-0670-4d13-aee3-6331725c91fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:22.615643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12583141-0670-4d13-aee3-6331725c91fe admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:22.616341 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12583141-0670-4d13-aee3-6331725c91fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:22.618204 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12583141-0670-4d13-aee3-6331725c91fe admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:22.675350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1236/2462] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:22 2022] POST /identity/v3/users => generated 284 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:22.679346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f820e-64e4-4a5f-8ad1-af737838a20b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:22.698477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f820e-64e4-4a5f-8ad1-af737838a20b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:22.710854 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14e9f1-902d-4509-9eb7-6888ca15a674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:22.711465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14e9f1-902d-4509-9eb7-6888ca15a674 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:22.711778 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14e9f1-902d-4509-9eb7-6888ca15a674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:22.712023 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14e9f1-902d-4509-9eb7-6888ca15a674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:22.712676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14e9f1-902d-4509-9eb7-6888ca15a674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:22.714319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14e9f1-902d-4509-9eb7-6888ca15a674 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:22.729883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1227/2463] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:22.732555 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12583141-0670-4d13-aee3-6331725c91fe admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:22.745133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12583141-0670-4d13-aee3-6331725c91fe admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:22.750388 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd0831-d79e-43fb-bcac-31a30d1d125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:22.751217 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd0831-d79e-43fb-bcac-31a30d1d125c admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:22.751595 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd0831-d79e-43fb-bcac-31a30d1d125c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:22.751974 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd0831-d79e-43fb-bcac-31a30d1d125c admin admin] PATH_INFO: `/v3/projects/d0b80650798445d18136226554d2b40c/users/e88f0ad8338347dbbb7cd37084d5d484/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:22.769046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd0831-d79e-43fb-bcac-31a30d1d125c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b80650798445d18136226554d2b40c, user_id=e88f0ad8338347dbbb7cd37084d5d484, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:22.772343 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd0831-d79e-43fb-bcac-31a30d1d125c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:22.788513 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14e9f1-902d-4509-9eb7-6888ca15a674 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:22.795228 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1237/2464] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:22 2022] PUT /identity/v3/projects/d0b80650798445d18136226554d2b40c/users/e88f0ad8338347dbbb7cd37084d5d484/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:22.800379 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd0831-d79e-43fb-bcac-31a30d1d125c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:22.865856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14e9f1-902d-4509-9eb7-6888ca15a674 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:22.882349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd0831-d79e-43fb-bcac-31a30d1d125c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:22.883113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:22.892236 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5cd56-70db-444d-a070-8c2f457f869c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:22.893578 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5cd56-70db-444d-a070-8c2f457f869c admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:22.893746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5cd56-70db-444d-a070-8c2f457f869c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:22.894078 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5cd56-70db-444d-a070-8c2f457f869c admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:22.894834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5cd56-70db-444d-a070-8c2f457f869c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:22.896672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5cd56-70db-444d-a070-8c2f457f869c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:22.909736 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1238/2465] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:22.913841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5cd56-70db-444d-a070-8c2f457f869c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:22.928185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5cd56-70db-444d-a070-8c2f457f869c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:22.933621 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5668d1-b9ff-4b97-a3dc-6c5a13f695d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:22.934245 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a9016-a438-4f9a-b319-85af2ed0196d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:22.934794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5668d1-b9ff-4b97-a3dc-6c5a13f695d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:22.934926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a9016-a438-4f9a-b319-85af2ed0196d service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:22.935140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a9016-a438-4f9a-b319-85af2ed0196d service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:22.935410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a9016-a438-4f9a-b319-85af2ed0196d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:22.935525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5668d1-b9ff-4b97-a3dc-6c5a13f695d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:22.935943 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5668d1-b9ff-4b97-a3dc-6c5a13f695d2 admin admin] PATH_INFO: `/v3/projects/d0b80650798445d18136226554d2b40c/users/e88f0ad8338347dbbb7cd37084d5d484/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:22.937488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-051a9016-a438-4f9a-b319-85af2ed0196d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:22.938088 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5668d1-b9ff-4b97-a3dc-6c5a13f695d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b80650798445d18136226554d2b40c, user_id=e88f0ad8338347dbbb7cd37084d5d484, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:22.941086 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5668d1-b9ff-4b97-a3dc-6c5a13f695d2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:22.955872 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1239/2466] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:22 2022] PUT /identity/v3/projects/d0b80650798445d18136226554d2b40c/users/e88f0ad8338347dbbb7cd37084d5d484/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:22.966199 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92c6e6-31ba-4a0b-a71d-3e2cb5d1c7ae None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:22.966481 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92c6e6-31ba-4a0b-a71d-3e2cb5d1c7ae None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:22.966746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92c6e6-31ba-4a0b-a71d-3e2cb5d1c7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:22.995863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2a92c6e6-31ba-4a0b-a71d-3e2cb5d1c7ae None None] MFA Rules not processed for user `e88f0ad8338347dbbb7cd37084d5d484`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:22.997094 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2a92c6e6-31ba-4a0b-a71d-3e2cb5d1c7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:23.001091 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:23.006862 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a9016-a438-4f9a-b319-85af2ed0196d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:23.008992 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a9016-a438-4f9a-b319-85af2ed0196d service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:23.019628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1228/2467] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:23.073525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1240/2468] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:23.085611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a9016-a438-4f9a-b319-85af2ed0196d service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:23.097707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a9016-a438-4f9a-b319-85af2ed0196d service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:23.158065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872c056-6191-4065-8bf0-a8ad66160efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:23.158701 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872c056-6191-4065-8bf0-a8ad66160efb service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:23.158980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872c056-6191-4065-8bf0-a8ad66160efb service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:23.159255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872c056-6191-4065-8bf0-a8ad66160efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:23.170367 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872c056-6191-4065-8bf0-a8ad66160efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:23.171933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872c056-6191-4065-8bf0-a8ad66160efb service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:23.182787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1229/2469] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:23.265307 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92c6e6-31ba-4a0b-a71d-3e2cb5d1c7ae None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:23.279161 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92c6e6-31ba-4a0b-a71d-3e2cb5d1c7ae None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:23.283711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a7933-92fe-4005-b47b-53b1f4b36a47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:23.284328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a7933-92fe-4005-b47b-53b1f4b36a47 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:23.284660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a7933-92fe-4005-b47b-53b1f4b36a47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:23.284871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a7933-92fe-4005-b47b-53b1f4b36a47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:23.342021 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a7933-92fe-4005-b47b-53b1f4b36a47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:23.344320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a7933-92fe-4005-b47b-53b1f4b36a47 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:23.353426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1241/2470] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:23.639016 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872c056-6191-4065-8bf0-a8ad66160efb service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:23.641163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a872c056-6191-4065-8bf0-a8ad66160efb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:23.708469 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872c056-6191-4065-8bf0-a8ad66160efb service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:23.713005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5df7c6-f0b7-4e34-9653-61ca7c1e5238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:23.713630 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5df7c6-f0b7-4e34-9653-61ca7c1e5238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:23.713942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5df7c6-f0b7-4e34-9653-61ca7c1e5238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:23.714216 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5df7c6-f0b7-4e34-9653-61ca7c1e5238 admin admin] PATH_INFO: `/v3/users/2f52998162bb4c5bb238884157b6c101` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:23.715321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5df7c6-f0b7-4e34-9653-61ca7c1e5238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f52998162bb4c5bb238884157b6c101)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:23.717274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5df7c6-f0b7-4e34-9653-61ca7c1e5238 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:23.728260 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:23.764540 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6b5df7c6-f0b7-4e34-9653-61ca7c1e5238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f52998162bb4c5bb238884157b6c101'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:23.772097 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6b5df7c6-f0b7-4e34-9653-61ca7c1e5238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f52998162bb4c5bb238884157b6c101'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:23.784490 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6b5df7c6-f0b7-4e34-9653-61ca7c1e5238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f52998162bb4c5bb238884157b6c101'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:23.791334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6b5df7c6-f0b7-4e34-9653-61ca7c1e5238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f52998162bb4c5bb238884157b6c101'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:23.792000 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6b5df7c6-f0b7-4e34-9653-61ca7c1e5238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f52998162bb4c5bb238884157b6c101'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:23.798216 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1230/2471] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:23 2022] DELETE /identity/v3/users/2f52998162bb4c5bb238884157b6c101 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:23.802799 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81fbca-7f0a-47fa-8e86-822b6e3ea9ba None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:23.803298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81fbca-7f0a-47fa-8e86-822b6e3ea9ba None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:23.803407 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81fbca-7f0a-47fa-8e86-822b6e3ea9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:23.825269 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-1f81fbca-7f0a-47fa-8e86-822b6e3ea9ba None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:23.826503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1f81fbca-7f0a-47fa-8e86-822b6e3ea9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:23.884947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1242/2472] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:23.895483 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5df7c6-f0b7-4e34-9653-61ca7c1e5238 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:23.897034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6b5df7c6-f0b7-4e34-9653-61ca7c1e5238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:23.955862 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5df7c6-f0b7-4e34-9653-61ca7c1e5238 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:23.959556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297caf76-85e9-447d-b8bc-3d020c5b07ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:23.960155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297caf76-85e9-447d-b8bc-3d020c5b07ec service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:23.960435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297caf76-85e9-447d-b8bc-3d020c5b07ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:23.960704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297caf76-85e9-447d-b8bc-3d020c5b07ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:23.971143 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297caf76-85e9-447d-b8bc-3d020c5b07ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:23.972624 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297caf76-85e9-447d-b8bc-3d020c5b07ec service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:23.981926 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1231/2473] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:24.267319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81fbca-7f0a-47fa-8e86-822b6e3ea9ba None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:24.269506 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1f81fbca-7f0a-47fa-8e86-822b6e3ea9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:24.282311 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81fbca-7f0a-47fa-8e86-822b6e3ea9ba None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:24.288772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfaa04-c965-485a-9d40-62b15de1e384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:24.289552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfaa04-c965-485a-9d40-62b15de1e384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:24.289947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfaa04-c965-485a-9d40-62b15de1e384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:24.290359 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfaa04-c965-485a-9d40-62b15de1e384 admin admin] PATH_INFO: `/v3/projects/16333e82360448b893993a7af9d8582c` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:24.291577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfaa04-c965-485a-9d40-62b15de1e384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16333e82360448b893993a7af9d8582c)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:24.293670 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfaa04-c965-485a-9d40-62b15de1e384 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:24.359115 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:24.375915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cebfaa04-c965-485a-9d40-62b15de1e384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16333e82360448b893993a7af9d8582c', 'request_id': 'req-cebfaa04-c965-485a-9d40-62b15de1e384'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:24.386858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cebfaa04-c965-485a-9d40-62b15de1e384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16333e82360448b893993a7af9d8582c', 'request_id': 'req-cebfaa04-c965-485a-9d40-62b15de1e384'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:24.394986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cebfaa04-c965-485a-9d40-62b15de1e384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16333e82360448b893993a7af9d8582c', 'request_id': 'req-cebfaa04-c965-485a-9d40-62b15de1e384'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:24.434062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cebfaa04-c965-485a-9d40-62b15de1e384 admin admin] The token cache is being invalidate because project 16333e82360448b893993a7af9d8582c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:24.434411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cebfaa04-c965-485a-9d40-62b15de1e384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:24.435344 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cebfaa04-c965-485a-9d40-62b15de1e384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:24.440257 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1243/2474] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:24 2022] DELETE /identity/v3/projects/16333e82360448b893993a7af9d8582c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:24.441489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297caf76-85e9-447d-b8bc-3d020c5b07ec service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:24.453458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297caf76-85e9-447d-b8bc-3d020c5b07ec service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:24.526582 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbfd57-5f34-4c36-9a6f-a3208cd2a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:24.527293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbfd57-5f34-4c36-9a6f-a3208cd2a4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:24.527644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbfd57-5f34-4c36-9a6f-a3208cd2a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:24.527924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbfd57-5f34-4c36-9a6f-a3208cd2a4a6 admin admin] PATH_INFO: `/v3/users/1390ea083f0f4d999b1f5895fac71399` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:24.529117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbfd57-5f34-4c36-9a6f-a3208cd2a4a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1390ea083f0f4d999b1f5895fac71399)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:24.531914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbfd57-5f34-4c36-9a6f-a3208cd2a4a6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:24.572073 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:24.589060 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-93cbfd57-5f34-4c36-9a6f-a3208cd2a4a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1390ea083f0f4d999b1f5895fac71399'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:24.599524 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-93cbfd57-5f34-4c36-9a6f-a3208cd2a4a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1390ea083f0f4d999b1f5895fac71399'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:24.615187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-93cbfd57-5f34-4c36-9a6f-a3208cd2a4a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1390ea083f0f4d999b1f5895fac71399'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:24.622141 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-93cbfd57-5f34-4c36-9a6f-a3208cd2a4a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1390ea083f0f4d999b1f5895fac71399'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:24.622839 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-93cbfd57-5f34-4c36-9a6f-a3208cd2a4a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1390ea083f0f4d999b1f5895fac71399'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:24.630351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1232/2475] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:24 2022] DELETE /identity/v3/users/1390ea083f0f4d999b1f5895fac71399 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:24.904922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfaa04-c965-485a-9d40-62b15de1e384 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:24.906463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cebfaa04-c965-485a-9d40-62b15de1e384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:24.919425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfaa04-c965-485a-9d40-62b15de1e384 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:24.978373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af92b2e-ae3c-43e8-9138-aab78cdd500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:24.979004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af92b2e-ae3c-43e8-9138-aab78cdd500a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:24.979286 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af92b2e-ae3c-43e8-9138-aab78cdd500a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:24.979561 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af92b2e-ae3c-43e8-9138-aab78cdd500a admin admin] PATH_INFO: `/v3/projects/227c040c8dcd4ee39df5fc5b505654b1` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:24.980669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af92b2e-ae3c-43e8-9138-aab78cdd500a admin admin] RBAC: Authorizing `identity:delete_project(project_id=227c040c8dcd4ee39df5fc5b505654b1)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:24.982610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af92b2e-ae3c-43e8-9138-aab78cdd500a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:25.029559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1af92b2e-ae3c-43e8-9138-aab78cdd500a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227c040c8dcd4ee39df5fc5b505654b1', 'request_id': 'req-1af92b2e-ae3c-43e8-9138-aab78cdd500a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:25.035387 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1af92b2e-ae3c-43e8-9138-aab78cdd500a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227c040c8dcd4ee39df5fc5b505654b1', 'request_id': 'req-1af92b2e-ae3c-43e8-9138-aab78cdd500a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:25.041610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1af92b2e-ae3c-43e8-9138-aab78cdd500a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227c040c8dcd4ee39df5fc5b505654b1', 'request_id': 'req-1af92b2e-ae3c-43e8-9138-aab78cdd500a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:25.054336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1af92b2e-ae3c-43e8-9138-aab78cdd500a admin admin] The token cache is being invalidate because project 227c040c8dcd4ee39df5fc5b505654b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:25.054649 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1af92b2e-ae3c-43e8-9138-aab78cdd500a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:25.055324 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1af92b2e-ae3c-43e8-9138-aab78cdd500a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:25.056826 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1244/2476] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:24 2022] DELETE /identity/v3/projects/227c040c8dcd4ee39df5fc5b505654b1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:25.062363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647c575-08b9-40cc-9ab5-9a1f35a483aa None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:25.062868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647c575-08b9-40cc-9ab5-9a1f35a483aa None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:25.062975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647c575-08b9-40cc-9ab5-9a1f35a483aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:25.083863 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1647c575-08b9-40cc-9ab5-9a1f35a483aa None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:25.085065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1647c575-08b9-40cc-9ab5-9a1f35a483aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:25.144347 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1233/2477] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:25.153366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c2412-8418-4166-a6a1-dde7d8c6cb5b None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:25.153587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c2412-8418-4166-a6a1-dde7d8c6cb5b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:25.153891 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c2412-8418-4166-a6a1-dde7d8c6cb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:25.174178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-104c2412-8418-4166-a6a1-dde7d8c6cb5b None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:25.175426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-104c2412-8418-4166-a6a1-dde7d8c6cb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:25.183296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1245/2478] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:25.188107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647c575-08b9-40cc-9ab5-9a1f35a483aa None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:25.197761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647c575-08b9-40cc-9ab5-9a1f35a483aa None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:25.202298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914afa1-da05-4e88-9d6a-1fac83630f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:25.203489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914afa1-da05-4e88-9d6a-1fac83630f43 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:25.203763 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914afa1-da05-4e88-9d6a-1fac83630f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:25.204031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914afa1-da05-4e88-9d6a-1fac83630f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:25.204665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914afa1-da05-4e88-9d6a-1fac83630f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:25.204967 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914afa1-da05-4e88-9d6a-1fac83630f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:25.206577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914afa1-da05-4e88-9d6a-1fac83630f43 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:25.217869 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1234/2479] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:29:25.222560 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c2412-8418-4166-a6a1-dde7d8c6cb5b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:25.231576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c2412-8418-4166-a6a1-dde7d8c6cb5b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:25.236856 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ea336-a9ec-4fdf-9385-1b1d32a490c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:25.237439 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ea336-a9ec-4fdf-9385-1b1d32a490c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:25.237753 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ea336-a9ec-4fdf-9385-1b1d32a490c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:25.238025 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ea336-a9ec-4fdf-9385-1b1d32a490c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:25.238641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ea336-a9ec-4fdf-9385-1b1d32a490c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:25.240510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ea336-a9ec-4fdf-9385-1b1d32a490c1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:25.267654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1246/2480] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:25 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:25.271626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914afa1-da05-4e88-9d6a-1fac83630f43 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:25.281481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914afa1-da05-4e88-9d6a-1fac83630f43 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:25.337480 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2ba66-c6d2-4a17-b5dc-fff27498991a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:25.338107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2ba66-c6d2-4a17-b5dc-fff27498991a admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:25.338385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2ba66-c6d2-4a17-b5dc-fff27498991a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:25.338648 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2ba66-c6d2-4a17-b5dc-fff27498991a admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:25.339279 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2ba66-c6d2-4a17-b5dc-fff27498991a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:25.341170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2ba66-c6d2-4a17-b5dc-fff27498991a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:25.362792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1235/2481] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:25 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:25.366975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ea336-a9ec-4fdf-9385-1b1d32a490c1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:25.377850 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ea336-a9ec-4fdf-9385-1b1d32a490c1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:25.382669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa1a6c-1ffe-49e6-8975-797a9a91adba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:25.383256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa1a6c-1ffe-49e6-8975-797a9a91adba admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:25.383534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa1a6c-1ffe-49e6-8975-797a9a91adba admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:25.383805 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa1a6c-1ffe-49e6-8975-797a9a91adba admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:25.384490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa1a6c-1ffe-49e6-8975-797a9a91adba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:25.386150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa1a6c-1ffe-49e6-8975-797a9a91adba admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:25.396535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1247/2482] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:25.400369 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2ba66-c6d2-4a17-b5dc-fff27498991a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:25.410631 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2ba66-c6d2-4a17-b5dc-fff27498991a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:25.415220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbeae4-c0a6-4b5a-9fb0-6a2ddda80857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:25.415813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbeae4-c0a6-4b5a-9fb0-6a2ddda80857 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:25.416095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbeae4-c0a6-4b5a-9fb0-6a2ddda80857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:25.416365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbeae4-c0a6-4b5a-9fb0-6a2ddda80857 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:25.417002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbeae4-c0a6-4b5a-9fb0-6a2ddda80857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:25.418893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbeae4-c0a6-4b5a-9fb0-6a2ddda80857 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:25.430263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1236/2483] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:25.434561 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa1a6c-1ffe-49e6-8975-797a9a91adba admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:25.445511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa1a6c-1ffe-49e6-8975-797a9a91adba admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:25.450439 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb19aa8-211c-490d-9b18-7c7b474393c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:25.451075 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb19aa8-211c-490d-9b18-7c7b474393c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:25.451351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb19aa8-211c-490d-9b18-7c7b474393c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:25.451619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb19aa8-211c-490d-9b18-7c7b474393c2 admin admin] PATH_INFO: `/v3/projects/dc0c35e457624ac3bf57962b14047619/users/2450b0f045f845f1a1bbab3ee5905ccf/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:25.462777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:25.467296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb19aa8-211c-490d-9b18-7c7b474393c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0c35e457624ac3bf57962b14047619, user_id=2450b0f045f845f1a1bbab3ee5905ccf, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:25.471010 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb19aa8-211c-490d-9b18-7c7b474393c2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:25.484820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1248/2484] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:25 2022] PUT /identity/v3/projects/dc0c35e457624ac3bf57962b14047619/users/2450b0f045f845f1a1bbab3ee5905ccf/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:25.495294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177bb3b-a7dc-4fdd-aa43-34d139f75367 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:25.495567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177bb3b-a7dc-4fdd-aa43-34d139f75367 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:25.495843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177bb3b-a7dc-4fdd-aa43-34d139f75367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:25.525663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f177bb3b-a7dc-4fdd-aa43-34d139f75367 None None] MFA Rules not processed for user `2450b0f045f845f1a1bbab3ee5905ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:25.526836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f177bb3b-a7dc-4fdd-aa43-34d139f75367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:25.541812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:25.616166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1237/2485] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:25.620674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb19aa8-211c-490d-9b18-7c7b474393c2 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:25.684795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb19aa8-211c-490d-9b18-7c7b474393c2 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:25.693517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52c4aa-825e-4293-9b0a-3dee934ac12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:25.694245 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52c4aa-825e-4293-9b0a-3dee934ac12d admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:25.694518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52c4aa-825e-4293-9b0a-3dee934ac12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:25.694961 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52c4aa-825e-4293-9b0a-3dee934ac12d admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:25.695594 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52c4aa-825e-4293-9b0a-3dee934ac12d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:25.698073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52c4aa-825e-4293-9b0a-3dee934ac12d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:25.760185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1249/2486] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:25 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:25.763756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177bb3b-a7dc-4fdd-aa43-34d139f75367 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:25.778130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177bb3b-a7dc-4fdd-aa43-34d139f75367 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:25.868629 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc94459-3fb3-4ae4-b8c9-cf340558cea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:25.869661 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc94459-3fb3-4ae4-b8c9-cf340558cea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:25.870079 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc94459-3fb3-4ae4-b8c9-cf340558cea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:25.870447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc94459-3fb3-4ae4-b8c9-cf340558cea9 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:25.871545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc94459-3fb3-4ae4-b8c9-cf340558cea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:25.875848 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc94459-3fb3-4ae4-b8c9-cf340558cea9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:25.916773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1238/2487] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:25 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:25.920764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52c4aa-825e-4293-9b0a-3dee934ac12d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:25.936172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52c4aa-825e-4293-9b0a-3dee934ac12d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:25.944421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcaea9-bdb9-4a68-aa08-8648a4423083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:25.945426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcaea9-bdb9-4a68-aa08-8648a4423083 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:25.946112 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcaea9-bdb9-4a68-aa08-8648a4423083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:25.946438 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcaea9-bdb9-4a68-aa08-8648a4423083 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:25.947059 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcaea9-bdb9-4a68-aa08-8648a4423083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:25.948927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcaea9-bdb9-4a68-aa08-8648a4423083 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:25.967174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1250/2488] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:25.972271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc94459-3fb3-4ae4-b8c9-cf340558cea9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:25.986071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc94459-3fb3-4ae4-b8c9-cf340558cea9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:25.992989 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dd785-3654-4a68-9e04-b11c063bf2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:25.993823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dd785-3654-4a68-9e04-b11c063bf2aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:25.994136 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dd785-3654-4a68-9e04-b11c063bf2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:25.994478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dd785-3654-4a68-9e04-b11c063bf2aa admin admin] PATH_INFO: `/v3/projects/50a30ab7a5a64d92881cee47816e5aba/users/f653a76ba78642f1ab1c0bb2e04a92ae/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:26.017252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dd785-3654-4a68-9e04-b11c063bf2aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a30ab7a5a64d92881cee47816e5aba, user_id=f653a76ba78642f1ab1c0bb2e04a92ae, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:26.020384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dd785-3654-4a68-9e04-b11c063bf2aa admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:26.040873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1239/2489] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:25 2022] PUT /identity/v3/projects/50a30ab7a5a64d92881cee47816e5aba/users/f653a76ba78642f1ab1c0bb2e04a92ae/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:26.045494 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcaea9-bdb9-4a68-aa08-8648a4423083 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:26.060726 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcaea9-bdb9-4a68-aa08-8648a4423083 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:26.137223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c459046-0207-4f7a-9b29-0ac325d9de7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:26.137987 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c459046-0207-4f7a-9b29-0ac325d9de7c admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:26.138370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c459046-0207-4f7a-9b29-0ac325d9de7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:26.138770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c459046-0207-4f7a-9b29-0ac325d9de7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:26.139686 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c459046-0207-4f7a-9b29-0ac325d9de7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:26.141733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c459046-0207-4f7a-9b29-0ac325d9de7c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:26.163733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1251/2490] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:26.164736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dd785-3654-4a68-9e04-b11c063bf2aa admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:26.177461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dd785-3654-4a68-9e04-b11c063bf2aa admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:26.182294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14b839-4750-41cb-bcd9-7712fa07df84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:26.183563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14b839-4750-41cb-bcd9-7712fa07df84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:26.183563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14b839-4750-41cb-bcd9-7712fa07df84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:26.183798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14b839-4750-41cb-bcd9-7712fa07df84 admin admin] PATH_INFO: `/v3/projects/50a30ab7a5a64d92881cee47816e5aba/users/f653a76ba78642f1ab1c0bb2e04a92ae/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:26.188224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14b839-4750-41cb-bcd9-7712fa07df84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a30ab7a5a64d92881cee47816e5aba, user_id=f653a76ba78642f1ab1c0bb2e04a92ae, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:26.192592 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14b839-4750-41cb-bcd9-7712fa07df84 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:26.208541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1240/2491] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:26 2022] PUT /identity/v3/projects/50a30ab7a5a64d92881cee47816e5aba/users/f653a76ba78642f1ab1c0bb2e04a92ae/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:26.220320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada325aa-0d21-4fe4-b03c-eb3444cee332 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:26.220848 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada325aa-0d21-4fe4-b03c-eb3444cee332 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:26.221151 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada325aa-0d21-4fe4-b03c-eb3444cee332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:26.262724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ada325aa-0d21-4fe4-b03c-eb3444cee332 None None] MFA Rules not processed for user `f653a76ba78642f1ab1c0bb2e04a92ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:26.263977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ada325aa-0d21-4fe4-b03c-eb3444cee332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:26.317045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:26.341034 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1252/2492] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:26.353654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14b839-4750-41cb-bcd9-7712fa07df84 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:26.355585 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9c14b839-4750-41cb-bcd9-7712fa07df84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:26.418520 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14b839-4750-41cb-bcd9-7712fa07df84 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:26.419793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b404f3-473d-407b-b957-f861a36c29a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:26.420832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b404f3-473d-407b-b957-f861a36c29a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:26.420832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b404f3-473d-407b-b957-f861a36c29a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:26.422351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b404f3-473d-407b-b957-f861a36c29a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:26.432987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b404f3-473d-407b-b957-f861a36c29a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:26.434865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b404f3-473d-407b-b957-f861a36c29a6 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:26.440130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:26.445517 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1241/2493] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:26.836489 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada325aa-0d21-4fe4-b03c-eb3444cee332 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:26.905028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada325aa-0d21-4fe4-b03c-eb3444cee332 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:26.916255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca68525-9840-4969-82a4-ed2a678ac574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:26.916918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca68525-9840-4969-82a4-ed2a678ac574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:26.917200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca68525-9840-4969-82a4-ed2a678ac574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:26.917475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca68525-9840-4969-82a4-ed2a678ac574 admin admin] PATH_INFO: `/v3/users/2450b0f045f845f1a1bbab3ee5905ccf` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:26.919273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca68525-9840-4969-82a4-ed2a678ac574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2450b0f045f845f1a1bbab3ee5905ccf)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:26.922443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca68525-9840-4969-82a4-ed2a678ac574 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:26.972788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-eca68525-9840-4969-82a4-ed2a678ac574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2450b0f045f845f1a1bbab3ee5905ccf'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:26.973470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-eca68525-9840-4969-82a4-ed2a678ac574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2450b0f045f845f1a1bbab3ee5905ccf'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:26.990185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-eca68525-9840-4969-82a4-ed2a678ac574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2450b0f045f845f1a1bbab3ee5905ccf'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.006877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-eca68525-9840-4969-82a4-ed2a678ac574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2450b0f045f845f1a1bbab3ee5905ccf'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.018694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-eca68525-9840-4969-82a4-ed2a678ac574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2450b0f045f845f1a1bbab3ee5905ccf'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.025765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1253/2494] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:26 2022] DELETE /identity/v3/users/2450b0f045f845f1a1bbab3ee5905ccf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:27.030896 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb55ca9-0c49-439c-82a7-159e889140fc None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:27.034484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb55ca9-0c49-439c-82a7-159e889140fc None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:27.034767 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb55ca9-0c49-439c-82a7-159e889140fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:27.035225 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca68525-9840-4969-82a4-ed2a678ac574 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:27.036923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-eca68525-9840-4969-82a4-ed2a678ac574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:27.056240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cbb55ca9-0c49-439c-82a7-159e889140fc None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:27.057126 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cbb55ca9-0c49-439c-82a7-159e889140fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:27.112227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca68525-9840-4969-82a4-ed2a678ac574 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:27.117125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8f7f2-7a90-4983-a33f-c80993033565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:27.117797 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8f7f2-7a90-4983-a33f-c80993033565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:27.118075 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8f7f2-7a90-4983-a33f-c80993033565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:27.118349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8f7f2-7a90-4983-a33f-c80993033565 admin admin] PATH_INFO: `/v3/users/7117d04336084ae4a877df67895c6bb2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:27.119488 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8f7f2-7a90-4983-a33f-c80993033565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7117d04336084ae4a877df67895c6bb2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:27.121482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8f7f2-7a90-4983-a33f-c80993033565 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:27.121856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1242/2495] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:27.127214 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:27.132188 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb55ca9-0c49-439c-82a7-159e889140fc None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:27.133558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cbb55ca9-0c49-439c-82a7-159e889140fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:27.198602 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9d8f7f2-7a90-4983-a33f-c80993033565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7117d04336084ae4a877df67895c6bb2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.199565 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9d8f7f2-7a90-4983-a33f-c80993033565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7117d04336084ae4a877df67895c6bb2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.209286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb55ca9-0c49-439c-82a7-159e889140fc None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:27.220002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac41d2-cd6b-4b33-9f89-0d0472a868c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:27.221674 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac41d2-cd6b-4b33-9f89-0d0472a868c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:27.221975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac41d2-cd6b-4b33-9f89-0d0472a868c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:27.222243 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac41d2-cd6b-4b33-9f89-0d0472a868c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:27.242872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac41d2-cd6b-4b33-9f89-0d0472a868c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:27.244400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac41d2-cd6b-4b33-9f89-0d0472a868c0 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:27.256298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1243/2496] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:27.312345 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9d8f7f2-7a90-4983-a33f-c80993033565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7117d04336084ae4a877df67895c6bb2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.329825 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9d8f7f2-7a90-4983-a33f-c80993033565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7117d04336084ae4a877df67895c6bb2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.338559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9d8f7f2-7a90-4983-a33f-c80993033565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7117d04336084ae4a877df67895c6bb2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.347973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1254/2497] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:27 2022] DELETE /identity/v3/users/7117d04336084ae4a877df67895c6bb2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:27.352933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba187540-9374-492b-a721-9953b909074a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:27.353215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba187540-9374-492b-a721-9953b909074a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:27.353492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba187540-9374-492b-a721-9953b909074a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:27.374009 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ba187540-9374-492b-a721-9953b909074a None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:27.375363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ba187540-9374-492b-a721-9953b909074a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:27.461933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1244/2498] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:27.472205 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8f7f2-7a90-4983-a33f-c80993033565 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:27.473768 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c9d8f7f2-7a90-4983-a33f-c80993033565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:27.539433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8f7f2-7a90-4983-a33f-c80993033565 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:27.543319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb608c-f1d8-4900-ab36-c810b78ec03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:27.543936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb608c-f1d8-4900-ab36-c810b78ec03d service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:27.544263 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb608c-f1d8-4900-ab36-c810b78ec03d service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:27.544543 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb608c-f1d8-4900-ab36-c810b78ec03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:27.561618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb608c-f1d8-4900-ab36-c810b78ec03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:27.563335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb608c-f1d8-4900-ab36-c810b78ec03d service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:27.575858 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba187540-9374-492b-a721-9953b909074a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:27.576045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1255/2499] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:27.581772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ba187540-9374-492b-a721-9953b909074a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:27.597999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba187540-9374-492b-a721-9953b909074a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:27.604315 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc9418-56c9-4393-8ddc-a3db0497991a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:27.605550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc9418-56c9-4393-8ddc-a3db0497991a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:27.606275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc9418-56c9-4393-8ddc-a3db0497991a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:27.606592 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc9418-56c9-4393-8ddc-a3db0497991a admin admin] PATH_INFO: `/v3/projects/dc0c35e457624ac3bf57962b14047619` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:27.608040 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc9418-56c9-4393-8ddc-a3db0497991a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc0c35e457624ac3bf57962b14047619)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:27.611756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc9418-56c9-4393-8ddc-a3db0497991a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:27.665953 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:27.674047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dcbc9418-56c9-4393-8ddc-a3db0497991a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc0c35e457624ac3bf57962b14047619', 'request_id': 'req-dcbc9418-56c9-4393-8ddc-a3db0497991a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.682836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dcbc9418-56c9-4393-8ddc-a3db0497991a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc0c35e457624ac3bf57962b14047619', 'request_id': 'req-dcbc9418-56c9-4393-8ddc-a3db0497991a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.691009 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dcbc9418-56c9-4393-8ddc-a3db0497991a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc0c35e457624ac3bf57962b14047619', 'request_id': 'req-dcbc9418-56c9-4393-8ddc-a3db0497991a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.707556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dcbc9418-56c9-4393-8ddc-a3db0497991a admin admin] The token cache is being invalidate because project dc0c35e457624ac3bf57962b14047619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:27.708124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dcbc9418-56c9-4393-8ddc-a3db0497991a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.710753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dcbc9418-56c9-4393-8ddc-a3db0497991a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.713859 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1245/2500] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:27 2022] DELETE /identity/v3/projects/dc0c35e457624ac3bf57962b14047619 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:27.716263 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb608c-f1d8-4900-ab36-c810b78ec03d service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:27.726963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb608c-f1d8-4900-ab36-c810b78ec03d service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:27.844176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05a1f0-b791-447b-ac84-cda8db3650ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:27.846190 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05a1f0-b791-447b-ac84-cda8db3650ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:27.846861 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05a1f0-b791-447b-ac84-cda8db3650ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:27.847349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05a1f0-b791-447b-ac84-cda8db3650ef admin admin] PATH_INFO: `/v3/users/f653a76ba78642f1ab1c0bb2e04a92ae` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:27.849076 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05a1f0-b791-447b-ac84-cda8db3650ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f653a76ba78642f1ab1c0bb2e04a92ae)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:27.851490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05a1f0-b791-447b-ac84-cda8db3650ef admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:27.896929 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:27.956439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc9418-56c9-4393-8ddc-a3db0497991a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:27.960798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-dcbc9418-56c9-4393-8ddc-a3db0497991a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:27.962851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6b05a1f0-b791-447b-ac84-cda8db3650ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f653a76ba78642f1ab1c0bb2e04a92ae'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.965024 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6b05a1f0-b791-447b-ac84-cda8db3650ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f653a76ba78642f1ab1c0bb2e04a92ae'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.982440 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc9418-56c9-4393-8ddc-a3db0497991a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:27.988409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6b05a1f0-b791-447b-ac84-cda8db3650ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f653a76ba78642f1ab1c0bb2e04a92ae'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:27.988561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2684ce-53da-41ab-96a4-ccb6ae381737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:27.990250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2684ce-53da-41ab-96a4-ccb6ae381737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:27.990250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2684ce-53da-41ab-96a4-ccb6ae381737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:27.990250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2684ce-53da-41ab-96a4-ccb6ae381737 admin admin] PATH_INFO: `/v3/projects/e0c117c8ff164913843251dc745c966f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:27.991572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2684ce-53da-41ab-96a4-ccb6ae381737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c117c8ff164913843251dc745c966f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:27.994088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2684ce-53da-41ab-96a4-ccb6ae381737 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:28.008846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6b05a1f0-b791-447b-ac84-cda8db3650ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f653a76ba78642f1ab1c0bb2e04a92ae'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.021212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6b05a1f0-b791-447b-ac84-cda8db3650ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f653a76ba78642f1ab1c0bb2e04a92ae'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.032336 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1256/2501] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:27 2022] DELETE /identity/v3/users/f653a76ba78642f1ab1c0bb2e04a92ae => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:28.038121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05a1f0-b791-447b-ac84-cda8db3650ef admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:28.039688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6b05a1f0-b791-447b-ac84-cda8db3650ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:28.063399 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6c2684ce-53da-41ab-96a4-ccb6ae381737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c117c8ff164913843251dc745c966f', 'request_id': 'req-6c2684ce-53da-41ab-96a4-ccb6ae381737'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.074233 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6c2684ce-53da-41ab-96a4-ccb6ae381737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c117c8ff164913843251dc745c966f', 'request_id': 'req-6c2684ce-53da-41ab-96a4-ccb6ae381737'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.086753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6c2684ce-53da-41ab-96a4-ccb6ae381737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c117c8ff164913843251dc745c966f', 'request_id': 'req-6c2684ce-53da-41ab-96a4-ccb6ae381737'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.102866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6c2684ce-53da-41ab-96a4-ccb6ae381737 admin admin] The token cache is being invalidate because project e0c117c8ff164913843251dc745c966f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:28.103485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6c2684ce-53da-41ab-96a4-ccb6ae381737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.105044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-6c2684ce-53da-41ab-96a4-ccb6ae381737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.109743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1246/2502] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:27 2022] DELETE /identity/v3/projects/e0c117c8ff164913843251dc745c966f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:28.114445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2684ce-53da-41ab-96a4-ccb6ae381737 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:28.116445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6c2684ce-53da-41ab-96a4-ccb6ae381737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:28.149440 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05a1f0-b791-447b-ac84-cda8db3650ef admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:28.211899 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2684ce-53da-41ab-96a4-ccb6ae381737 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:28.217482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0abf7a-c5c7-4db6-9390-263a21ba82c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:28.219312 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0abf7a-c5c7-4db6-9390-263a21ba82c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:28.219665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0abf7a-c5c7-4db6-9390-263a21ba82c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:28.219996 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0abf7a-c5c7-4db6-9390-263a21ba82c4 admin admin] PATH_INFO: `/v3/users/7a2c233d9463407a927e8e25c2b21a30` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:28.222296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0abf7a-c5c7-4db6-9390-263a21ba82c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2c233d9463407a927e8e25c2b21a30)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:28.225329 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0abf7a-c5c7-4db6-9390-263a21ba82c4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:28.230514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7304f1-632a-40b7-8807-07b526d4cfbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:28.231513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7304f1-632a-40b7-8807-07b526d4cfbd service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:28.231811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7304f1-632a-40b7-8807-07b526d4cfbd service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:28.232156 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7304f1-632a-40b7-8807-07b526d4cfbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:28.234546 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fe7304f1-632a-40b7-8807-07b526d4cfbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:28.250664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7304f1-632a-40b7-8807-07b526d4cfbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:28.252279 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7304f1-632a-40b7-8807-07b526d4cfbd service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:28.269777 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1257/2503] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:28.288111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1e0abf7a-c5c7-4db6-9390-263a21ba82c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2c233d9463407a927e8e25c2b21a30'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.292929 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:28.299241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1e0abf7a-c5c7-4db6-9390-263a21ba82c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2c233d9463407a927e8e25c2b21a30'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.315534 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1e0abf7a-c5c7-4db6-9390-263a21ba82c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2c233d9463407a927e8e25c2b21a30'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.324317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1e0abf7a-c5c7-4db6-9390-263a21ba82c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2c233d9463407a927e8e25c2b21a30'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.325516 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1e0abf7a-c5c7-4db6-9390-263a21ba82c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2c233d9463407a927e8e25c2b21a30'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.347863 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1247/2504] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:28 2022] DELETE /identity/v3/users/7a2c233d9463407a927e8e25c2b21a30 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:28.451934 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7304f1-632a-40b7-8807-07b526d4cfbd service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:28.454340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fe7304f1-632a-40b7-8807-07b526d4cfbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:28.479592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7304f1-632a-40b7-8807-07b526d4cfbd service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:28.527043 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:28.566501 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1c2ab-7208-45c2-8fc6-fcc41121acb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:28.567175 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1c2ab-7208-45c2-8fc6-fcc41121acb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:28.567536 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1c2ab-7208-45c2-8fc6-fcc41121acb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:28.567887 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1c2ab-7208-45c2-8fc6-fcc41121acb7 admin admin] PATH_INFO: `/v3/projects/50a30ab7a5a64d92881cee47816e5aba` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:28.569410 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1c2ab-7208-45c2-8fc6-fcc41121acb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a30ab7a5a64d92881cee47816e5aba)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:28.571467 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1c2ab-7208-45c2-8fc6-fcc41121acb7 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:28.626541 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9dc1c2ab-7208-45c2-8fc6-fcc41121acb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a30ab7a5a64d92881cee47816e5aba', 'request_id': 'req-9dc1c2ab-7208-45c2-8fc6-fcc41121acb7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.632605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9dc1c2ab-7208-45c2-8fc6-fcc41121acb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a30ab7a5a64d92881cee47816e5aba', 'request_id': 'req-9dc1c2ab-7208-45c2-8fc6-fcc41121acb7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.643831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0abf7a-c5c7-4db6-9390-263a21ba82c4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:28.643992 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9dc1c2ab-7208-45c2-8fc6-fcc41121acb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a30ab7a5a64d92881cee47816e5aba', 'request_id': 'req-9dc1c2ab-7208-45c2-8fc6-fcc41121acb7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.645868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1e0abf7a-c5c7-4db6-9390-263a21ba82c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:28.658733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9dc1c2ab-7208-45c2-8fc6-fcc41121acb7 admin admin] The token cache is being invalidate because project 50a30ab7a5a64d92881cee47816e5aba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:28.659152 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9dc1c2ab-7208-45c2-8fc6-fcc41121acb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.659933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9dc1c2ab-7208-45c2-8fc6-fcc41121acb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.661029 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0abf7a-c5c7-4db6-9390-263a21ba82c4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:28.662404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1258/2505] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:28 2022] DELETE /identity/v3/projects/50a30ab7a5a64d92881cee47816e5aba => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:28.666937 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf7a9-70b2-49f1-a571-719ad3fcf6d8 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:28.667301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf7a9-70b2-49f1-a571-719ad3fcf6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:28.667667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf7a9-70b2-49f1-a571-719ad3fcf6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:28.690353 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a9dbf7a9-70b2-49f1-a571-719ad3fcf6d8 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:28.691577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a9dbf7a9-70b2-49f1-a571-719ad3fcf6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:28.720820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:28.721456 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:28.721770 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:28.722046 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4 admin admin] PATH_INFO: `/v3/projects/37a89551e17d49adb686ca0d61340094` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:28.723201 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a89551e17d49adb686ca0d61340094)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:28.725107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:28.755685 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1259/2506] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:28.763063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabc139-e053-4ab3-8d63-132a69b233a3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:28.763343 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabc139-e053-4ab3-8d63-132a69b233a3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:28.763615 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabc139-e053-4ab3-8d63-132a69b233a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:28.774723 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a89551e17d49adb686ca0d61340094', 'request_id': 'req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.781403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a89551e17d49adb686ca0d61340094', 'request_id': 'req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.783508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-feabc139-e053-4ab3-8d63-132a69b233a3 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:28.784829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-feabc139-e053-4ab3-8d63-132a69b233a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:28.787887 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a89551e17d49adb686ca0d61340094', 'request_id': 'req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.801572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4 admin admin] The token cache is being invalidate because project 37a89551e17d49adb686ca0d61340094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:28.801937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.802515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.804601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1248/2507] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:28 2022] DELETE /identity/v3/projects/37a89551e17d49adb686ca0d61340094 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:28.808002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:28.809323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:28.839291 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:28.850136 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1260/2508] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:28.854003 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabc139-e053-4ab3-8d63-132a69b233a3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:28.863508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabc139-e053-4ab3-8d63-132a69b233a3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:28.868164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c5479-9b0e-4f78-8515-67553812edc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:28.868732 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c5479-9b0e-4f78-8515-67553812edc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:28.869017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c5479-9b0e-4f78-8515-67553812edc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:28.869292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c5479-9b0e-4f78-8515-67553812edc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:28.869960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c5479-9b0e-4f78-8515-67553812edc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:28.870272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c5479-9b0e-4f78-8515-67553812edc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:28.871863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c5479-9b0e-4f78-8515-67553812edc4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:28.876205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cb323-6816-4f4f-be3b-3c1d9563e4a4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:28.880772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5fe4c-ca31-4fb3-a7ac-31488d28c1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:28.881383 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5fe4c-ca31-4fb3-a7ac-31488d28c1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:28.881706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5fe4c-ca31-4fb3-a7ac-31488d28c1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:28.881956 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5fe4c-ca31-4fb3-a7ac-31488d28c1f8 admin admin] PATH_INFO: `/v3/users/8609b763361f4e7cb77fc7d84706c64f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:28.883105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5fe4c-ca31-4fb3-a7ac-31488d28c1f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8609b763361f4e7cb77fc7d84706c64f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:28.884559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1261/2509] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:29:28.884988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5fe4c-ca31-4fb3-a7ac-31488d28c1f8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:28.886559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:28.888854 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c5479-9b0e-4f78-8515-67553812edc4 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:28.899322 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c5479-9b0e-4f78-8515-67553812edc4 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:28.904390 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4db00c-3141-49bb-aaee-72ba6d8668eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:28.905021 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4db00c-3141-49bb-aaee-72ba6d8668eb admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:28.905429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4db00c-3141-49bb-aaee-72ba6d8668eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:28.905731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4db00c-3141-49bb-aaee-72ba6d8668eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:28.906358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4db00c-3141-49bb-aaee-72ba6d8668eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:28.908281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4db00c-3141-49bb-aaee-72ba6d8668eb admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:28.938283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1bf5fe4c-ca31-4fb3-a7ac-31488d28c1f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8609b763361f4e7cb77fc7d84706c64f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.938630 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1262/2510] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:28 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:28.942703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4db00c-3141-49bb-aaee-72ba6d8668eb admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:28.946021 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1bf5fe4c-ca31-4fb3-a7ac-31488d28c1f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8609b763361f4e7cb77fc7d84706c64f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.958807 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1bf5fe4c-ca31-4fb3-a7ac-31488d28c1f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8609b763361f4e7cb77fc7d84706c64f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.966167 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1bf5fe4c-ca31-4fb3-a7ac-31488d28c1f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8609b763361f4e7cb77fc7d84706c64f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.966863 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1bf5fe4c-ca31-4fb3-a7ac-31488d28c1f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8609b763361f4e7cb77fc7d84706c64f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:28.973211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1249/2511] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:28 2022] DELETE /identity/v3/users/8609b763361f4e7cb77fc7d84706c64f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:29.016276 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4db00c-3141-49bb-aaee-72ba6d8668eb admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.086908 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ebb1d-d808-427f-8250-eaabd4d3ba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.087686 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ebb1d-d808-427f-8250-eaabd4d3ba8a admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.087816 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ebb1d-d808-427f-8250-eaabd4d3ba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.088093 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ebb1d-d808-427f-8250-eaabd4d3ba8a admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.091982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ebb1d-d808-427f-8250-eaabd4d3ba8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.091982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ebb1d-d808-427f-8250-eaabd4d3ba8a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.121312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1263/2512] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:28 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:29.122560 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5fe4c-ca31-4fb3-a7ac-31488d28c1f8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.124690 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1bf5fe4c-ca31-4fb3-a7ac-31488d28c1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:29.148729 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5fe4c-ca31-4fb3-a7ac-31488d28c1f8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.153897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3471374-77b9-4ccf-a4ae-e49aec22f60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.154502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3471374-77b9-4ccf-a4ae-e49aec22f60e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.154824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3471374-77b9-4ccf-a4ae-e49aec22f60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.155055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3471374-77b9-4ccf-a4ae-e49aec22f60e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.155788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3471374-77b9-4ccf-a4ae-e49aec22f60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.157508 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3471374-77b9-4ccf-a4ae-e49aec22f60e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.169370 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1250/2513] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:29.174067 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ebb1d-d808-427f-8250-eaabd4d3ba8a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.187044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ebb1d-d808-427f-8250-eaabd4d3ba8a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.192103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e04cb4-f55f-402c-a83c-8d8a7216ff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.192808 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e04cb4-f55f-402c-a83c-8d8a7216ff57 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.193155 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e04cb4-f55f-402c-a83c-8d8a7216ff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.193496 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e04cb4-f55f-402c-a83c-8d8a7216ff57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.194249 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e04cb4-f55f-402c-a83c-8d8a7216ff57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.195909 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e04cb4-f55f-402c-a83c-8d8a7216ff57 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.207046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1264/2514] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:29.211230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3471374-77b9-4ccf-a4ae-e49aec22f60e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.222309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3471374-77b9-4ccf-a4ae-e49aec22f60e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.227071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e7af2-f885-4737-b56b-e53b870fdcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.227730 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e7af2-f885-4737-b56b-e53b870fdcfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.228012 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e7af2-f885-4737-b56b-e53b870fdcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.228321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e7af2-f885-4737-b56b-e53b870fdcfd admin admin] PATH_INFO: `/v3/projects/84249c90a2dc4acca20abe3233c2c4b3/users/9a3d860677b048c9b1e03d558a935c66/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.244479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e7af2-f885-4737-b56b-e53b870fdcfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=84249c90a2dc4acca20abe3233c2c4b3, user_id=9a3d860677b048c9b1e03d558a935c66, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.247170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e7af2-f885-4737-b56b-e53b870fdcfd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.260743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1251/2515] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:29 2022] PUT /identity/v3/projects/84249c90a2dc4acca20abe3233c2c4b3/users/9a3d860677b048c9b1e03d558a935c66/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:29.271601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883f923-d47b-4d91-bdb2-59073a148423 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.272037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883f923-d47b-4d91-bdb2-59073a148423 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.272325 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883f923-d47b-4d91-bdb2-59073a148423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.303173 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6883f923-d47b-4d91-bdb2-59073a148423 None None] MFA Rules not processed for user `9a3d860677b048c9b1e03d558a935c66`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:29.304397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6883f923-d47b-4d91-bdb2-59073a148423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:29.306857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e7af2-f885-4737-b56b-e53b870fdcfd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.308646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-183e7af2-f885-4737-b56b-e53b870fdcfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:29.354349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:29.391449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1265/2516] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:29.392667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883f923-d47b-4d91-bdb2-59073a148423 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.394986 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e7af2-f885-4737-b56b-e53b870fdcfd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.399772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e5b8-81ad-4e1c-8ed7-c27aaf7b58e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.400959 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e5b8-81ad-4e1c-8ed7-c27aaf7b58e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.401270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e5b8-81ad-4e1c-8ed7-c27aaf7b58e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.401532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e5b8-81ad-4e1c-8ed7-c27aaf7b58e8 admin admin] PATH_INFO: `/v3/projects/38b2a13d094e4957aac9f9aba52c2d2d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.402845 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452e5b8-81ad-4e1c-8ed7-c27aaf7b58e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b2a13d094e4957aac9f9aba52c2d2d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.404746 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452e5b8-81ad-4e1c-8ed7-c27aaf7b58e8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.404859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883f923-d47b-4d91-bdb2-59073a148423 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.411656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19665ff4-02bd-48a1-be3e-4afafa8b14a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.412280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19665ff4-02bd-48a1-be3e-4afafa8b14a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.412560 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19665ff4-02bd-48a1-be3e-4afafa8b14a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.412830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19665ff4-02bd-48a1-be3e-4afafa8b14a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.418375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19665ff4-02bd-48a1-be3e-4afafa8b14a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.418375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19665ff4-02bd-48a1-be3e-4afafa8b14a1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.454825 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1266/2517] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:29 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:29.460063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19665ff4-02bd-48a1-be3e-4afafa8b14a1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.461919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:29.465855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9452e5b8-81ad-4e1c-8ed7-c27aaf7b58e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b2a13d094e4957aac9f9aba52c2d2d', 'request_id': 'req-9452e5b8-81ad-4e1c-8ed7-c27aaf7b58e8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:29.473702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9452e5b8-81ad-4e1c-8ed7-c27aaf7b58e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b2a13d094e4957aac9f9aba52c2d2d', 'request_id': 'req-9452e5b8-81ad-4e1c-8ed7-c27aaf7b58e8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:29.480915 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9452e5b8-81ad-4e1c-8ed7-c27aaf7b58e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b2a13d094e4957aac9f9aba52c2d2d', 'request_id': 'req-9452e5b8-81ad-4e1c-8ed7-c27aaf7b58e8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:29.500887 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9452e5b8-81ad-4e1c-8ed7-c27aaf7b58e8 admin admin] The token cache is being invalidate because project 38b2a13d094e4957aac9f9aba52c2d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:29.501374 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9452e5b8-81ad-4e1c-8ed7-c27aaf7b58e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:29.502439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9452e5b8-81ad-4e1c-8ed7-c27aaf7b58e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:29.509676 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1252/2518] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:29 2022] DELETE /identity/v3/projects/38b2a13d094e4957aac9f9aba52c2d2d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:29.512013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852c2a6-d8b0-4d5c-95cd-fca1b6f20299 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.512343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852c2a6-d8b0-4d5c-95cd-fca1b6f20299 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.512795 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852c2a6-d8b0-4d5c-95cd-fca1b6f20299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.542533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d852c2a6-d8b0-4d5c-95cd-fca1b6f20299 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:29.543910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d852c2a6-d8b0-4d5c-95cd-fca1b6f20299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:29.551544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19665ff4-02bd-48a1-be3e-4afafa8b14a1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.552997 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1253/2519] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:29.561338 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198fca-3535-495f-97b6-aa786d72f46e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.562592 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198fca-3535-495f-97b6-aa786d72f46e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.562858 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198fca-3535-495f-97b6-aa786d72f46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.566186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944038c0-5a92-4f68-ae3c-365c076ce400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.567283 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944038c0-5a92-4f68-ae3c-365c076ce400 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.567794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944038c0-5a92-4f68-ae3c-365c076ce400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.568296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944038c0-5a92-4f68-ae3c-365c076ce400 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.569461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944038c0-5a92-4f68-ae3c-365c076ce400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.573405 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944038c0-5a92-4f68-ae3c-365c076ce400 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.589532 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a6198fca-3535-495f-97b6-aa786d72f46e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:29.592559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a6198fca-3535-495f-97b6-aa786d72f46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:29.602158 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1254/2520] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:29.606510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1267/2521] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:29 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:29.606935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198fca-3535-495f-97b6-aa786d72f46e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.610274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944038c0-5a92-4f68-ae3c-365c076ce400 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.612168 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-944038c0-5a92-4f68-ae3c-365c076ce400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:29.616427 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198fca-3535-495f-97b6-aa786d72f46e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.621228 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45fb5c-fb0b-4a61-a71a-07f69ebf63f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.621895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45fb5c-fb0b-4a61-a71a-07f69ebf63f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.622181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45fb5c-fb0b-4a61-a71a-07f69ebf63f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.622455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45fb5c-fb0b-4a61-a71a-07f69ebf63f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.623095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45fb5c-fb0b-4a61-a71a-07f69ebf63f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:29.623419 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45fb5c-fb0b-4a61-a71a-07f69ebf63f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.624996 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944038c0-5a92-4f68-ae3c-365c076ce400 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.625774 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45fb5c-fb0b-4a61-a71a-07f69ebf63f0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.629711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61719d8b-f0b7-4c0a-8bec-5494898da5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.630301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61719d8b-f0b7-4c0a-8bec-5494898da5bc admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.630611 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61719d8b-f0b7-4c0a-8bec-5494898da5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.630885 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61719d8b-f0b7-4c0a-8bec-5494898da5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.631522 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61719d8b-f0b7-4c0a-8bec-5494898da5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.633123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61719d8b-f0b7-4c0a-8bec-5494898da5bc admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.642024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1255/2522] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:29:29.643007 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45fb5c-fb0b-4a61-a71a-07f69ebf63f0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.647880 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1268/2523] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:29.648820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61719d8b-f0b7-4c0a-8bec-5494898da5bc admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.653217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45fb5c-fb0b-4a61-a71a-07f69ebf63f0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.658472 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61719d8b-f0b7-4c0a-8bec-5494898da5bc admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.658709 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4263f-bca8-41c0-93a0-5e9f62f4984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.659257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4263f-bca8-41c0-93a0-5e9f62f4984a admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.659533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4263f-bca8-41c0-93a0-5e9f62f4984a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.659804 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4263f-bca8-41c0-93a0-5e9f62f4984a admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.660445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4263f-bca8-41c0-93a0-5e9f62f4984a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.662366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4263f-bca8-41c0-93a0-5e9f62f4984a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.663126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01074ef-3de8-446e-bccd-69d3a9c0c714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.663761 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01074ef-3de8-446e-bccd-69d3a9c0c714 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.664041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01074ef-3de8-446e-bccd-69d3a9c0c714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.664317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01074ef-3de8-446e-bccd-69d3a9c0c714 admin admin] PATH_INFO: `/v3/projects/33cae791694b4b4a90c987d0d4887c02/users/ede596acbc18459db0d502527bcd4e80/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.680503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01074ef-3de8-446e-bccd-69d3a9c0c714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33cae791694b4b4a90c987d0d4887c02, user_id=ede596acbc18459db0d502527bcd4e80, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.683348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01074ef-3de8-446e-bccd-69d3a9c0c714 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.693326 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1256/2524] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:29 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:29.697396 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1269/2525] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:29 2022] PUT /identity/v3/projects/33cae791694b4b4a90c987d0d4887c02/users/ede596acbc18459db0d502527bcd4e80/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:29.697533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4263f-bca8-41c0-93a0-5e9f62f4984a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.701096 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01074ef-3de8-446e-bccd-69d3a9c0c714 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.760112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4263f-bca8-41c0-93a0-5e9f62f4984a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.764893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e4a57-9a11-44b0-8f2f-75672787faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.765542 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e4a57-9a11-44b0-8f2f-75672787faf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.765732 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01074ef-3de8-446e-bccd-69d3a9c0c714 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.765844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e4a57-9a11-44b0-8f2f-75672787faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.766115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e4a57-9a11-44b0-8f2f-75672787faf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.766748 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e4a57-9a11-44b0-8f2f-75672787faf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.768698 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e4a57-9a11-44b0-8f2f-75672787faf1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.770408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ce9dd-3aec-43c0-b842-aae828f65cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.771004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ce9dd-3aec-43c0-b842-aae828f65cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.771296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ce9dd-3aec-43c0-b842-aae828f65cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.771550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ce9dd-3aec-43c0-b842-aae828f65cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.772203 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ce9dd-3aec-43c0-b842-aae828f65cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.773795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ce9dd-3aec-43c0-b842-aae828f65cc7 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.785132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1270/2526] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:29.789099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ce9dd-3aec-43c0-b842-aae828f65cc7 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.793023 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1257/2527] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:29 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:29.794006 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e4a57-9a11-44b0-8f2f-75672787faf1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.800111 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ce9dd-3aec-43c0-b842-aae828f65cc7 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.804062 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e4a57-9a11-44b0-8f2f-75672787faf1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.804799 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e30453-32c1-4f9c-bf9d-ae31270330b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.805434 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e30453-32c1-4f9c-bf9d-ae31270330b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.805739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e30453-32c1-4f9c-bf9d-ae31270330b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.806012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e30453-32c1-4f9c-bf9d-ae31270330b3 admin admin] PATH_INFO: `/v3/projects/33cae791694b4b4a90c987d0d4887c02/users/ede596acbc18459db0d502527bcd4e80/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.807891 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e30453-32c1-4f9c-bf9d-ae31270330b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33cae791694b4b4a90c987d0d4887c02, user_id=ede596acbc18459db0d502527bcd4e80, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.808860 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3222cb-ae05-4f75-b3c0-cfe2d57d4df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.809438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3222cb-ae05-4f75-b3c0-cfe2d57d4df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.809743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3222cb-ae05-4f75-b3c0-cfe2d57d4df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.810020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3222cb-ae05-4f75-b3c0-cfe2d57d4df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.810520 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e30453-32c1-4f9c-bf9d-ae31270330b3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.810648 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3222cb-ae05-4f75-b3c0-cfe2d57d4df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.812800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3222cb-ae05-4f75-b3c0-cfe2d57d4df9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.814491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:29.823145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1258/2528] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:29.823771 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1271/2529] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:29 2022] PUT /identity/v3/projects/33cae791694b4b4a90c987d0d4887c02/users/ede596acbc18459db0d502527bcd4e80/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:29.827060 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3222cb-ae05-4f75-b3c0-cfe2d57d4df9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.837126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c317a-6762-479a-abb3-be9413c05350 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.837504 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c317a-6762-479a-abb3-be9413c05350 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.837890 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c317a-6762-479a-abb3-be9413c05350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.840663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3222cb-ae05-4f75-b3c0-cfe2d57d4df9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.868674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-102c317a-6762-479a-abb3-be9413c05350 None None] MFA Rules not processed for user `ede596acbc18459db0d502527bcd4e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:29.869966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-102c317a-6762-479a-abb3-be9413c05350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:29.902989 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5becf0-494b-46f8-b969-0fe64582a7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.903648 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5becf0-494b-46f8-b969-0fe64582a7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.903934 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5becf0-494b-46f8-b969-0fe64582a7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.904213 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5becf0-494b-46f8-b969-0fe64582a7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.904852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5becf0-494b-46f8-b969-0fe64582a7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.906709 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5becf0-494b-46f8-b969-0fe64582a7b7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.911815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:29.920228 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1259/2530] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:29.922077 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5becf0-494b-46f8-b969-0fe64582a7b7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.933908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5becf0-494b-46f8-b969-0fe64582a7b7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:29.940887 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d429c5-cae9-46db-ba85-d7188f86e712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:29.941586 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d429c5-cae9-46db-ba85-d7188f86e712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.941916 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d429c5-cae9-46db-ba85-d7188f86e712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.942263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d429c5-cae9-46db-ba85-d7188f86e712 admin admin] PATH_INFO: `/v3/projects/0f81699ce28046e685d0f0d729aefc70/users/52b0dffd1cae4cdba59c35ed3c6d1db0/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:29.942503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1272/2531] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:29.955207 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c317a-6762-479a-abb3-be9413c05350 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:29.956895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-102c317a-6762-479a-abb3-be9413c05350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:29.959980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d429c5-cae9-46db-ba85-d7188f86e712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f81699ce28046e685d0f0d729aefc70, user_id=52b0dffd1cae4cdba59c35ed3c6d1db0, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:29.962680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d429c5-cae9-46db-ba85-d7188f86e712 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:29.977777 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1260/2532] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:29 2022] PUT /identity/v3/projects/0f81699ce28046e685d0f0d729aefc70/users/52b0dffd1cae4cdba59c35ed3c6d1db0/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:29.981261 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2127bf-7814-4261-9d8b-dd30872e30a7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:29.981542 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2127bf-7814-4261-9d8b-dd30872e30a7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:29.981849 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2127bf-7814-4261-9d8b-dd30872e30a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:30.002407 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8a2127bf-7814-4261-9d8b-dd30872e30a7 None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:30.003619 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8a2127bf-7814-4261-9d8b-dd30872e30a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:30.023025 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c317a-6762-479a-abb3-be9413c05350 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:30.058771 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1261/2533] 10.222.0.57 () {58 vars in 967 bytes} [Tue Sep 27 17:29:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:30.060454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6526c-33f4-4c5d-a975-e3658bb5bd77 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:30.060822 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6526c-33f4-4c5d-a975-e3658bb5bd77 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:30.061155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6526c-33f4-4c5d-a975-e3658bb5bd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:30.080248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4b782-88e5-45aa-a4c0-c4317ab9a61d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:30.080859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4b782-88e5-45aa-a4c0-c4317ab9a61d service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:30.081135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4b782-88e5-45aa-a4c0-c4317ab9a61d service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:30.081403 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4b782-88e5-45aa-a4c0-c4317ab9a61d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:30.091757 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3db6526c-33f4-4c5d-a975-e3658bb5bd77 None None] MFA Rules not processed for user `52b0dffd1cae4cdba59c35ed3c6d1db0`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:30.093735 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3db6526c-33f4-4c5d-a975-e3658bb5bd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:30.133359 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:30.147277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4b782-88e5-45aa-a4c0-c4317ab9a61d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:30.149000 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4b782-88e5-45aa-a4c0-c4317ab9a61d service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:30.160198 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1262/2534] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:30.161193 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6526c-33f4-4c5d-a975-e3658bb5bd77 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:30.162485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3db6526c-33f4-4c5d-a975-e3658bb5bd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:30.164935 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1273/2535] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:30.191673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4b782-88e5-45aa-a4c0-c4317ab9a61d service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:30.193343 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c6b4b782-88e5-45aa-a4c0-c4317ab9a61d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:30.212791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4b782-88e5-45aa-a4c0-c4317ab9a61d service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:30.216725 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58099be3-fac6-4d91-91ae-3c30e4c628a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:30.217332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58099be3-fac6-4d91-91ae-3c30e4c628a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:30.218238 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58099be3-fac6-4d91-91ae-3c30e4c628a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:30.218613 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58099be3-fac6-4d91-91ae-3c30e4c628a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:30.228429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58099be3-fac6-4d91-91ae-3c30e4c628a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:30.229393 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58099be3-fac6-4d91-91ae-3c30e4c628a8 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:30.240780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1274/2536] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:30.253546 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6526c-33f4-4c5d-a975-e3658bb5bd77 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:30.258971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335ac51-9983-4cd3-b44a-f2d4ca1af082 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:30.259655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335ac51-9983-4cd3-b44a-f2d4ca1af082 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:30.260004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335ac51-9983-4cd3-b44a-f2d4ca1af082 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:30.260354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335ac51-9983-4cd3-b44a-f2d4ca1af082 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:30.269530 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335ac51-9983-4cd3-b44a-f2d4ca1af082 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:30.271163 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335ac51-9983-4cd3-b44a-f2d4ca1af082 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:30.283275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:30.293854 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1263/2537] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:29:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 17:29:31.879388 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58099be3-fac6-4d91-91ae-3c30e4c628a8 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:31.946320 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58099be3-fac6-4d91-91ae-3c30e4c628a8 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:31.950933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436dd9bd-3da8-4ae4-902d-d783e05cc02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:31.951555 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dd9bd-3da8-4ae4-902d-d783e05cc02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:31.951860 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dd9bd-3da8-4ae4-902d-d783e05cc02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:31.952850 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dd9bd-3da8-4ae4-902d-d783e05cc02c admin admin] PATH_INFO: `/v3/users/9a3d860677b048c9b1e03d558a935c66` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:31.954186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436dd9bd-3da8-4ae4-902d-d783e05cc02c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3d860677b048c9b1e03d558a935c66)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:31.956106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436dd9bd-3da8-4ae4-902d-d783e05cc02c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:32.025445 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-436dd9bd-3da8-4ae4-902d-d783e05cc02c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3d860677b048c9b1e03d558a935c66'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:32.026250 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-436dd9bd-3da8-4ae4-902d-d783e05cc02c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3d860677b048c9b1e03d558a935c66'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:32.037293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-436dd9bd-3da8-4ae4-902d-d783e05cc02c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3d860677b048c9b1e03d558a935c66'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:32.066300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-436dd9bd-3da8-4ae4-902d-d783e05cc02c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3d860677b048c9b1e03d558a935c66'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:32.078957 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-436dd9bd-3da8-4ae4-902d-d783e05cc02c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3d860677b048c9b1e03d558a935c66'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:32.091507 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1275/2538] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:31 2022] DELETE /identity/v3/users/9a3d860677b048c9b1e03d558a935c66 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:32.096857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0abf1-d850-4612-947b-2370c9fb3250 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:32.097304 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0abf1-d850-4612-947b-2370c9fb3250 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:32.097478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0abf1-d850-4612-947b-2370c9fb3250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:32.117431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fcc0abf1-d850-4612-947b-2370c9fb3250 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:32.119579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fcc0abf1-d850-4612-947b-2370c9fb3250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:32.205933 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1264/2539] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:32.216436 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436dd9bd-3da8-4ae4-902d-d783e05cc02c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:32.218631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-436dd9bd-3da8-4ae4-902d-d783e05cc02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:32.287484 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436dd9bd-3da8-4ae4-902d-d783e05cc02c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:32.291265 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921b1c2-5660-4123-903f-c357f33a9493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:32.292012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921b1c2-5660-4123-903f-c357f33a9493 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:32.292349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921b1c2-5660-4123-903f-c357f33a9493 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:32.292570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921b1c2-5660-4123-903f-c357f33a9493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:32.300589 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:32.303275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921b1c2-5660-4123-903f-c357f33a9493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:32.305012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921b1c2-5660-4123-903f-c357f33a9493 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:32.325378 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1276/2540] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:32.613978 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0abf1-d850-4612-947b-2370c9fb3250 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:32.615586 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fcc0abf1-d850-4612-947b-2370c9fb3250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:32.629955 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0abf1-d850-4612-947b-2370c9fb3250 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:32.635184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba21d0-810a-4f27-85da-e5b99d5ab593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:32.635812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba21d0-810a-4f27-85da-e5b99d5ab593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:32.636259 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba21d0-810a-4f27-85da-e5b99d5ab593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:32.636599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba21d0-810a-4f27-85da-e5b99d5ab593 admin admin] PATH_INFO: `/v3/projects/84249c90a2dc4acca20abe3233c2c4b3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:32.637922 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba21d0-810a-4f27-85da-e5b99d5ab593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84249c90a2dc4acca20abe3233c2c4b3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:32.640430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba21d0-810a-4f27-85da-e5b99d5ab593 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:32.685931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-caba21d0-810a-4f27-85da-e5b99d5ab593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84249c90a2dc4acca20abe3233c2c4b3', 'request_id': 'req-caba21d0-810a-4f27-85da-e5b99d5ab593'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:32.692058 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-caba21d0-810a-4f27-85da-e5b99d5ab593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84249c90a2dc4acca20abe3233c2c4b3', 'request_id': 'req-caba21d0-810a-4f27-85da-e5b99d5ab593'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:32.698106 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-caba21d0-810a-4f27-85da-e5b99d5ab593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84249c90a2dc4acca20abe3233c2c4b3', 'request_id': 'req-caba21d0-810a-4f27-85da-e5b99d5ab593'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:32.710809 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-caba21d0-810a-4f27-85da-e5b99d5ab593 admin admin] The token cache is being invalidate because project 84249c90a2dc4acca20abe3233c2c4b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:32.711221 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-caba21d0-810a-4f27-85da-e5b99d5ab593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:32.711864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-caba21d0-810a-4f27-85da-e5b99d5ab593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:32.713378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1265/2541] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:32 2022] DELETE /identity/v3/projects/84249c90a2dc4acca20abe3233c2c4b3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:32.717596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921b1c2-5660-4123-903f-c357f33a9493 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:32.727495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921b1c2-5660-4123-903f-c357f33a9493 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:32.783379 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db96126-05d0-4c68-bd39-fe748bc387ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:32.784003 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db96126-05d0-4c68-bd39-fe748bc387ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:32.784283 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db96126-05d0-4c68-bd39-fe748bc387ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:32.784556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db96126-05d0-4c68-bd39-fe748bc387ae admin admin] PATH_INFO: `/v3/users/ede596acbc18459db0d502527bcd4e80` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:32.785703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db96126-05d0-4c68-bd39-fe748bc387ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede596acbc18459db0d502527bcd4e80)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:32.787604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db96126-05d0-4c68-bd39-fe748bc387ae admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:32.832830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4db96126-05d0-4c68-bd39-fe748bc387ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede596acbc18459db0d502527bcd4e80'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:32.833392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4db96126-05d0-4c68-bd39-fe748bc387ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede596acbc18459db0d502527bcd4e80'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:32.840491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4db96126-05d0-4c68-bd39-fe748bc387ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede596acbc18459db0d502527bcd4e80'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:32.852568 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4db96126-05d0-4c68-bd39-fe748bc387ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede596acbc18459db0d502527bcd4e80'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:32.859821 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4db96126-05d0-4c68-bd39-fe748bc387ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede596acbc18459db0d502527bcd4e80'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:32.865517 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1277/2542] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:32 2022] DELETE /identity/v3/users/ede596acbc18459db0d502527bcd4e80 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:33.131993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba21d0-810a-4f27-85da-e5b99d5ab593 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:33.133570 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-caba21d0-810a-4f27-85da-e5b99d5ab593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:33.146709 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba21d0-810a-4f27-85da-e5b99d5ab593 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:33.209787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31999c41-9d03-4f87-9219-c77d38e3a49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:33.210416 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31999c41-9d03-4f87-9219-c77d38e3a49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:33.210690 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31999c41-9d03-4f87-9219-c77d38e3a49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:33.210958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31999c41-9d03-4f87-9219-c77d38e3a49f admin admin] PATH_INFO: `/v3/projects/33cae791694b4b4a90c987d0d4887c02` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:33.212105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31999c41-9d03-4f87-9219-c77d38e3a49f admin admin] RBAC: Authorizing `identity:delete_project(project_id=33cae791694b4b4a90c987d0d4887c02)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:33.214815 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31999c41-9d03-4f87-9219-c77d38e3a49f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:33.252466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:33.270352 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-31999c41-9d03-4f87-9219-c77d38e3a49f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33cae791694b4b4a90c987d0d4887c02', 'request_id': 'req-31999c41-9d03-4f87-9219-c77d38e3a49f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:33.275897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-31999c41-9d03-4f87-9219-c77d38e3a49f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33cae791694b4b4a90c987d0d4887c02', 'request_id': 'req-31999c41-9d03-4f87-9219-c77d38e3a49f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:33.282841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-31999c41-9d03-4f87-9219-c77d38e3a49f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33cae791694b4b4a90c987d0d4887c02', 'request_id': 'req-31999c41-9d03-4f87-9219-c77d38e3a49f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:33.305949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-31999c41-9d03-4f87-9219-c77d38e3a49f admin admin] The token cache is being invalidate because project 33cae791694b4b4a90c987d0d4887c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:33.305949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-31999c41-9d03-4f87-9219-c77d38e3a49f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:33.305949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-31999c41-9d03-4f87-9219-c77d38e3a49f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:33.305949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1266/2543] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:33 2022] DELETE /identity/v3/projects/33cae791694b4b4a90c987d0d4887c02 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:33.306295 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8636057-ca82-40f8-8b94-291252bbb624 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:33.306295 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8636057-ca82-40f8-8b94-291252bbb624 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:33.306295 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8636057-ca82-40f8-8b94-291252bbb624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:33.324369 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e8636057-ca82-40f8-8b94-291252bbb624 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:33.325795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e8636057-ca82-40f8-8b94-291252bbb624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:33.391148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1278/2544] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:33.398583 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84464bd9-a8c1-4178-82b9-e760b034e6dd None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:33.398873 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84464bd9-a8c1-4178-82b9-e760b034e6dd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:33.399152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84464bd9-a8c1-4178-82b9-e760b034e6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:33.420475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-84464bd9-a8c1-4178-82b9-e760b034e6dd None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:33.422286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-84464bd9-a8c1-4178-82b9-e760b034e6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:33.430765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1267/2545] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:33.435022 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8636057-ca82-40f8-8b94-291252bbb624 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:33.447076 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8636057-ca82-40f8-8b94-291252bbb624 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:33.452872 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24c14-be07-463f-b57e-51213324c3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:33.453534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24c14-be07-463f-b57e-51213324c3cf admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:33.453921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24c14-be07-463f-b57e-51213324c3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:33.454171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24c14-be07-463f-b57e-51213324c3cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:33.454803 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c24c14-be07-463f-b57e-51213324c3cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:33.455101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c24c14-be07-463f-b57e-51213324c3cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:33.456713 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c24c14-be07-463f-b57e-51213324c3cf admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:33.469969 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1279/2546] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:29:33.475275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84464bd9-a8c1-4178-82b9-e760b034e6dd None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:33.484675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84464bd9-a8c1-4178-82b9-e760b034e6dd None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:33.489373 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b2262-73d8-4884-ae61-0110fa05be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:33.490005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b2262-73d8-4884-ae61-0110fa05be26 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:33.490299 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b2262-73d8-4884-ae61-0110fa05be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:33.490557 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b2262-73d8-4884-ae61-0110fa05be26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:33.491186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b2262-73d8-4884-ae61-0110fa05be26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:33.493076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b2262-73d8-4884-ae61-0110fa05be26 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:33.524101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1268/2547] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:33 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:33.529252 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24c14-be07-463f-b57e-51213324c3cf admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:33.537201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:33.544009 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24c14-be07-463f-b57e-51213324c3cf admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:33.681898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db4681-25bc-46be-8a98-043b50bff86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:33.682958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db4681-25bc-46be-8a98-043b50bff86c admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:33.683636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db4681-25bc-46be-8a98-043b50bff86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:33.684134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db4681-25bc-46be-8a98-043b50bff86c admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:33.685292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db4681-25bc-46be-8a98-043b50bff86c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:33.690747 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db4681-25bc-46be-8a98-043b50bff86c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:33.733268 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1280/2548] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:33 2022] POST /identity/v3/users => generated 284 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:33.737536 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b2262-73d8-4884-ae61-0110fa05be26 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:33.751775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b2262-73d8-4884-ae61-0110fa05be26 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:33.759716 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa6a4a-23b3-444f-b0ee-d6aa1f54945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:33.760595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa6a4a-23b3-444f-b0ee-d6aa1f54945c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:33.760910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa6a4a-23b3-444f-b0ee-d6aa1f54945c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:33.761350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa6a4a-23b3-444f-b0ee-d6aa1f54945c admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:33.762485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa6a4a-23b3-444f-b0ee-d6aa1f54945c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:33.765565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa6a4a-23b3-444f-b0ee-d6aa1f54945c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:33.777169 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1269/2549] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:33.782338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db4681-25bc-46be-8a98-043b50bff86c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:33.792544 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db4681-25bc-46be-8a98-043b50bff86c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:33.797764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291652d-2fee-4a83-9603-c26c9a169221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:33.798475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291652d-2fee-4a83-9603-c26c9a169221 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:33.798763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291652d-2fee-4a83-9603-c26c9a169221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:33.799092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291652d-2fee-4a83-9603-c26c9a169221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:33.799678 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291652d-2fee-4a83-9603-c26c9a169221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:33.801314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291652d-2fee-4a83-9603-c26c9a169221 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:33.813635 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1281/2550] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:33.818901 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa6a4a-23b3-444f-b0ee-d6aa1f54945c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:33.829909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa6a4a-23b3-444f-b0ee-d6aa1f54945c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:33.834674 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b75a6-92de-4a65-a229-96962e66cf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:33.835327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b75a6-92de-4a65-a229-96962e66cf41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:33.835664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b75a6-92de-4a65-a229-96962e66cf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:33.835993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b75a6-92de-4a65-a229-96962e66cf41 admin admin] PATH_INFO: `/v3/projects/bc4df98d6a1543d99857f859f0140795/users/2b0efabdcbbc4f298f9ead5186420dc2/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:33.854243 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b75a6-92de-4a65-a229-96962e66cf41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4df98d6a1543d99857f859f0140795, user_id=2b0efabdcbbc4f298f9ead5186420dc2, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:33.856906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b75a6-92de-4a65-a229-96962e66cf41 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:33.884889 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1270/2551] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:33 2022] PUT /identity/v3/projects/bc4df98d6a1543d99857f859f0140795/users/2b0efabdcbbc4f298f9ead5186420dc2/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:33.897625 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb48e9-0c0a-47ff-90fe-f34cdc88a45e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:33.897903 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb48e9-0c0a-47ff-90fe-f34cdc88a45e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:33.909140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb48e9-0c0a-47ff-90fe-f34cdc88a45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:33.945835 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-3feb48e9-0c0a-47ff-90fe-f34cdc88a45e None None] MFA Rules not processed for user `2b0efabdcbbc4f298f9ead5186420dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:33.947151 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3feb48e9-0c0a-47ff-90fe-f34cdc88a45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:34.021976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1282/2552] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:34.026512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b75a6-92de-4a65-a229-96962e66cf41 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:34.088317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b75a6-92de-4a65-a229-96962e66cf41 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:34.093028 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11de945-bc12-4fcd-81bd-0172c29cd410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:34.093623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11de945-bc12-4fcd-81bd-0172c29cd410 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:34.093931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11de945-bc12-4fcd-81bd-0172c29cd410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:34.094203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11de945-bc12-4fcd-81bd-0172c29cd410 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:34.094820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11de945-bc12-4fcd-81bd-0172c29cd410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:34.096961 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11de945-bc12-4fcd-81bd-0172c29cd410 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:34.122779 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1271/2553] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:34 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:34.127670 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb48e9-0c0a-47ff-90fe-f34cdc88a45e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:34.138575 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb48e9-0c0a-47ff-90fe-f34cdc88a45e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:34.197555 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed3aef-f832-4594-be51-dbcc5a9cadfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:34.198198 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed3aef-f832-4594-be51-dbcc5a9cadfb admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:34.198480 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed3aef-f832-4594-be51-dbcc5a9cadfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:34.198756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed3aef-f832-4594-be51-dbcc5a9cadfb admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:34.199383 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed3aef-f832-4594-be51-dbcc5a9cadfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:34.201287 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed3aef-f832-4594-be51-dbcc5a9cadfb admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:34.218225 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:34.224031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1283/2554] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:34 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:34.227963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11de945-bc12-4fcd-81bd-0172c29cd410 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:34.239612 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11de945-bc12-4fcd-81bd-0172c29cd410 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:34.244393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600b45e-5cfb-4708-b2bb-a654bca7648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:34.245010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b45e-5cfb-4708-b2bb-a654bca7648e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:34.245273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b45e-5cfb-4708-b2bb-a654bca7648e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:34.245544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b45e-5cfb-4708-b2bb-a654bca7648e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:34.246227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600b45e-5cfb-4708-b2bb-a654bca7648e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:34.247855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600b45e-5cfb-4708-b2bb-a654bca7648e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:34.258431 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1272/2555] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:34.262554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed3aef-f832-4594-be51-dbcc5a9cadfb admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:34.272903 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed3aef-f832-4594-be51-dbcc5a9cadfb admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:34.277465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642c383-30dd-4652-9e66-8dc6734421ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:34.278142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642c383-30dd-4652-9e66-8dc6734421ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:34.278424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642c383-30dd-4652-9e66-8dc6734421ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:34.278697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642c383-30dd-4652-9e66-8dc6734421ad admin admin] PATH_INFO: `/v3/projects/ee3ef6efc9734116a1bba537cb9977c7/users/477a3dccfe27410397f31753678a4dc4/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:34.294133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642c383-30dd-4652-9e66-8dc6734421ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3ef6efc9734116a1bba537cb9977c7, user_id=477a3dccfe27410397f31753678a4dc4, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:34.296866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642c383-30dd-4652-9e66-8dc6734421ad admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:34.309107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1284/2556] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:34 2022] PUT /identity/v3/projects/ee3ef6efc9734116a1bba537cb9977c7/users/477a3dccfe27410397f31753678a4dc4/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:34.313003 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600b45e-5cfb-4708-b2bb-a654bca7648e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:34.323015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600b45e-5cfb-4708-b2bb-a654bca7648e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:34.343803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:34.381875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f73ec5-e5d4-4dbc-9ccd-04197c7eb8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:34.382480 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f73ec5-e5d4-4dbc-9ccd-04197c7eb8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:34.382761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f73ec5-e5d4-4dbc-9ccd-04197c7eb8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:34.383035 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f73ec5-e5d4-4dbc-9ccd-04197c7eb8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:34.383673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f73ec5-e5d4-4dbc-9ccd-04197c7eb8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:34.385262 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f73ec5-e5d4-4dbc-9ccd-04197c7eb8c8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:34.395786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1273/2557] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:34.399869 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642c383-30dd-4652-9e66-8dc6734421ad admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:34.410754 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642c383-30dd-4652-9e66-8dc6734421ad admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:34.415551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dbf6d-84ed-4c0a-9d1f-92d699e1f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:34.416205 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dbf6d-84ed-4c0a-9d1f-92d699e1f540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:34.416490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dbf6d-84ed-4c0a-9d1f-92d699e1f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:34.416764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dbf6d-84ed-4c0a-9d1f-92d699e1f540 admin admin] PATH_INFO: `/v3/projects/ee3ef6efc9734116a1bba537cb9977c7/users/477a3dccfe27410397f31753678a4dc4/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:34.418741 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dbf6d-84ed-4c0a-9d1f-92d699e1f540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3ef6efc9734116a1bba537cb9977c7, user_id=477a3dccfe27410397f31753678a4dc4, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:34.421905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dbf6d-84ed-4c0a-9d1f-92d699e1f540 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:34.432906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1285/2558] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:34 2022] PUT /identity/v3/projects/ee3ef6efc9734116a1bba537cb9977c7/users/477a3dccfe27410397f31753678a4dc4/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:34.443187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aa638-1274-434b-a4b2-60557c13736d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:34.443478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aa638-1274-434b-a4b2-60557c13736d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:34.443754 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aa638-1274-434b-a4b2-60557c13736d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:34.472477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-183aa638-1274-434b-a4b2-60557c13736d None None] MFA Rules not processed for user `477a3dccfe27410397f31753678a4dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:34.473601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-183aa638-1274-434b-a4b2-60557c13736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:34.540184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1274/2559] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:34.551706 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dbf6d-84ed-4c0a-9d1f-92d699e1f540 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:34.553374 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-429dbf6d-84ed-4c0a-9d1f-92d699e1f540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:34.610794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dbf6d-84ed-4c0a-9d1f-92d699e1f540 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:34.614458 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87c333-d9e1-40fb-9d18-29887f286114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:34.615055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87c333-d9e1-40fb-9d18-29887f286114 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:34.615332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87c333-d9e1-40fb-9d18-29887f286114 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:34.615600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87c333-d9e1-40fb-9d18-29887f286114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:34.624982 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87c333-d9e1-40fb-9d18-29887f286114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:34.626425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87c333-d9e1-40fb-9d18-29887f286114 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:34.635667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1286/2560] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:34.679531 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aa638-1274-434b-a4b2-60557c13736d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:34.680950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-183aa638-1274-434b-a4b2-60557c13736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:34.693434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aa638-1274-434b-a4b2-60557c13736d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:34.697078 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2f89c-d309-4aad-87b6-659287fe8bce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:34.697671 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2f89c-d309-4aad-87b6-659287fe8bce service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:34.697983 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2f89c-d309-4aad-87b6-659287fe8bce service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:34.698252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2f89c-d309-4aad-87b6-659287fe8bce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:34.754563 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2f89c-d309-4aad-87b6-659287fe8bce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:34.755924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2f89c-d309-4aad-87b6-659287fe8bce service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:34.765217 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1275/2561] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:38.324991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87c333-d9e1-40fb-9d18-29887f286114 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:38.374895 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2f89c-d309-4aad-87b6-659287fe8bce service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:38.376371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ace2f89c-d309-4aad-87b6-659287fe8bce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:38.391077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87c333-d9e1-40fb-9d18-29887f286114 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:38.395858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9f2f5-5766-4d86-b76b-022ca83622ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:38.396482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f2f5-5766-4d86-b76b-022ca83622ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:38.396757 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f2f5-5766-4d86-b76b-022ca83622ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:38.397025 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f2f5-5766-4d86-b76b-022ca83622ff admin admin] PATH_INFO: `/v3/users/2b0efabdcbbc4f298f9ead5186420dc2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:38.398157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9f2f5-5766-4d86-b76b-022ca83622ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0efabdcbbc4f298f9ead5186420dc2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:38.400043 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9f2f5-5766-4d86-b76b-022ca83622ff admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:38.436508 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:38.450899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5df9f2f5-5766-4d86-b76b-022ca83622ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0efabdcbbc4f298f9ead5186420dc2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:38.451569 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5df9f2f5-5766-4d86-b76b-022ca83622ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0efabdcbbc4f298f9ead5186420dc2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:38.457335 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2f89c-d309-4aad-87b6-659287fe8bce service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:38.460433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5df9f2f5-5766-4d86-b76b-022ca83622ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0efabdcbbc4f298f9ead5186420dc2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:38.462253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c2182-34ad-44de-a627-db307189aef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:38.462880 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c2182-34ad-44de-a627-db307189aef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:38.463164 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c2182-34ad-44de-a627-db307189aef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:38.463438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c2182-34ad-44de-a627-db307189aef6 admin admin] PATH_INFO: `/v3/users/80ff60dc52644e87aaf2f97422feaa14` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:38.464565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c2182-34ad-44de-a627-db307189aef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ff60dc52644e87aaf2f97422feaa14)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:38.466517 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c2182-34ad-44de-a627-db307189aef6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:38.472488 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:38.474692 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5df9f2f5-5766-4d86-b76b-022ca83622ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0efabdcbbc4f298f9ead5186420dc2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:38.484525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5df9f2f5-5766-4d86-b76b-022ca83622ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0efabdcbbc4f298f9ead5186420dc2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:38.490479 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1287/2562] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:38 2022] DELETE /identity/v3/users/2b0efabdcbbc4f298f9ead5186420dc2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:38.495390 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5035915-8521-4009-9953-e866f40b4a21 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:38.495918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5035915-8521-4009-9953-e866f40b4a21 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:38.496292 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5035915-8521-4009-9953-e866f40b4a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:38.516893 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e5035915-8521-4009-9953-e866f40b4a21 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:38.517278 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bc7c2182-34ad-44de-a627-db307189aef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ff60dc52644e87aaf2f97422feaa14'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:38.518921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e5035915-8521-4009-9953-e866f40b4a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:38.525654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bc7c2182-34ad-44de-a627-db307189aef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ff60dc52644e87aaf2f97422feaa14'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:38.539657 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bc7c2182-34ad-44de-a627-db307189aef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ff60dc52644e87aaf2f97422feaa14'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:38.547339 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bc7c2182-34ad-44de-a627-db307189aef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ff60dc52644e87aaf2f97422feaa14'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:38.548069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bc7c2182-34ad-44de-a627-db307189aef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ff60dc52644e87aaf2f97422feaa14'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:38.554135 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1276/2563] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:38 2022] DELETE /identity/v3/users/80ff60dc52644e87aaf2f97422feaa14 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:38.558481 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927889bc-1032-4233-be08-19cc69310c9e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:38.558764 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927889bc-1032-4233-be08-19cc69310c9e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:38.559034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927889bc-1032-4233-be08-19cc69310c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:38.579681 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-927889bc-1032-4233-be08-19cc69310c9e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:38.580864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-927889bc-1032-4233-be08-19cc69310c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:38.582423 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1288/2564] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:38.593014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5035915-8521-4009-9953-e866f40b4a21 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:38.594555 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e5035915-8521-4009-9953-e866f40b4a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:38.646016 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1277/2565] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:38.656720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927889bc-1032-4233-be08-19cc69310c9e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:38.656905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5035915-8521-4009-9953-e866f40b4a21 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:38.658157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-927889bc-1032-4233-be08-19cc69310c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:38.711656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2e6de-e581-4cfa-9a94-02c9efd43a36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:38.712327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2e6de-e581-4cfa-9a94-02c9efd43a36 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:38.712617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2e6de-e581-4cfa-9a94-02c9efd43a36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:38.712942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2e6de-e581-4cfa-9a94-02c9efd43a36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:38.725081 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2e6de-e581-4cfa-9a94-02c9efd43a36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:38.726733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2e6de-e581-4cfa-9a94-02c9efd43a36 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:38.729550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927889bc-1032-4233-be08-19cc69310c9e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:38.733037 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b6839-deac-4d4f-b269-bebef002964a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:38.733862 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b6839-deac-4d4f-b269-bebef002964a service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:38.734282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b6839-deac-4d4f-b269-bebef002964a service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:38.734450 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b6839-deac-4d4f-b269-bebef002964a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:38.737426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1289/2566] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:38.745053 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b6839-deac-4d4f-b269-bebef002964a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:38.746802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b6839-deac-4d4f-b269-bebef002964a service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:38.759540 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1278/2567] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:39.042233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2e6de-e581-4cfa-9a94-02c9efd43a36 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:39.043757 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7ce2e6de-e581-4cfa-9a94-02c9efd43a36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:39.079293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2e6de-e581-4cfa-9a94-02c9efd43a36 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:39.094595 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715830bc-71c6-4849-a4c5-c4ea734558b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:39.094829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b6839-deac-4d4f-b269-bebef002964a service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:39.095622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715830bc-71c6-4849-a4c5-c4ea734558b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:39.095851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715830bc-71c6-4849-a4c5-c4ea734558b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:39.096124 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715830bc-71c6-4849-a4c5-c4ea734558b2 admin admin] PATH_INFO: `/v3/projects/bc4df98d6a1543d99857f859f0140795` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:39.096635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e03b6839-deac-4d4f-b269-bebef002964a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:39.104692 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715830bc-71c6-4849-a4c5-c4ea734558b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4df98d6a1543d99857f859f0140795)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:39.106690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715830bc-71c6-4849-a4c5-c4ea734558b2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:39.115731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b6839-deac-4d4f-b269-bebef002964a service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:39.122364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85a8d3-b092-473a-b094-6f6db7fc12a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:39.123213 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85a8d3-b092-473a-b094-6f6db7fc12a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:39.124350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85a8d3-b092-473a-b094-6f6db7fc12a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:39.124783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85a8d3-b092-473a-b094-6f6db7fc12a5 admin admin] PATH_INFO: `/v3/projects/d672f5faad6b4e7589edb4c0c3cbcc6a` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:39.128516 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85a8d3-b092-473a-b094-6f6db7fc12a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d672f5faad6b4e7589edb4c0c3cbcc6a)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:39.138718 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85a8d3-b092-473a-b094-6f6db7fc12a5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:39.141082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:39.156737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:39.165699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-715830bc-71c6-4849-a4c5-c4ea734558b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4df98d6a1543d99857f859f0140795', 'request_id': 'req-715830bc-71c6-4849-a4c5-c4ea734558b2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.173723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-715830bc-71c6-4849-a4c5-c4ea734558b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4df98d6a1543d99857f859f0140795', 'request_id': 'req-715830bc-71c6-4849-a4c5-c4ea734558b2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.190298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-715830bc-71c6-4849-a4c5-c4ea734558b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4df98d6a1543d99857f859f0140795', 'request_id': 'req-715830bc-71c6-4849-a4c5-c4ea734558b2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.204012 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3f85a8d3-b092-473a-b094-6f6db7fc12a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd672f5faad6b4e7589edb4c0c3cbcc6a', 'request_id': 'req-3f85a8d3-b092-473a-b094-6f6db7fc12a5'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.207081 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-715830bc-71c6-4849-a4c5-c4ea734558b2 admin admin] The token cache is being invalidate because project bc4df98d6a1543d99857f859f0140795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:39.207384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-715830bc-71c6-4849-a4c5-c4ea734558b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.208309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-715830bc-71c6-4849-a4c5-c4ea734558b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.210004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1290/2568] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:39 2022] DELETE /identity/v3/projects/bc4df98d6a1543d99857f859f0140795 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:39.213043 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3f85a8d3-b092-473a-b094-6f6db7fc12a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd672f5faad6b4e7589edb4c0c3cbcc6a', 'request_id': 'req-3f85a8d3-b092-473a-b094-6f6db7fc12a5'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.213931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715830bc-71c6-4849-a4c5-c4ea734558b2 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:39.215433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-715830bc-71c6-4849-a4c5-c4ea734558b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:39.218993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3f85a8d3-b092-473a-b094-6f6db7fc12a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd672f5faad6b4e7589edb4c0c3cbcc6a', 'request_id': 'req-3f85a8d3-b092-473a-b094-6f6db7fc12a5'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.235830 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3f85a8d3-b092-473a-b094-6f6db7fc12a5 admin admin] The token cache is being invalidate because project d672f5faad6b4e7589edb4c0c3cbcc6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:39.236377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3f85a8d3-b092-473a-b094-6f6db7fc12a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.237157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3f85a8d3-b092-473a-b094-6f6db7fc12a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.242050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1279/2569] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:39 2022] DELETE /identity/v3/projects/d672f5faad6b4e7589edb4c0c3cbcc6a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:39.244106 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85a8d3-b092-473a-b094-6f6db7fc12a5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:39.245968 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3f85a8d3-b092-473a-b094-6f6db7fc12a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:39.294770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715830bc-71c6-4849-a4c5-c4ea734558b2 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:39.318623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85a8d3-b092-473a-b094-6f6db7fc12a5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:39.323662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e6b3b-7a2f-41ee-b8b9-a03ce7b0ff00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:39.324024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e6b3b-7a2f-41ee-b8b9-a03ce7b0ff00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:39.324303 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e6b3b-7a2f-41ee-b8b9-a03ce7b0ff00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:39.324692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e6b3b-7a2f-41ee-b8b9-a03ce7b0ff00 admin admin] PATH_INFO: `/v3/users/e88f0ad8338347dbbb7cd37084d5d484` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:39.325876 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e6b3b-7a2f-41ee-b8b9-a03ce7b0ff00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88f0ad8338347dbbb7cd37084d5d484)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:39.328374 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e6b3b-7a2f-41ee-b8b9-a03ce7b0ff00 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:39.359547 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c7de9-ab0a-4a2b-a231-79ee44165dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:39.360249 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c7de9-ab0a-4a2b-a231-79ee44165dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:39.360685 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c7de9-ab0a-4a2b-a231-79ee44165dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:39.361053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c7de9-ab0a-4a2b-a231-79ee44165dcd admin admin] PATH_INFO: `/v3/users/477a3dccfe27410397f31753678a4dc4` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:39.363532 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c7de9-ab0a-4a2b-a231-79ee44165dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=477a3dccfe27410397f31753678a4dc4)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:39.366185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c7de9-ab0a-4a2b-a231-79ee44165dcd admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:39.383993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f69e6b3b-7a2f-41ee-b8b9-a03ce7b0ff00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88f0ad8338347dbbb7cd37084d5d484'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.394296 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f69e6b3b-7a2f-41ee-b8b9-a03ce7b0ff00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88f0ad8338347dbbb7cd37084d5d484'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.412635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f69e6b3b-7a2f-41ee-b8b9-a03ce7b0ff00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88f0ad8338347dbbb7cd37084d5d484'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.425923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f69e6b3b-7a2f-41ee-b8b9-a03ce7b0ff00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88f0ad8338347dbbb7cd37084d5d484'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.426885 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f69e6b3b-7a2f-41ee-b8b9-a03ce7b0ff00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88f0ad8338347dbbb7cd37084d5d484'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.435561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1280/2570] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:39 2022] DELETE /identity/v3/users/e88f0ad8338347dbbb7cd37084d5d484 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:39.438484 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-526c7de9-ab0a-4a2b-a231-79ee44165dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477a3dccfe27410397f31753678a4dc4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.442329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-526c7de9-ab0a-4a2b-a231-79ee44165dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477a3dccfe27410397f31753678a4dc4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.451119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-526c7de9-ab0a-4a2b-a231-79ee44165dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477a3dccfe27410397f31753678a4dc4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.467712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-526c7de9-ab0a-4a2b-a231-79ee44165dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477a3dccfe27410397f31753678a4dc4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.472798 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:39.476493 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-526c7de9-ab0a-4a2b-a231-79ee44165dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477a3dccfe27410397f31753678a4dc4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:39.486629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1291/2571] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:39 2022] DELETE /identity/v3/users/477a3dccfe27410397f31753678a4dc4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:39.803270 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e6b3b-7a2f-41ee-b8b9-a03ce7b0ff00 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:39.804856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f69e6b3b-7a2f-41ee-b8b9-a03ce7b0ff00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:39.823241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:39.892714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c7de9-ab0a-4a2b-a231-79ee44165dcd admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:39.894212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-526c7de9-ab0a-4a2b-a231-79ee44165dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:39.917008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e6b3b-7a2f-41ee-b8b9-a03ce7b0ff00 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:39.986794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c7de9-ab0a-4a2b-a231-79ee44165dcd admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:39.991834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dedd0-e95b-4a3f-831b-12f760d6ae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:39.992498 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dedd0-e95b-4a3f-831b-12f760d6ae09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:39.992778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dedd0-e95b-4a3f-831b-12f760d6ae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:39.993048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dedd0-e95b-4a3f-831b-12f760d6ae09 admin admin] PATH_INFO: `/v3/projects/ee3ef6efc9734116a1bba537cb9977c7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:39.993266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41352f-156d-4875-86b0-d67ddfe018ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:39.993928 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41352f-156d-4875-86b0-d67ddfe018ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:39.994220 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41352f-156d-4875-86b0-d67ddfe018ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:39.994395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dedd0-e95b-4a3f-831b-12f760d6ae09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3ef6efc9734116a1bba537cb9977c7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:39.994497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41352f-156d-4875-86b0-d67ddfe018ad admin admin] PATH_INFO: `/v3/projects/d0b80650798445d18136226554d2b40c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:39.995607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41352f-156d-4875-86b0-d67ddfe018ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0b80650798445d18136226554d2b40c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:39.996270 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dedd0-e95b-4a3f-831b-12f760d6ae09 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:39.997527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41352f-156d-4875-86b0-d67ddfe018ad admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.049639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-953dedd0-e95b-4a3f-831b-12f760d6ae09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3ef6efc9734116a1bba537cb9977c7', 'request_id': 'req-953dedd0-e95b-4a3f-831b-12f760d6ae09'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:40.053555 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8c41352f-156d-4875-86b0-d67ddfe018ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b80650798445d18136226554d2b40c', 'request_id': 'req-8c41352f-156d-4875-86b0-d67ddfe018ad'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:40.056633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-953dedd0-e95b-4a3f-831b-12f760d6ae09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3ef6efc9734116a1bba537cb9977c7', 'request_id': 'req-953dedd0-e95b-4a3f-831b-12f760d6ae09'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:40.059944 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8c41352f-156d-4875-86b0-d67ddfe018ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b80650798445d18136226554d2b40c', 'request_id': 'req-8c41352f-156d-4875-86b0-d67ddfe018ad'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:40.064950 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-953dedd0-e95b-4a3f-831b-12f760d6ae09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3ef6efc9734116a1bba537cb9977c7', 'request_id': 'req-953dedd0-e95b-4a3f-831b-12f760d6ae09'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:40.066720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8c41352f-156d-4875-86b0-d67ddfe018ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b80650798445d18136226554d2b40c', 'request_id': 'req-8c41352f-156d-4875-86b0-d67ddfe018ad'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:40.080780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-953dedd0-e95b-4a3f-831b-12f760d6ae09 admin admin] The token cache is being invalidate because project ee3ef6efc9734116a1bba537cb9977c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:40.081095 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-953dedd0-e95b-4a3f-831b-12f760d6ae09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:40.081709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-953dedd0-e95b-4a3f-831b-12f760d6ae09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:40.082994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8c41352f-156d-4875-86b0-d67ddfe018ad admin admin] The token cache is being invalidate because project d0b80650798445d18136226554d2b40c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:40.083303 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8c41352f-156d-4875-86b0-d67ddfe018ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:40.083426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1292/2572] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:39 2022] DELETE /identity/v3/projects/ee3ef6efc9734116a1bba537cb9977c7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:40.084031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8c41352f-156d-4875-86b0-d67ddfe018ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:40.085792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1281/2573] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:39 2022] DELETE /identity/v3/projects/d0b80650798445d18136226554d2b40c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:40.089073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dee608-a8fb-4511-832e-591db989f74f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.089073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dee608-a8fb-4511-832e-591db989f74f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.089073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dee608-a8fb-4511-832e-591db989f74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.090389 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45ae14-906d-4966-a6b6-a2b4053500c0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.090680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45ae14-906d-4966-a6b6-a2b4053500c0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.090984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45ae14-906d-4966-a6b6-a2b4053500c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.111005 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-37dee608-a8fb-4511-832e-591db989f74f None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:40.111651 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-37dee608-a8fb-4511-832e-591db989f74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:40.116297 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3d45ae14-906d-4966-a6b6-a2b4053500c0 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:40.117731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3d45ae14-906d-4966-a6b6-a2b4053500c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:40.173255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:40.175259 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1293/2574] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:40.183511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debc24-06d1-4acf-ac5c-b4dca656aaba None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.183855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debc24-06d1-4acf-ac5c-b4dca656aaba None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.184145 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debc24-06d1-4acf-ac5c-b4dca656aaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.196705 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1282/2575] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:40.204733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e1debc24-06d1-4acf-ac5c-b4dca656aaba None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:40.205454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da8966-8137-40ef-a31f-033450b42acd None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.205924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da8966-8137-40ef-a31f-033450b42acd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.206057 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e1debc24-06d1-4acf-ac5c-b4dca656aaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:40.206207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da8966-8137-40ef-a31f-033450b42acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.213892 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1294/2576] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:40.219106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1debc24-06d1-4acf-ac5c-b4dca656aaba None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.226823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d6da8966-8137-40ef-a31f-033450b42acd None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:40.228094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d6da8966-8137-40ef-a31f-033450b42acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:40.228319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1debc24-06d1-4acf-ac5c-b4dca656aaba None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.233743 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe56f8-9608-40c0-92a1-00af6b8ee8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.234524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe56f8-9608-40c0-92a1-00af6b8ee8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.234813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe56f8-9608-40c0-92a1-00af6b8ee8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.235138 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe56f8-9608-40c0-92a1-00af6b8ee8d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.235724 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe56f8-9608-40c0-92a1-00af6b8ee8d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:40.236211 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe56f8-9608-40c0-92a1-00af6b8ee8d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.236492 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1283/2577] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:40.237844 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe56f8-9608-40c0-92a1-00af6b8ee8d6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.240651 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da8966-8137-40ef-a31f-033450b42acd None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.249897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da8966-8137-40ef-a31f-033450b42acd None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.254039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1295/2578] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:29:40.254761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec67db8-61ee-40a3-83e4-ba2721174baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.254949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe56f8-9608-40c0-92a1-00af6b8ee8d6 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.255359 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec67db8-61ee-40a3-83e4-ba2721174baf admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.255645 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec67db8-61ee-40a3-83e4-ba2721174baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.255919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec67db8-61ee-40a3-83e4-ba2721174baf admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.256591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec67db8-61ee-40a3-83e4-ba2721174baf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:40.256894 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec67db8-61ee-40a3-83e4-ba2721174baf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.258535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec67db8-61ee-40a3-83e4-ba2721174baf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.261461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:40.265836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe56f8-9608-40c0-92a1-00af6b8ee8d6 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.271853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b05cb-8390-4427-8c06-ad4c30facd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.272023 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1284/2579] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:29:40.276046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b05cb-8390-4427-8c06-ad4c30facd82 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.276339 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b05cb-8390-4427-8c06-ad4c30facd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.276471 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec67db8-61ee-40a3-83e4-ba2721174baf admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.276625 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b05cb-8390-4427-8c06-ad4c30facd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.277268 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b05cb-8390-4427-8c06-ad4c30facd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.279193 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b05cb-8390-4427-8c06-ad4c30facd82 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.288461 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec67db8-61ee-40a3-83e4-ba2721174baf admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.293166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7248a60-42f6-4b52-82d4-380b191e5ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.293782 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7248a60-42f6-4b52-82d4-380b191e5ddd admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.294065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7248a60-42f6-4b52-82d4-380b191e5ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.294335 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7248a60-42f6-4b52-82d4-380b191e5ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.294954 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7248a60-42f6-4b52-82d4-380b191e5ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.296948 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7248a60-42f6-4b52-82d4-380b191e5ddd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.312308 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1296/2580] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:40 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:40.313558 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b05cb-8390-4427-8c06-ad4c30facd82 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.330286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1285/2581] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:40 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:40.331295 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7248a60-42f6-4b52-82d4-380b191e5ddd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.381641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b05cb-8390-4427-8c06-ad4c30facd82 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.400686 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7248a60-42f6-4b52-82d4-380b191e5ddd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.406253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88410b0-33c8-45e9-8a53-4c7478057688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.406854 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88410b0-33c8-45e9-8a53-4c7478057688 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.407133 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88410b0-33c8-45e9-8a53-4c7478057688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.407401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88410b0-33c8-45e9-8a53-4c7478057688 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.408024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88410b0-33c8-45e9-8a53-4c7478057688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.409971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88410b0-33c8-45e9-8a53-4c7478057688 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.432893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1286/2582] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:40 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:40.437362 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88410b0-33c8-45e9-8a53-4c7478057688 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.447793 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9127c2-450a-4738-a965-2a1e169a491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.448128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88410b0-33c8-45e9-8a53-4c7478057688 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.448554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9127c2-450a-4738-a965-2a1e169a491f admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.448829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9127c2-450a-4738-a965-2a1e169a491f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.449114 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9127c2-450a-4738-a965-2a1e169a491f admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.449745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9127c2-450a-4738-a965-2a1e169a491f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.452417 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9127c2-450a-4738-a965-2a1e169a491f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.455761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b3d22-2baf-4481-ad3c-698fa6097538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.456658 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b3d22-2baf-4481-ad3c-698fa6097538 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.457136 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b3d22-2baf-4481-ad3c-698fa6097538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.457436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b3d22-2baf-4481-ad3c-698fa6097538 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.458106 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b3d22-2baf-4481-ad3c-698fa6097538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.459704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b3d22-2baf-4481-ad3c-698fa6097538 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.473134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1287/2583] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:40.476456 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1297/2584] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:40 2022] POST /identity/v3/users => generated 300 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:40.477240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b3d22-2baf-4481-ad3c-698fa6097538 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.480269 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9127c2-450a-4738-a965-2a1e169a491f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.489194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b3d22-2baf-4481-ad3c-698fa6097538 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.490283 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9127c2-450a-4738-a965-2a1e169a491f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.495639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7cf41-591f-4ad6-9909-61789ad1c5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.496278 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7cf41-591f-4ad6-9909-61789ad1c5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.496561 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7cf41-591f-4ad6-9909-61789ad1c5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.496834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7cf41-591f-4ad6-9909-61789ad1c5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.497470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7cf41-591f-4ad6-9909-61789ad1c5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.498885 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59898dc6-6294-4e5a-8ba5-eac8a2147c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.499255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7cf41-591f-4ad6-9909-61789ad1c5c0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.499466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59898dc6-6294-4e5a-8ba5-eac8a2147c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.499746 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59898dc6-6294-4e5a-8ba5-eac8a2147c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.500010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59898dc6-6294-4e5a-8ba5-eac8a2147c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.500636 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59898dc6-6294-4e5a-8ba5-eac8a2147c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.502240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59898dc6-6294-4e5a-8ba5-eac8a2147c26 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.511604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1298/2585] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:40.513742 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7cf41-591f-4ad6-9909-61789ad1c5c0 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.518761 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1288/2586] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:40.519584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59898dc6-6294-4e5a-8ba5-eac8a2147c26 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.524270 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7cf41-591f-4ad6-9909-61789ad1c5c0 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.529018 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cedf38-f6bf-4ce0-b99b-79b1f0d4ae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.529630 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cedf38-f6bf-4ce0-b99b-79b1f0d4ae07 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.530731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cedf38-f6bf-4ce0-b99b-79b1f0d4ae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.531007 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cedf38-f6bf-4ce0-b99b-79b1f0d4ae07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.531637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cedf38-f6bf-4ce0-b99b-79b1f0d4ae07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.533222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cedf38-f6bf-4ce0-b99b-79b1f0d4ae07 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.534282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59898dc6-6294-4e5a-8ba5-eac8a2147c26 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.539295 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d9982-4ba4-4bdd-b201-0a8a6ea70dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.540015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d9982-4ba4-4bdd-b201-0a8a6ea70dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.540298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d9982-4ba4-4bdd-b201-0a8a6ea70dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.541001 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d9982-4ba4-4bdd-b201-0a8a6ea70dc3 admin admin] PATH_INFO: `/v3/projects/4c29c796cfbf4dd39ff099c5330f5015/users/6a8c65bdcd7d41d1bcd0005ecd8c5684/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.547378 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1299/2587] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:40.548423 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cedf38-f6bf-4ce0-b99b-79b1f0d4ae07 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.557928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cedf38-f6bf-4ce0-b99b-79b1f0d4ae07 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.563247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bae3e-132b-445b-af2e-a0ab2cda931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.563896 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bae3e-132b-445b-af2e-a0ab2cda931d admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.564174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bae3e-132b-445b-af2e-a0ab2cda931d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.564448 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bae3e-132b-445b-af2e-a0ab2cda931d admin admin] PATH_INFO: `/v3/projects/2e640072fea446be8b2fa1b551c5c305/users/2acc7587370d46f1abeda0bc6f869acd/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.567825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d9982-4ba4-4bdd-b201-0a8a6ea70dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c29c796cfbf4dd39ff099c5330f5015, user_id=6a8c65bdcd7d41d1bcd0005ecd8c5684, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.570513 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d9982-4ba4-4bdd-b201-0a8a6ea70dc3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.580306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bae3e-132b-445b-af2e-a0ab2cda931d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e640072fea446be8b2fa1b551c5c305, user_id=2acc7587370d46f1abeda0bc6f869acd, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.583108 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bae3e-132b-445b-af2e-a0ab2cda931d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.585562 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1289/2588] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:40 2022] PUT /identity/v3/projects/4c29c796cfbf4dd39ff099c5330f5015/users/6a8c65bdcd7d41d1bcd0005ecd8c5684/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:40.598585 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610f18c-9309-4d89-aa51-e0fcbba6875a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.598880 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610f18c-9309-4d89-aa51-e0fcbba6875a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.599142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610f18c-9309-4d89-aa51-e0fcbba6875a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.599769 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1300/2589] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:40 2022] PUT /identity/v3/projects/2e640072fea446be8b2fa1b551c5c305/users/2acc7587370d46f1abeda0bc6f869acd/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:40.611122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7988137-999e-42ab-a5e7-73615806ba3e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.611433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7988137-999e-42ab-a5e7-73615806ba3e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.611705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7988137-999e-42ab-a5e7-73615806ba3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.628540 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b610f18c-9309-4d89-aa51-e0fcbba6875a None None] MFA Rules not processed for user `6a8c65bdcd7d41d1bcd0005ecd8c5684`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:40.629828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b610f18c-9309-4d89-aa51-e0fcbba6875a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:40.641363 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a7988137-999e-42ab-a5e7-73615806ba3e None None] MFA Rules not processed for user `2acc7587370d46f1abeda0bc6f869acd`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:40.642658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a7988137-999e-42ab-a5e7-73615806ba3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:40.663055 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:40.669348 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:40.698392 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1290/2590] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:40.703776 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610f18c-9309-4d89-aa51-e0fcbba6875a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.711375 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1301/2591] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:40 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:40.715911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7988137-999e-42ab-a5e7-73615806ba3e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.769564 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610f18c-9309-4d89-aa51-e0fcbba6875a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.774372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456286b5-291b-42e3-904a-3ed9b05b6c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.775082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456286b5-291b-42e3-904a-3ed9b05b6c86 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.775398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456286b5-291b-42e3-904a-3ed9b05b6c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.775677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456286b5-291b-42e3-904a-3ed9b05b6c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.776337 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456286b5-291b-42e3-904a-3ed9b05b6c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.778319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456286b5-291b-42e3-904a-3ed9b05b6c86 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.778443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7988137-999e-42ab-a5e7-73615806ba3e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.783638 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be7f84-cbb4-4f02-93e2-2e6282f24a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.784255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be7f84-cbb4-4f02-93e2-2e6282f24a7e admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.784522 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be7f84-cbb4-4f02-93e2-2e6282f24a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.784794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be7f84-cbb4-4f02-93e2-2e6282f24a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.785418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be7f84-cbb4-4f02-93e2-2e6282f24a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.787323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be7f84-cbb4-4f02-93e2-2e6282f24a7e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.806655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1291/2592] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:40 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:40.811178 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456286b5-291b-42e3-904a-3ed9b05b6c86 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.817549 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1302/2593] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:40 2022] POST /identity/v3/projects => generated 399 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:40.821593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be7f84-cbb4-4f02-93e2-2e6282f24a7e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.876326 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456286b5-291b-42e3-904a-3ed9b05b6c86 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.880957 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542aac5-d04a-468d-ac3a-f3c143739690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.881561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542aac5-d04a-468d-ac3a-f3c143739690 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.881860 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542aac5-d04a-468d-ac3a-f3c143739690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.882158 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542aac5-d04a-468d-ac3a-f3c143739690 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.882784 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542aac5-d04a-468d-ac3a-f3c143739690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.884181 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be7f84-cbb4-4f02-93e2-2e6282f24a7e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.884677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542aac5-d04a-468d-ac3a-f3c143739690 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.889079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c9ca3-d8a1-4b1b-8121-7fc0f81c0f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.889901 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c9ca3-d8a1-4b1b-8121-7fc0f81c0f26 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.890180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c9ca3-d8a1-4b1b-8121-7fc0f81c0f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.890454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c9ca3-d8a1-4b1b-8121-7fc0f81c0f26 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.891079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c9ca3-d8a1-4b1b-8121-7fc0f81c0f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.893053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c9ca3-d8a1-4b1b-8121-7fc0f81c0f26 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.907273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1292/2594] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:40 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:40.911254 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542aac5-d04a-468d-ac3a-f3c143739690 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.917210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1303/2595] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:40 2022] POST /identity/v3/users => generated 306 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:40.921762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c9ca3-d8a1-4b1b-8121-7fc0f81c0f26 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.922489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542aac5-d04a-468d-ac3a-f3c143739690 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.927086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac0d40-b841-48cf-89ac-d78d501abb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.927687 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac0d40-b841-48cf-89ac-d78d501abb9e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.928124 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac0d40-b841-48cf-89ac-d78d501abb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.928396 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac0d40-b841-48cf-89ac-d78d501abb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.929041 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac0d40-b841-48cf-89ac-d78d501abb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.930654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac0d40-b841-48cf-89ac-d78d501abb9e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.931666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c9ca3-d8a1-4b1b-8121-7fc0f81c0f26 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.936545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e6c2a-161b-44ff-b346-e87560a48822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.937276 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e6c2a-161b-44ff-b346-e87560a48822 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.937559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e6c2a-161b-44ff-b346-e87560a48822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.937871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e6c2a-161b-44ff-b346-e87560a48822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.938693 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e6c2a-161b-44ff-b346-e87560a48822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.940218 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e6c2a-161b-44ff-b346-e87560a48822 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.941216 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1293/2596] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:40.945182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac0d40-b841-48cf-89ac-d78d501abb9e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.957429 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1304/2597] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:40.957638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac0d40-b841-48cf-89ac-d78d501abb9e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.958836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e6c2a-161b-44ff-b346-e87560a48822 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.961472 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caafaf-4edd-43a7-a45b-f3042a68df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.962097 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caafaf-4edd-43a7-a45b-f3042a68df1d admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.962372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caafaf-4edd-43a7-a45b-f3042a68df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.962643 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caafaf-4edd-43a7-a45b-f3042a68df1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.963272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2caafaf-4edd-43a7-a45b-f3042a68df1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:40.964860 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2caafaf-4edd-43a7-a45b-f3042a68df1d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:40.968953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e6c2a-161b-44ff-b346-e87560a48822 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.973984 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811a4db-8a91-4b8c-b344-07805066a0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:40.974665 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811a4db-8a91-4b8c-b344-07805066a0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:40.974946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811a4db-8a91-4b8c-b344-07805066a0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:40.975222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811a4db-8a91-4b8c-b344-07805066a0b9 admin admin] PATH_INFO: `/v3/projects/f427d825d13d411db3c45537d1d17021/users/c6f1fb3104134d6d939bc2cff2564301/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:40.976611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1294/2598] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:40.980808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caafaf-4edd-43a7-a45b-f3042a68df1d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:40.994943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caafaf-4edd-43a7-a45b-f3042a68df1d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:40.999870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811a4db-8a91-4b8c-b344-07805066a0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f427d825d13d411db3c45537d1d17021, user_id=c6f1fb3104134d6d939bc2cff2564301, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:41.000640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0b488-6c28-490c-9c7b-5dbc1516ee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:41.001305 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0b488-6c28-490c-9c7b-5dbc1516ee02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.001621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0b488-6c28-490c-9c7b-5dbc1516ee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.001938 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0b488-6c28-490c-9c7b-5dbc1516ee02 admin admin] PATH_INFO: `/v3/projects/c3048c37b9e640d5b37aae520bf32f9e/users/a57867ba9ccd497ea7e2c13b4756f267/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.002772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811a4db-8a91-4b8c-b344-07805066a0b9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:41.018780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0b488-6c28-490c-9c7b-5dbc1516ee02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3048c37b9e640d5b37aae520bf32f9e, user_id=a57867ba9ccd497ea7e2c13b4756f267, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:41.019973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1305/2599] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:40 2022] PUT /identity/v3/projects/f427d825d13d411db3c45537d1d17021/users/c6f1fb3104134d6d939bc2cff2564301/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:41.020800 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811a4db-8a91-4b8c-b344-07805066a0b9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:41.022532 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a811a4db-8a91-4b8c-b344-07805066a0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:41.024455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0b488-6c28-490c-9c7b-5dbc1516ee02 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:41.027838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:41.039657 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1295/2600] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:40 2022] PUT /identity/v3/projects/c3048c37b9e640d5b37aae520bf32f9e/users/a57867ba9ccd497ea7e2c13b4756f267/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:41.049909 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0b488-6c28-490c-9c7b-5dbc1516ee02 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:41.059693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:41.093490 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811a4db-8a91-4b8c-b344-07805066a0b9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:41.115046 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0b488-6c28-490c-9c7b-5dbc1516ee02 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:41.120012 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a97011-d5eb-43e1-95bd-503a9e4b70d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:41.120614 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a97011-d5eb-43e1-95bd-503a9e4b70d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.120897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a97011-d5eb-43e1-95bd-503a9e4b70d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.121175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a97011-d5eb-43e1-95bd-503a9e4b70d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.121888 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a97011-d5eb-43e1-95bd-503a9e4b70d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:41.123556 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a97011-d5eb-43e1-95bd-503a9e4b70d8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:41.133835 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1296/2601] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:41.135757 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630f2c5-082a-419b-944e-556bebc6cdb5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.136435 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630f2c5-082a-419b-944e-556bebc6cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.136720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630f2c5-082a-419b-944e-556bebc6cdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.154011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8c06f-35cb-47ec-ab56-82df9098bd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:41.155302 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8c06f-35cb-47ec-ab56-82df9098bd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.155675 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8c06f-35cb-47ec-ab56-82df9098bd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.155977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8c06f-35cb-47ec-ab56-82df9098bd05 admin admin] PATH_INFO: `/v3/users/52b0dffd1cae4cdba59c35ed3c6d1db0` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.157129 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8c06f-35cb-47ec-ab56-82df9098bd05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b0dffd1cae4cdba59c35ed3c6d1db0)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:41.159102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8c06f-35cb-47ec-ab56-82df9098bd05 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:41.166197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b630f2c5-082a-419b-944e-556bebc6cdb5 None None] MFA Rules not processed for user `a57867ba9ccd497ea7e2c13b4756f267`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:41.167414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b630f2c5-082a-419b-944e-556bebc6cdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:41.208361 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-94d8c06f-35cb-47ec-ab56-82df9098bd05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b0dffd1cae4cdba59c35ed3c6d1db0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:41.208954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-94d8c06f-35cb-47ec-ab56-82df9098bd05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b0dffd1cae4cdba59c35ed3c6d1db0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:41.219872 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-94d8c06f-35cb-47ec-ab56-82df9098bd05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b0dffd1cae4cdba59c35ed3c6d1db0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:41.233280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-94d8c06f-35cb-47ec-ab56-82df9098bd05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b0dffd1cae4cdba59c35ed3c6d1db0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:41.237903 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1297/2602] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:41.238724 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630f2c5-082a-419b-944e-556bebc6cdb5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:41.244554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-94d8c06f-35cb-47ec-ab56-82df9098bd05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b0dffd1cae4cdba59c35ed3c6d1db0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:41.249709 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630f2c5-082a-419b-944e-556bebc6cdb5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:41.251178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1306/2603] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:41 2022] DELETE /identity/v3/users/52b0dffd1cae4cdba59c35ed3c6d1db0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:41.252215 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8c06f-35cb-47ec-ab56-82df9098bd05 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:41.253601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-94d8c06f-35cb-47ec-ab56-82df9098bd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:41.292341 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:41.311735 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b7339-2da3-4a76-96d1-24cb03858ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:41.312397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b7339-2da3-4a76-96d1-24cb03858ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.312678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b7339-2da3-4a76-96d1-24cb03858ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.312953 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b7339-2da3-4a76-96d1-24cb03858ec9 admin admin] PATH_INFO: `/v3/projects/f427d825d13d411db3c45537d1d17021/users/c6f1fb3104134d6d939bc2cff2564301/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.314898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b7339-2da3-4a76-96d1-24cb03858ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f427d825d13d411db3c45537d1d17021, user_id=c6f1fb3104134d6d939bc2cff2564301, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:41.317545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b7339-2da3-4a76-96d1-24cb03858ec9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:41.328690 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1298/2604] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:41 2022] PUT /identity/v3/projects/f427d825d13d411db3c45537d1d17021/users/c6f1fb3104134d6d939bc2cff2564301/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:41.329930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe199f5-b829-4c9e-9eec-26a2b948f91a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.330218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe199f5-b829-4c9e-9eec-26a2b948f91a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.330497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe199f5-b829-4c9e-9eec-26a2b948f91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.336171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8c06f-35cb-47ec-ab56-82df9098bd05 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:41.350784 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cfe199f5-b829-4c9e-9eec-26a2b948f91a None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:41.351985 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cfe199f5-b829-4c9e-9eec-26a2b948f91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:41.374280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:41.397729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7569bb-155d-4833-8dcf-661ba880d1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:41.398387 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7569bb-155d-4833-8dcf-661ba880d1bd admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.398628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7569bb-155d-4833-8dcf-661ba880d1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.398901 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7569bb-155d-4833-8dcf-661ba880d1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.399524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7569bb-155d-4833-8dcf-661ba880d1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:41.401412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7569bb-155d-4833-8dcf-661ba880d1bd admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:41.419511 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1299/2605] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:41.420907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a472e3-b033-45c9-895f-b6a46592088e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.421188 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a472e3-b033-45c9-895f-b6a46592088e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.421640 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a472e3-b033-45c9-895f-b6a46592088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.439562 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1307/2606] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:41 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:41.440765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7569bb-155d-4833-8dcf-661ba880d1bd admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:41.443997 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1e7569bb-155d-4833-8dcf-661ba880d1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:41.454138 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-72a472e3-b033-45c9-895f-b6a46592088e None None] MFA Rules not processed for user `c6f1fb3104134d6d939bc2cff2564301`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:41.455338 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-72a472e3-b033-45c9-895f-b6a46592088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:41.503358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7569bb-155d-4833-8dcf-661ba880d1bd admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:41.506967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906f7ef-c88b-4434-813e-137ba1e028bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:41.507570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906f7ef-c88b-4434-813e-137ba1e028bc service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.507852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906f7ef-c88b-4434-813e-137ba1e028bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.508125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906f7ef-c88b-4434-813e-137ba1e028bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.527266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1300/2607] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:41 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:41.528682 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a472e3-b033-45c9-895f-b6a46592088e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:41.572931 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906f7ef-c88b-4434-813e-137ba1e028bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:41.574491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906f7ef-c88b-4434-813e-137ba1e028bc service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:41.586907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1308/2608] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:41.587787 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906f7ef-c88b-4434-813e-137ba1e028bc service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:41.589072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7906f7ef-c88b-4434-813e-137ba1e028bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:41.601952 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a472e3-b033-45c9-895f-b6a46592088e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:41.606069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:41.607106 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f508e-2e12-4a44-941a-072c3daeb7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:41.608443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f508e-2e12-4a44-941a-072c3daeb7aa admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.608572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f508e-2e12-4a44-941a-072c3daeb7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.608998 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f508e-2e12-4a44-941a-072c3daeb7aa admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.610076 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f508e-2e12-4a44-941a-072c3daeb7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:41.612008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f508e-2e12-4a44-941a-072c3daeb7aa admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:41.647134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1301/2609] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:41 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:41.651177 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f508e-2e12-4a44-941a-072c3daeb7aa admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:41.662502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f508e-2e12-4a44-941a-072c3daeb7aa admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:41.667609 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36400eb1-1b14-4b2a-ae76-80496a25c5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:41.668141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906f7ef-c88b-4434-813e-137ba1e028bc service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:41.668286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36400eb1-1b14-4b2a-ae76-80496a25c5cd admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.668486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36400eb1-1b14-4b2a-ae76-80496a25c5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.668792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36400eb1-1b14-4b2a-ae76-80496a25c5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.669433 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36400eb1-1b14-4b2a-ae76-80496a25c5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:41.671857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36400eb1-1b14-4b2a-ae76-80496a25c5cd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:41.672768 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580d08f-56f6-4999-ace7-760f4c37c0c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:41.673573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580d08f-56f6-4999-ace7-760f4c37c0c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.673883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580d08f-56f6-4999-ace7-760f4c37c0c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.674160 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580d08f-56f6-4999-ace7-760f4c37c0c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.683800 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1302/2610] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:41.685378 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580d08f-56f6-4999-ace7-760f4c37c0c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:41.687466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580d08f-56f6-4999-ace7-760f4c37c0c6 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:41.688332 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36400eb1-1b14-4b2a-ae76-80496a25c5cd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:41.699159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36400eb1-1b14-4b2a-ae76-80496a25c5cd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:41.700085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1309/2611] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:41 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:41.704783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4fb15-a3e9-4c2f-a8ec-76ef5f6b2b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:41.705468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4fb15-a3e9-4c2f-a8ec-76ef5f6b2b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.705783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4fb15-a3e9-4c2f-a8ec-76ef5f6b2b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.706068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4fb15-a3e9-4c2f-a8ec-76ef5f6b2b1a admin admin] PATH_INFO: `/v3/projects/b18a1b20737a4e859a96f2647d0b8811/users/093875bcd9444cfb923a20e999689953/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.724598 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4fb15-a3e9-4c2f-a8ec-76ef5f6b2b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18a1b20737a4e859a96f2647d0b8811, user_id=093875bcd9444cfb923a20e999689953, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:41.727697 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4fb15-a3e9-4c2f-a8ec-76ef5f6b2b1a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:41.749634 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1303/2612] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:41 2022] PUT /identity/v3/projects/b18a1b20737a4e859a96f2647d0b8811/users/093875bcd9444cfb923a20e999689953/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:41.753827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580d08f-56f6-4999-ace7-760f4c37c0c6 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:41.769421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580d08f-56f6-4999-ace7-760f4c37c0c6 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:41.805992 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4fb15-a3e9-4c2f-a8ec-76ef5f6b2b1a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:41.815615 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:41.840782 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177170b-959d-4acf-8661-7894bb85fe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:41.841666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177170b-959d-4acf-8661-7894bb85fe77 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.841977 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177170b-959d-4acf-8661-7894bb85fe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.844109 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177170b-959d-4acf-8661-7894bb85fe77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.847538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177170b-959d-4acf-8661-7894bb85fe77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:41.849244 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177170b-959d-4acf-8661-7894bb85fe77 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:41.860613 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1310/2613] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:41.864788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177170b-959d-4acf-8661-7894bb85fe77 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:41.868968 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4fb15-a3e9-4c2f-a8ec-76ef5f6b2b1a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:41.873119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d1ce1-52b5-48c8-8574-5f1a79dd5bdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:41.874031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d1ce1-52b5-48c8-8574-5f1a79dd5bdf service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.874482 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d1ce1-52b5-48c8-8574-5f1a79dd5bdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.874787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d1ce1-52b5-48c8-8574-5f1a79dd5bdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.876820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-953d1ce1-52b5-48c8-8574-5f1a79dd5bdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:41.877162 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177170b-959d-4acf-8661-7894bb85fe77 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:41.883638 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162071c2-4a57-45a6-aebd-4086d8ad2a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:41.884561 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162071c2-4a57-45a6-aebd-4086d8ad2a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.884851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162071c2-4a57-45a6-aebd-4086d8ad2a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.885141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162071c2-4a57-45a6-aebd-4086d8ad2a1e admin admin] PATH_INFO: `/v3/projects/b18a1b20737a4e859a96f2647d0b8811/users/093875bcd9444cfb923a20e999689953/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.887434 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162071c2-4a57-45a6-aebd-4086d8ad2a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18a1b20737a4e859a96f2647d0b8811, user_id=093875bcd9444cfb923a20e999689953, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:41.890646 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162071c2-4a57-45a6-aebd-4086d8ad2a1e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:41.908023 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1311/2614] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:41 2022] PUT /identity/v3/projects/b18a1b20737a4e859a96f2647d0b8811/users/093875bcd9444cfb923a20e999689953/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:41.908901 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162071c2-4a57-45a6-aebd-4086d8ad2a1e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:41.910733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-162071c2-4a57-45a6-aebd-4086d8ad2a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:41.952525 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d1ce1-52b5-48c8-8574-5f1a79dd5bdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:41.954048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d1ce1-52b5-48c8-8574-5f1a79dd5bdf service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:41.963699 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1304/2615] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:41 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:41.966887 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393050d-d4f7-464b-ae48-b041ee434eb8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:41.967311 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393050d-d4f7-464b-ae48-b041ee434eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:41.967618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393050d-d4f7-464b-ae48-b041ee434eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:41.993582 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162071c2-4a57-45a6-aebd-4086d8ad2a1e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:41.997634 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b393050d-d4f7-464b-ae48-b041ee434eb8 None None] MFA Rules not processed for user `093875bcd9444cfb923a20e999689953`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:41.999334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b393050d-d4f7-464b-ae48-b041ee434eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:41.999578 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cfd13-0c08-4bb9-8f2f-1a147f5f0880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:42.000398 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cfd13-0c08-4bb9-8f2f-1a147f5f0880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:42.000858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cfd13-0c08-4bb9-8f2f-1a147f5f0880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:42.001141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cfd13-0c08-4bb9-8f2f-1a147f5f0880 admin admin] PATH_INFO: `/v3/projects/0f81699ce28046e685d0f0d729aefc70` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:42.002350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cfd13-0c08-4bb9-8f2f-1a147f5f0880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f81699ce28046e685d0f0d729aefc70)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:42.004264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cfd13-0c08-4bb9-8f2f-1a147f5f0880 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:42.056963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:42.069350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fc4cfd13-0c08-4bb9-8f2f-1a147f5f0880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f81699ce28046e685d0f0d729aefc70', 'request_id': 'req-fc4cfd13-0c08-4bb9-8f2f-1a147f5f0880'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:42.076201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fc4cfd13-0c08-4bb9-8f2f-1a147f5f0880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f81699ce28046e685d0f0d729aefc70', 'request_id': 'req-fc4cfd13-0c08-4bb9-8f2f-1a147f5f0880'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:42.082619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fc4cfd13-0c08-4bb9-8f2f-1a147f5f0880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f81699ce28046e685d0f0d729aefc70', 'request_id': 'req-fc4cfd13-0c08-4bb9-8f2f-1a147f5f0880'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:42.087521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1305/2616] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:42.098118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fc4cfd13-0c08-4bb9-8f2f-1a147f5f0880 admin admin] The token cache is being invalidate because project 0f81699ce28046e685d0f0d729aefc70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:42.098520 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fc4cfd13-0c08-4bb9-8f2f-1a147f5f0880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:42.099947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fc4cfd13-0c08-4bb9-8f2f-1a147f5f0880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:42.101205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393050d-d4f7-464b-ae48-b041ee434eb8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:42.102323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1312/2617] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:41 2022] DELETE /identity/v3/projects/0f81699ce28046e685d0f0d729aefc70 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:42.103664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b393050d-d4f7-464b-ae48-b041ee434eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:42.106830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cece7-2bb9-4c34-a2d2-3c3551b21b21 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:42.107435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cece7-2bb9-4c34-a2d2-3c3551b21b21 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:42.108001 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cece7-2bb9-4c34-a2d2-3c3551b21b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:42.133028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0a2cece7-2bb9-4c34-a2d2-3c3551b21b21 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:42.134326 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0a2cece7-2bb9-4c34-a2d2-3c3551b21b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:42.165406 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:42.172149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393050d-d4f7-464b-ae48-b041ee434eb8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:42.210390 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1313/2618] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:42.219464 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fec389-29a5-41bb-a6f5-bdc2914f4f07 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:42.219758 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fec389-29a5-41bb-a6f5-bdc2914f4f07 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:42.220040 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fec389-29a5-41bb-a6f5-bdc2914f4f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:42.235143 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bea741-c31f-4502-82fe-96258b4ac870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:42.248503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bea741-c31f-4502-82fe-96258b4ac870 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:42.248832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bea741-c31f-4502-82fe-96258b4ac870 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:42.249034 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a9fec389-29a5-41bb-a6f5-bdc2914f4f07 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:42.249206 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bea741-c31f-4502-82fe-96258b4ac870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:42.250421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a9fec389-29a5-41bb-a6f5-bdc2914f4f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:42.251647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-22bea741-c31f-4502-82fe-96258b4ac870 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:42.267804 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1314/2619] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:42.271698 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fec389-29a5-41bb-a6f5-bdc2914f4f07 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:42.284104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fec389-29a5-41bb-a6f5-bdc2914f4f07 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:42.290510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94c082-df91-419d-afad-eb31cb3def2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:42.291463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94c082-df91-419d-afad-eb31cb3def2e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:42.291690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94c082-df91-419d-afad-eb31cb3def2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:42.292435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94c082-df91-419d-afad-eb31cb3def2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:42.293082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94c082-df91-419d-afad-eb31cb3def2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:42.293387 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94c082-df91-419d-afad-eb31cb3def2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:42.297088 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94c082-df91-419d-afad-eb31cb3def2e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:42.316850 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1315/2620] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:29:42.321467 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94c082-df91-419d-afad-eb31cb3def2e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:42.332327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94c082-df91-419d-afad-eb31cb3def2e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:42.337146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5d458-3627-4360-b5ab-835e409b7adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:42.337816 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5d458-3627-4360-b5ab-835e409b7adf admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:42.338122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5d458-3627-4360-b5ab-835e409b7adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:42.338373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5d458-3627-4360-b5ab-835e409b7adf admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:42.339064 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5d458-3627-4360-b5ab-835e409b7adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:42.340951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5d458-3627-4360-b5ab-835e409b7adf admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:42.354729 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bea741-c31f-4502-82fe-96258b4ac870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:42.356422 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bea741-c31f-4502-82fe-96258b4ac870 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:42.369205 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1306/2621] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:42.372190 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1316/2622] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:42 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:42.375607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bea741-c31f-4502-82fe-96258b4ac870 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:42.386625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bea741-c31f-4502-82fe-96258b4ac870 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:42.455578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e45f26-3c36-40cd-9032-b0fb5d4203d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:42.456181 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e45f26-3c36-40cd-9032-b0fb5d4203d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:42.456449 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e45f26-3c36-40cd-9032-b0fb5d4203d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:42.456719 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e45f26-3c36-40cd-9032-b0fb5d4203d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:42.457622 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e45f26-3c36-40cd-9032-b0fb5d4203d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:42.459963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e45f26-3c36-40cd-9032-b0fb5d4203d8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:42.487599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1307/2623] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:42 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:42.491705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5d458-3627-4360-b5ab-835e409b7adf admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:42.503539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5d458-3627-4360-b5ab-835e409b7adf admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:42.509619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea887a-6bc9-481b-a044-031b95827011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:42.510273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea887a-6bc9-481b-a044-031b95827011 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:42.510682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea887a-6bc9-481b-a044-031b95827011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:42.510958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea887a-6bc9-481b-a044-031b95827011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:42.511593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea887a-6bc9-481b-a044-031b95827011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:42.513587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea887a-6bc9-481b-a044-031b95827011 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:42.525474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1317/2624] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:42.529963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e45f26-3c36-40cd-9032-b0fb5d4203d8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:42.540604 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e45f26-3c36-40cd-9032-b0fb5d4203d8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:42.546693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7188c11-9d53-4f1f-8960-9983b2c76179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:42.547818 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7188c11-9d53-4f1f-8960-9983b2c76179 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:42.548131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7188c11-9d53-4f1f-8960-9983b2c76179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:42.548439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7188c11-9d53-4f1f-8960-9983b2c76179 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:42.549083 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7188c11-9d53-4f1f-8960-9983b2c76179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:42.551077 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7188c11-9d53-4f1f-8960-9983b2c76179 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:42.565711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1308/2625] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:42.568334 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea887a-6bc9-481b-a044-031b95827011 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:42.585190 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea887a-6bc9-481b-a044-031b95827011 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:42.589980 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fcd63-8b7f-4fda-b9df-5c3dcf81d8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:42.590641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fcd63-8b7f-4fda-b9df-5c3dcf81d8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:42.590923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fcd63-8b7f-4fda-b9df-5c3dcf81d8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:42.591201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fcd63-8b7f-4fda-b9df-5c3dcf81d8fb admin admin] PATH_INFO: `/v3/projects/75e4867487b049eaa8cb33ada3509151/users/0ce562113b5f4f39817100ffcaa5f46e/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:42.606848 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fcd63-8b7f-4fda-b9df-5c3dcf81d8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e4867487b049eaa8cb33ada3509151, user_id=0ce562113b5f4f39817100ffcaa5f46e, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:42.610550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fcd63-8b7f-4fda-b9df-5c3dcf81d8fb admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:42.629265 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1318/2626] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:42 2022] PUT /identity/v3/projects/75e4867487b049eaa8cb33ada3509151/users/0ce562113b5f4f39817100ffcaa5f46e/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:42.641303 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5454d-1891-4749-b7ae-192b464f89a3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:42.641591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5454d-1891-4749-b7ae-192b464f89a3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:42.641921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5454d-1891-4749-b7ae-192b464f89a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:42.669950 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e3f5454d-1891-4749-b7ae-192b464f89a3 None None] MFA Rules not processed for user `0ce562113b5f4f39817100ffcaa5f46e`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:42.671946 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e3f5454d-1891-4749-b7ae-192b464f89a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:42.691813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:42.747025 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1309/2627] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:42.760087 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fcd63-8b7f-4fda-b9df-5c3dcf81d8fb admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:42.761765 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e71fcd63-8b7f-4fda-b9df-5c3dcf81d8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:42.822460 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fcd63-8b7f-4fda-b9df-5c3dcf81d8fb admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:42.827677 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bab8aa-8933-4a9d-b665-9a7d2631a31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:42.827677 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bab8aa-8933-4a9d-b665-9a7d2631a31d service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:42.827677 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bab8aa-8933-4a9d-b665-9a7d2631a31d service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:42.828010 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bab8aa-8933-4a9d-b665-9a7d2631a31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:42.833401 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:42.838251 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bab8aa-8933-4a9d-b665-9a7d2631a31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:42.839848 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bab8aa-8933-4a9d-b665-9a7d2631a31d service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:42.852357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1319/2628] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:42.943703 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5454d-1891-4749-b7ae-192b464f89a3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:42.945103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e3f5454d-1891-4749-b7ae-192b464f89a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:42.958372 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5454d-1891-4749-b7ae-192b464f89a3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:42.963099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fffbd-4cb8-4709-9ab8-a5932ef68102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:42.963702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fffbd-4cb8-4709-9ab8-a5932ef68102 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:42.963978 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fffbd-4cb8-4709-9ab8-a5932ef68102 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:42.964247 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fffbd-4cb8-4709-9ab8-a5932ef68102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:42.966279 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c00fffbd-4cb8-4709-9ab8-a5932ef68102 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:43.031145 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fffbd-4cb8-4709-9ab8-a5932ef68102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:43.032833 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fffbd-4cb8-4709-9ab8-a5932ef68102 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:43.042681 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1310/2629] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:46.126637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bab8aa-8933-4a9d-b665-9a7d2631a31d service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:46.128053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-83bab8aa-8933-4a9d-b665-9a7d2631a31d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:46.198044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bab8aa-8933-4a9d-b665-9a7d2631a31d service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:46.203223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc872bef-c80f-4dfc-a1a2-769cbbc82573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:46.203844 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc872bef-c80f-4dfc-a1a2-769cbbc82573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:46.204126 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc872bef-c80f-4dfc-a1a2-769cbbc82573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:46.204400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc872bef-c80f-4dfc-a1a2-769cbbc82573 admin admin] PATH_INFO: `/v3/users/2acc7587370d46f1abeda0bc6f869acd` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:46.205533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc872bef-c80f-4dfc-a1a2-769cbbc82573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2acc7587370d46f1abeda0bc6f869acd)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:46.207466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc872bef-c80f-4dfc-a1a2-769cbbc82573 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:46.256893 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bc872bef-c80f-4dfc-a1a2-769cbbc82573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2acc7587370d46f1abeda0bc6f869acd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:46.257538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bc872bef-c80f-4dfc-a1a2-769cbbc82573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2acc7587370d46f1abeda0bc6f869acd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:46.265457 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bc872bef-c80f-4dfc-a1a2-769cbbc82573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2acc7587370d46f1abeda0bc6f869acd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:46.278491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bc872bef-c80f-4dfc-a1a2-769cbbc82573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2acc7587370d46f1abeda0bc6f869acd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:46.285853 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bc872bef-c80f-4dfc-a1a2-769cbbc82573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2acc7587370d46f1abeda0bc6f869acd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:46.291827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1320/2630] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:46 2022] DELETE /identity/v3/users/2acc7587370d46f1abeda0bc6f869acd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:46.296408 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02afca-2299-4392-a3ca-259a23848bee None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:46.296889 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02afca-2299-4392-a3ca-259a23848bee None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:46.296985 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02afca-2299-4392-a3ca-259a23848bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:46.315822 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-dc02afca-2299-4392-a3ca-259a23848bee None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:46.317025 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-dc02afca-2299-4392-a3ca-259a23848bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:46.376794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1311/2631] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:46.386720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc872bef-c80f-4dfc-a1a2-769cbbc82573 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:46.388168 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bc872bef-c80f-4dfc-a1a2-769cbbc82573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:46.446927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc872bef-c80f-4dfc-a1a2-769cbbc82573 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:46.450697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f05e0b-024b-44d1-8400-a9676f23c7a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:46.451820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f05e0b-024b-44d1-8400-a9676f23c7a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:46.452110 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f05e0b-024b-44d1-8400-a9676f23c7a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:46.452381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f05e0b-024b-44d1-8400-a9676f23c7a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:46.461473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f05e0b-024b-44d1-8400-a9676f23c7a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:46.462985 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f05e0b-024b-44d1-8400-a9676f23c7a3 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:46.473407 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1321/2632] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:46.758454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02afca-2299-4392-a3ca-259a23848bee None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:46.760577 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-dc02afca-2299-4392-a3ca-259a23848bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:46.785568 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02afca-2299-4392-a3ca-259a23848bee None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:46.787819 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:46.788666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:46.789166 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:46.789446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b admin admin] PATH_INFO: `/v3/projects/2e640072fea446be8b2fa1b551c5c305` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:46.790704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e640072fea446be8b2fa1b551c5c305)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:46.792675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:46.844357 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e640072fea446be8b2fa1b551c5c305', 'request_id': 'req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:46.849074 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:46.851551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e640072fea446be8b2fa1b551c5c305', 'request_id': 'req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:46.859489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e640072fea446be8b2fa1b551c5c305', 'request_id': 'req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:46.872077 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b admin admin] The token cache is being invalidate because project 2e640072fea446be8b2fa1b551c5c305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:46.872363 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:46.872971 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:46.875002 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1312/2633] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:46 2022] DELETE /identity/v3/projects/2e640072fea446be8b2fa1b551c5c305 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:46.879088 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f05e0b-024b-44d1-8400-a9676f23c7a3 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:46.888824 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f05e0b-024b-44d1-8400-a9676f23c7a3 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:46.907026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:46.950349 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe318c01-18d6-47e7-b490-8390e4fa596d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:46.950990 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe318c01-18d6-47e7-b490-8390e4fa596d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:46.951892 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe318c01-18d6-47e7-b490-8390e4fa596d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:46.952196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe318c01-18d6-47e7-b490-8390e4fa596d admin admin] PATH_INFO: `/v3/users/c6f1fb3104134d6d939bc2cff2564301` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:46.953494 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe318c01-18d6-47e7-b490-8390e4fa596d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6f1fb3104134d6d939bc2cff2564301)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:46.955458 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe318c01-18d6-47e7-b490-8390e4fa596d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:47.008430 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fe318c01-18d6-47e7-b490-8390e4fa596d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6f1fb3104134d6d939bc2cff2564301'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:47.009084 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fe318c01-18d6-47e7-b490-8390e4fa596d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6f1fb3104134d6d939bc2cff2564301'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:47.019053 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fe318c01-18d6-47e7-b490-8390e4fa596d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6f1fb3104134d6d939bc2cff2564301'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:47.031672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fe318c01-18d6-47e7-b490-8390e4fa596d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6f1fb3104134d6d939bc2cff2564301'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:47.039272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fe318c01-18d6-47e7-b490-8390e4fa596d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6f1fb3104134d6d939bc2cff2564301'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:47.046694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1322/2634] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:46 2022] DELETE /identity/v3/users/c6f1fb3104134d6d939bc2cff2564301 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:47.175264 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:47.180882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:47.251704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c02b7-83d7-4c74-b6a8-c819862cbf1b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:47.301994 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad496fb3-4a77-4023-b6c0-8a2c9170e0cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:47.302703 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad496fb3-4a77-4023-b6c0-8a2c9170e0cb service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:47.302872 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad496fb3-4a77-4023-b6c0-8a2c9170e0cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:47.303141 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad496fb3-4a77-4023-b6c0-8a2c9170e0cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:47.304874 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ad496fb3-4a77-4023-b6c0-8a2c9170e0cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:47.338963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe318c01-18d6-47e7-b490-8390e4fa596d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:47.340877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fe318c01-18d6-47e7-b490-8390e4fa596d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:47.377831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad496fb3-4a77-4023-b6c0-8a2c9170e0cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:47.379316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad496fb3-4a77-4023-b6c0-8a2c9170e0cb service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:47.388455 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1313/2635] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:47.424766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe318c01-18d6-47e7-b490-8390e4fa596d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:47.429727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5189f-657c-4fd6-ab95-b3c627c8b4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:47.430395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5189f-657c-4fd6-ab95-b3c627c8b4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:47.430672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5189f-657c-4fd6-ab95-b3c627c8b4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:47.431017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5189f-657c-4fd6-ab95-b3c627c8b4f4 admin admin] PATH_INFO: `/v3/projects/f427d825d13d411db3c45537d1d17021` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:47.432509 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5189f-657c-4fd6-ab95-b3c627c8b4f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f427d825d13d411db3c45537d1d17021)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:47.434440 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5189f-657c-4fd6-ab95-b3c627c8b4f4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:47.479147 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:47.491779 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-58d5189f-657c-4fd6-ab95-b3c627c8b4f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f427d825d13d411db3c45537d1d17021', 'request_id': 'req-58d5189f-657c-4fd6-ab95-b3c627c8b4f4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:47.499655 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-58d5189f-657c-4fd6-ab95-b3c627c8b4f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f427d825d13d411db3c45537d1d17021', 'request_id': 'req-58d5189f-657c-4fd6-ab95-b3c627c8b4f4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:47.507176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-58d5189f-657c-4fd6-ab95-b3c627c8b4f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f427d825d13d411db3c45537d1d17021', 'request_id': 'req-58d5189f-657c-4fd6-ab95-b3c627c8b4f4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:47.520467 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-58d5189f-657c-4fd6-ab95-b3c627c8b4f4 admin admin] The token cache is being invalidate because project f427d825d13d411db3c45537d1d17021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:47.520762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-58d5189f-657c-4fd6-ab95-b3c627c8b4f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:47.521430 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-58d5189f-657c-4fd6-ab95-b3c627c8b4f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:47.522947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1323/2636] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:47 2022] DELETE /identity/v3/projects/f427d825d13d411db3c45537d1d17021 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:47.528011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dae79-f822-47f0-8be5-53cf16a93025 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:47.528297 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dae79-f822-47f0-8be5-53cf16a93025 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:47.528567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dae79-f822-47f0-8be5-53cf16a93025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:47.550759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-404dae79-f822-47f0-8be5-53cf16a93025 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:47.552209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-404dae79-f822-47f0-8be5-53cf16a93025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:47.603608 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:47.619878 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1314/2637] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:47.689170 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab7546-5077-4952-bc5d-ddaabb409484 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:47.689472 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab7546-5077-4952-bc5d-ddaabb409484 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:47.689752 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab7546-5077-4952-bc5d-ddaabb409484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:47.711196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-bdab7546-5077-4952-bc5d-ddaabb409484 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:47.712395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bdab7546-5077-4952-bc5d-ddaabb409484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:47.722612 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1324/2638] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:47.727600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dae79-f822-47f0-8be5-53cf16a93025 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:47.738591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dae79-f822-47f0-8be5-53cf16a93025 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:47.744079 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97aee94-a062-4230-bbd1-780e4a24daf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:47.744690 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97aee94-a062-4230-bbd1-780e4a24daf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:47.744969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97aee94-a062-4230-bbd1-780e4a24daf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:47.745242 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97aee94-a062-4230-bbd1-780e4a24daf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:47.746053 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97aee94-a062-4230-bbd1-780e4a24daf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:47.746399 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97aee94-a062-4230-bbd1-780e4a24daf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:47.748031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97aee94-a062-4230-bbd1-780e4a24daf8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:47.760738 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1315/2639] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:29:47.765274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab7546-5077-4952-bc5d-ddaabb409484 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:47.774745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab7546-5077-4952-bc5d-ddaabb409484 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:47.779503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e9023-11b4-48c8-b6e0-56f2b419ee34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:47.780108 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9023-11b4-48c8-b6e0-56f2b419ee34 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:47.780380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9023-11b4-48c8-b6e0-56f2b419ee34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:47.780651 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9023-11b4-48c8-b6e0-56f2b419ee34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:47.781283 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e9023-11b4-48c8-b6e0-56f2b419ee34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:47.783335 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e9023-11b4-48c8-b6e0-56f2b419ee34 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:47.817834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1325/2640] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:47 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:47.819712 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97aee94-a062-4230-bbd1-780e4a24daf8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:47.830535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97aee94-a062-4230-bbd1-780e4a24daf8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:47.904430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62625552-c486-435a-b90a-0056fe4e3146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:47.905382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62625552-c486-435a-b90a-0056fe4e3146 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:47.905475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62625552-c486-435a-b90a-0056fe4e3146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:47.905778 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62625552-c486-435a-b90a-0056fe4e3146 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:47.906428 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62625552-c486-435a-b90a-0056fe4e3146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:47.908809 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62625552-c486-435a-b90a-0056fe4e3146 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:47.942151 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1316/2641] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:47 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:47.946347 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e9023-11b4-48c8-b6e0-56f2b419ee34 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:47.959591 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e9023-11b4-48c8-b6e0-56f2b419ee34 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:47.965471 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64b2f5-2970-433a-bd39-b711f0a1ba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:47.966418 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64b2f5-2970-433a-bd39-b711f0a1ba85 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:47.966716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64b2f5-2970-433a-bd39-b711f0a1ba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:47.967058 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64b2f5-2970-433a-bd39-b711f0a1ba85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:47.968046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64b2f5-2970-433a-bd39-b711f0a1ba85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:47.969462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64b2f5-2970-433a-bd39-b711f0a1ba85 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:47.980673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1326/2642] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:47.986120 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62625552-c486-435a-b90a-0056fe4e3146 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:47.997635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62625552-c486-435a-b90a-0056fe4e3146 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:48.003864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ebca4-900d-461d-a216-fdcb3d97eeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:48.004625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ebca4-900d-461d-a216-fdcb3d97eeef admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:48.004974 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ebca4-900d-461d-a216-fdcb3d97eeef admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:48.005257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ebca4-900d-461d-a216-fdcb3d97eeef admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:48.005928 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ebca4-900d-461d-a216-fdcb3d97eeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:48.007521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ebca4-900d-461d-a216-fdcb3d97eeef admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:48.019582 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1317/2643] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:48.026935 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64b2f5-2970-433a-bd39-b711f0a1ba85 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:48.038897 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64b2f5-2970-433a-bd39-b711f0a1ba85 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:48.047222 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff3b05-1f03-424a-a746-f79283430a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:48.047896 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff3b05-1f03-424a-a746-f79283430a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:48.048180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff3b05-1f03-424a-a746-f79283430a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:48.048456 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff3b05-1f03-424a-a746-f79283430a0d admin admin] PATH_INFO: `/v3/projects/2b4a2ca383534cad8f77365607be48a9/users/3847567ac9414450a0b9aae4d19ddc6d/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:48.067421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff3b05-1f03-424a-a746-f79283430a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4a2ca383534cad8f77365607be48a9, user_id=3847567ac9414450a0b9aae4d19ddc6d, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:48.072762 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff3b05-1f03-424a-a746-f79283430a0d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:48.099202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1327/2644] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:48 2022] PUT /identity/v3/projects/2b4a2ca383534cad8f77365607be48a9/users/3847567ac9414450a0b9aae4d19ddc6d/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:48.100960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacff896-247a-43e9-ab05-52ced66f2d16 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:48.101254 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacff896-247a-43e9-ab05-52ced66f2d16 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:48.101524 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacff896-247a-43e9-ab05-52ced66f2d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:48.139041 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cacff896-247a-43e9-ab05-52ced66f2d16 None None] MFA Rules not processed for user `3847567ac9414450a0b9aae4d19ddc6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:48.140365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cacff896-247a-43e9-ab05-52ced66f2d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:48.229812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1318/2645] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:48.229983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff3b05-1f03-424a-a746-f79283430a0d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:48.307043 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff3b05-1f03-424a-a746-f79283430a0d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:48.312000 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18772d-f365-453a-94a9-13b206558df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:48.312641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18772d-f365-453a-94a9-13b206558df4 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:48.312928 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18772d-f365-453a-94a9-13b206558df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:48.313735 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18772d-f365-453a-94a9-13b206558df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:48.314467 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18772d-f365-453a-94a9-13b206558df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:48.316381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18772d-f365-453a-94a9-13b206558df4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:48.349883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1328/2646] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:48 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:48.350965 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacff896-247a-43e9-ab05-52ced66f2d16 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:48.363729 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacff896-247a-43e9-ab05-52ced66f2d16 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:48.413191 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:48.435785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ad78a-12ed-43c2-b2ef-8fa615c9b8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:48.436401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ad78a-12ed-43c2-b2ef-8fa615c9b8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:48.436679 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ad78a-12ed-43c2-b2ef-8fa615c9b8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:48.436949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ad78a-12ed-43c2-b2ef-8fa615c9b8c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:48.437620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ad78a-12ed-43c2-b2ef-8fa615c9b8c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:48.439603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ad78a-12ed-43c2-b2ef-8fa615c9b8c8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:48.469014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1319/2647] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:48 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:48.470986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18772d-f365-453a-94a9-13b206558df4 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:48.481118 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18772d-f365-453a-94a9-13b206558df4 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:48.487150 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad827c-09eb-4bae-807a-3a4e7304fa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:48.487749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad827c-09eb-4bae-807a-3a4e7304fa97 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:48.488025 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad827c-09eb-4bae-807a-3a4e7304fa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:48.488296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad827c-09eb-4bae-807a-3a4e7304fa97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:48.488930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad827c-09eb-4bae-807a-3a4e7304fa97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:48.490664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad827c-09eb-4bae-807a-3a4e7304fa97 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:48.505551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1329/2648] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:48.506719 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ad78a-12ed-43c2-b2ef-8fa615c9b8c8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:48.517290 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ad78a-12ed-43c2-b2ef-8fa615c9b8c8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:48.521964 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff059cab-f390-434b-b73b-fd427cb0671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:48.522610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff059cab-f390-434b-b73b-fd427cb0671e admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:48.522886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff059cab-f390-434b-b73b-fd427cb0671e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:48.523159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff059cab-f390-434b-b73b-fd427cb0671e admin admin] PATH_INFO: `/v3/projects/2d897f868bf34badb8532c0d7c10d88b/users/9e8acf29d279454393420208932a647e/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:48.539490 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff059cab-f390-434b-b73b-fd427cb0671e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d897f868bf34badb8532c0d7c10d88b, user_id=9e8acf29d279454393420208932a647e, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:48.542585 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff059cab-f390-434b-b73b-fd427cb0671e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:48.557203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1320/2649] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:48 2022] PUT /identity/v3/projects/2d897f868bf34badb8532c0d7c10d88b/users/9e8acf29d279454393420208932a647e/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:48.561703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad827c-09eb-4bae-807a-3a4e7304fa97 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:48.575586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad827c-09eb-4bae-807a-3a4e7304fa97 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:48.610513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:48.638411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a26df-91e9-48fd-a72f-32bf0a23aa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:48.639575 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a26df-91e9-48fd-a72f-32bf0a23aa78 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:48.639860 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a26df-91e9-48fd-a72f-32bf0a23aa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:48.640351 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a26df-91e9-48fd-a72f-32bf0a23aa78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:48.641084 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a26df-91e9-48fd-a72f-32bf0a23aa78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:48.642639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a26df-91e9-48fd-a72f-32bf0a23aa78 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:48.658231 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1330/2650] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:48.659600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff059cab-f390-434b-b73b-fd427cb0671e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:48.670209 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff059cab-f390-434b-b73b-fd427cb0671e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:48.675327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a04913-2621-4084-b61c-384837bca254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:48.675993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a04913-2621-4084-b61c-384837bca254 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:48.676316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a04913-2621-4084-b61c-384837bca254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:48.676592 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a04913-2621-4084-b61c-384837bca254 admin admin] PATH_INFO: `/v3/projects/2d897f868bf34badb8532c0d7c10d88b/users/9e8acf29d279454393420208932a647e/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:48.678596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a04913-2621-4084-b61c-384837bca254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d897f868bf34badb8532c0d7c10d88b, user_id=9e8acf29d279454393420208932a647e, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:48.681335 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a04913-2621-4084-b61c-384837bca254 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:48.692237 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1321/2651] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:48 2022] PUT /identity/v3/projects/2d897f868bf34badb8532c0d7c10d88b/users/9e8acf29d279454393420208932a647e/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:48.703333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bf963-fc64-4471-bfb0-adfad85e129b None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:48.703618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bf963-fc64-4471-bfb0-adfad85e129b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:48.703895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bf963-fc64-4471-bfb0-adfad85e129b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:48.732060 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-547bf963-fc64-4471-bfb0-adfad85e129b None None] MFA Rules not processed for user `9e8acf29d279454393420208932a647e`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:48.733460 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-547bf963-fc64-4471-bfb0-adfad85e129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:48.804130 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1331/2652] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:48.816161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a04913-2621-4084-b61c-384837bca254 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:48.817965 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-99a04913-2621-4084-b61c-384837bca254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:48.878415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a04913-2621-4084-b61c-384837bca254 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:48.882073 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249adeea-64ec-43f3-812f-610c0044293c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:48.882675 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249adeea-64ec-43f3-812f-610c0044293c service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:48.882953 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249adeea-64ec-43f3-812f-610c0044293c service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:48.883227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249adeea-64ec-43f3-812f-610c0044293c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:48.939645 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249adeea-64ec-43f3-812f-610c0044293c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:48.941070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249adeea-64ec-43f3-812f-610c0044293c service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:48.949777 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1322/2653] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:49.601475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bf963-fc64-4471-bfb0-adfad85e129b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:49.606158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-547bf963-fc64-4471-bfb0-adfad85e129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:49.671100 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bf963-fc64-4471-bfb0-adfad85e129b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:49.675554 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced4981-cf95-4bb5-b7ea-74e0f1488844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:49.676176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced4981-cf95-4bb5-b7ea-74e0f1488844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:49.676457 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced4981-cf95-4bb5-b7ea-74e0f1488844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:49.676731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced4981-cf95-4bb5-b7ea-74e0f1488844 admin admin] PATH_INFO: `/v3/users/6a8c65bdcd7d41d1bcd0005ecd8c5684` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:49.677890 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced4981-cf95-4bb5-b7ea-74e0f1488844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a8c65bdcd7d41d1bcd0005ecd8c5684)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:49.679789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced4981-cf95-4bb5-b7ea-74e0f1488844 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:49.733199 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fced4981-cf95-4bb5-b7ea-74e0f1488844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a8c65bdcd7d41d1bcd0005ecd8c5684'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:49.733941 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fced4981-cf95-4bb5-b7ea-74e0f1488844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a8c65bdcd7d41d1bcd0005ecd8c5684'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:49.742766 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fced4981-cf95-4bb5-b7ea-74e0f1488844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a8c65bdcd7d41d1bcd0005ecd8c5684'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:49.747688 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:49.759596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fced4981-cf95-4bb5-b7ea-74e0f1488844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a8c65bdcd7d41d1bcd0005ecd8c5684'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:49.768211 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fced4981-cf95-4bb5-b7ea-74e0f1488844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a8c65bdcd7d41d1bcd0005ecd8c5684'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:49.775049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1332/2654] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:49 2022] DELETE /identity/v3/users/6a8c65bdcd7d41d1bcd0005ecd8c5684 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:49.780119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a306257-9a81-409e-86b3-a32e7680ede1 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:49.780567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a306257-9a81-409e-86b3-a32e7680ede1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:49.780567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a306257-9a81-409e-86b3-a32e7680ede1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:49.801922 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6a306257-9a81-409e-86b3-a32e7680ede1 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:49.803338 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6a306257-9a81-409e-86b3-a32e7680ede1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:49.852992 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:49.865829 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1323/2655] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:49.876077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced4981-cf95-4bb5-b7ea-74e0f1488844 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:49.877512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fced4981-cf95-4bb5-b7ea-74e0f1488844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:49.937400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced4981-cf95-4bb5-b7ea-74e0f1488844 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:49.941233 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a04eab-c936-4955-b91c-b27bc1f58ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:49.941902 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a04eab-c936-4955-b91c-b27bc1f58ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:49.942182 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a04eab-c936-4955-b91c-b27bc1f58ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:49.942450 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a04eab-c936-4955-b91c-b27bc1f58ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:49.952978 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a04eab-c936-4955-b91c-b27bc1f58ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:49.954439 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a04eab-c936-4955-b91c-b27bc1f58ea5 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:49.964268 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1333/2656] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:50.233698 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a306257-9a81-409e-86b3-a32e7680ede1 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:50.235137 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6a306257-9a81-409e-86b3-a32e7680ede1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:50.247569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a306257-9a81-409e-86b3-a32e7680ede1 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:50.253601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987ca9f-5074-47ed-9414-71e0444d2c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:50.254116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987ca9f-5074-47ed-9414-71e0444d2c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:50.254475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987ca9f-5074-47ed-9414-71e0444d2c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:50.254728 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987ca9f-5074-47ed-9414-71e0444d2c5a admin admin] PATH_INFO: `/v3/projects/4c29c796cfbf4dd39ff099c5330f5015` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:50.256017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987ca9f-5074-47ed-9414-71e0444d2c5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c29c796cfbf4dd39ff099c5330f5015)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:50.257956 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987ca9f-5074-47ed-9414-71e0444d2c5a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:50.307337 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f987ca9f-5074-47ed-9414-71e0444d2c5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c29c796cfbf4dd39ff099c5330f5015', 'request_id': 'req-f987ca9f-5074-47ed-9414-71e0444d2c5a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:50.313701 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f987ca9f-5074-47ed-9414-71e0444d2c5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c29c796cfbf4dd39ff099c5330f5015', 'request_id': 'req-f987ca9f-5074-47ed-9414-71e0444d2c5a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:50.320592 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f987ca9f-5074-47ed-9414-71e0444d2c5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c29c796cfbf4dd39ff099c5330f5015', 'request_id': 'req-f987ca9f-5074-47ed-9414-71e0444d2c5a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:50.334038 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f987ca9f-5074-47ed-9414-71e0444d2c5a admin admin] The token cache is being invalidate because project 4c29c796cfbf4dd39ff099c5330f5015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:50.334339 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f987ca9f-5074-47ed-9414-71e0444d2c5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:50.334970 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f987ca9f-5074-47ed-9414-71e0444d2c5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:50.336772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1324/2657] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:50 2022] DELETE /identity/v3/projects/4c29c796cfbf4dd39ff099c5330f5015 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:50.340558 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a04eab-c936-4955-b91c-b27bc1f58ea5 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:50.351410 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a04eab-c936-4955-b91c-b27bc1f58ea5 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:50.413350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ea0e5-bf93-4e7d-ba7d-71adc122c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:50.414025 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ea0e5-bf93-4e7d-ba7d-71adc122c842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:50.414309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ea0e5-bf93-4e7d-ba7d-71adc122c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:50.414576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ea0e5-bf93-4e7d-ba7d-71adc122c842 admin admin] PATH_INFO: `/v3/users/a57867ba9ccd497ea7e2c13b4756f267` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:50.415889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ea0e5-bf93-4e7d-ba7d-71adc122c842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57867ba9ccd497ea7e2c13b4756f267)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:50.417848 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ea0e5-bf93-4e7d-ba7d-71adc122c842 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:50.476063 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-308ea0e5-bf93-4e7d-ba7d-71adc122c842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57867ba9ccd497ea7e2c13b4756f267'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:50.476731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-308ea0e5-bf93-4e7d-ba7d-71adc122c842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57867ba9ccd497ea7e2c13b4756f267'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:50.490364 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-308ea0e5-bf93-4e7d-ba7d-71adc122c842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57867ba9ccd497ea7e2c13b4756f267'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:50.503733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-308ea0e5-bf93-4e7d-ba7d-71adc122c842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57867ba9ccd497ea7e2c13b4756f267'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:50.510594 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-308ea0e5-bf93-4e7d-ba7d-71adc122c842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57867ba9ccd497ea7e2c13b4756f267'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:50.512799 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:50.517791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1334/2658] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:50 2022] DELETE /identity/v3/users/a57867ba9ccd497ea7e2c13b4756f267 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:50.802828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987ca9f-5074-47ed-9414-71e0444d2c5a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:50.804318 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f987ca9f-5074-47ed-9414-71e0444d2c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:50.820746 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987ca9f-5074-47ed-9414-71e0444d2c5a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:50.890351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294c9ae-c6ca-4e75-88ab-3525265689da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:50.891053 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294c9ae-c6ca-4e75-88ab-3525265689da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:50.891340 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294c9ae-c6ca-4e75-88ab-3525265689da admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:50.891641 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294c9ae-c6ca-4e75-88ab-3525265689da admin admin] PATH_INFO: `/v3/projects/c3048c37b9e640d5b37aae520bf32f9e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:50.892794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294c9ae-c6ca-4e75-88ab-3525265689da admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3048c37b9e640d5b37aae520bf32f9e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:50.894880 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294c9ae-c6ca-4e75-88ab-3525265689da admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:50.945496 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2294c9ae-c6ca-4e75-88ab-3525265689da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3048c37b9e640d5b37aae520bf32f9e', 'request_id': 'req-2294c9ae-c6ca-4e75-88ab-3525265689da'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:50.951086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2294c9ae-c6ca-4e75-88ab-3525265689da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3048c37b9e640d5b37aae520bf32f9e', 'request_id': 'req-2294c9ae-c6ca-4e75-88ab-3525265689da'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:50.957146 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2294c9ae-c6ca-4e75-88ab-3525265689da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3048c37b9e640d5b37aae520bf32f9e', 'request_id': 'req-2294c9ae-c6ca-4e75-88ab-3525265689da'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:50.969007 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2294c9ae-c6ca-4e75-88ab-3525265689da admin admin] The token cache is being invalidate because project c3048c37b9e640d5b37aae520bf32f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:50.969295 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2294c9ae-c6ca-4e75-88ab-3525265689da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:50.969956 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2294c9ae-c6ca-4e75-88ab-3525265689da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:50.971709 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1325/2659] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:50 2022] DELETE /identity/v3/projects/c3048c37b9e640d5b37aae520bf32f9e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:50.976948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ea0e5-bf93-4e7d-ba7d-71adc122c842 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:50.978376 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-308ea0e5-bf93-4e7d-ba7d-71adc122c842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:50.991512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ea0e5-bf93-4e7d-ba7d-71adc122c842 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:51.049101 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220d0db-fd8f-41ae-b166-307c9faff072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:51.049661 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220d0db-fd8f-41ae-b166-307c9faff072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:51.050032 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220d0db-fd8f-41ae-b166-307c9faff072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:51.050309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220d0db-fd8f-41ae-b166-307c9faff072 admin admin] PATH_INFO: `/v3/users/093875bcd9444cfb923a20e999689953` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:51.051423 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220d0db-fd8f-41ae-b166-307c9faff072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093875bcd9444cfb923a20e999689953)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:51.053425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220d0db-fd8f-41ae-b166-307c9faff072 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:51.103146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d220d0db-fd8f-41ae-b166-307c9faff072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093875bcd9444cfb923a20e999689953'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:51.103785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d220d0db-fd8f-41ae-b166-307c9faff072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093875bcd9444cfb923a20e999689953'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:51.111723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d220d0db-fd8f-41ae-b166-307c9faff072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093875bcd9444cfb923a20e999689953'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:51.124628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d220d0db-fd8f-41ae-b166-307c9faff072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093875bcd9444cfb923a20e999689953'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:51.131365 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d220d0db-fd8f-41ae-b166-307c9faff072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093875bcd9444cfb923a20e999689953'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:51.137117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1335/2660] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:50 2022] DELETE /identity/v3/users/093875bcd9444cfb923a20e999689953 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:51.408823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294c9ae-c6ca-4e75-88ab-3525265689da admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:51.410384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2294c9ae-c6ca-4e75-88ab-3525265689da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:51.425827 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294c9ae-c6ca-4e75-88ab-3525265689da admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:51.430881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:51.487150 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99956ce2-28f1-431a-aff0-1855931e0f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:51.487786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99956ce2-28f1-431a-aff0-1855931e0f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:51.488069 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99956ce2-28f1-431a-aff0-1855931e0f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:51.488347 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99956ce2-28f1-431a-aff0-1855931e0f3b admin admin] PATH_INFO: `/v3/projects/b18a1b20737a4e859a96f2647d0b8811` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:51.489459 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99956ce2-28f1-431a-aff0-1855931e0f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b18a1b20737a4e859a96f2647d0b8811)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:51.491405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99956ce2-28f1-431a-aff0-1855931e0f3b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:51.522658 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220d0db-fd8f-41ae-b166-307c9faff072 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:51.524200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d220d0db-fd8f-41ae-b166-307c9faff072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:51.537505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220d0db-fd8f-41ae-b166-307c9faff072 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:51.538388 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-99956ce2-28f1-431a-aff0-1855931e0f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b18a1b20737a4e859a96f2647d0b8811', 'request_id': 'req-99956ce2-28f1-431a-aff0-1855931e0f3b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:51.544099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-99956ce2-28f1-431a-aff0-1855931e0f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b18a1b20737a4e859a96f2647d0b8811', 'request_id': 'req-99956ce2-28f1-431a-aff0-1855931e0f3b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:51.551248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-99956ce2-28f1-431a-aff0-1855931e0f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b18a1b20737a4e859a96f2647d0b8811', 'request_id': 'req-99956ce2-28f1-431a-aff0-1855931e0f3b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:51.565914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-99956ce2-28f1-431a-aff0-1855931e0f3b admin admin] The token cache is being invalidate because project b18a1b20737a4e859a96f2647d0b8811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:51.566210 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-99956ce2-28f1-431a-aff0-1855931e0f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:51.566882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-99956ce2-28f1-431a-aff0-1855931e0f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:51.568345 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1326/2661] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:51 2022] DELETE /identity/v3/projects/b18a1b20737a4e859a96f2647d0b8811 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:51.574356 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73377866-c24e-4184-9db0-a7aafe898d5e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:51.574646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73377866-c24e-4184-9db0-a7aafe898d5e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:51.574920 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73377866-c24e-4184-9db0-a7aafe898d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:51.598414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-73377866-c24e-4184-9db0-a7aafe898d5e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:51.599527 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-73377866-c24e-4184-9db0-a7aafe898d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:51.604754 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73998d4-921d-472f-b3d5-7111049c5e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:51.605509 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73998d4-921d-472f-b3d5-7111049c5e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:51.605946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73998d4-921d-472f-b3d5-7111049c5e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:51.606321 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73998d4-921d-472f-b3d5-7111049c5e8c admin admin] PATH_INFO: `/v3/users/3847567ac9414450a0b9aae4d19ddc6d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:51.608547 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73998d4-921d-472f-b3d5-7111049c5e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3847567ac9414450a0b9aae4d19ddc6d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:51.610967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73998d4-921d-472f-b3d5-7111049c5e8c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:51.633727 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:51.662304 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a73998d4-921d-472f-b3d5-7111049c5e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3847567ac9414450a0b9aae4d19ddc6d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:51.662670 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1327/2662] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:51.662939 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a73998d4-921d-472f-b3d5-7111049c5e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3847567ac9414450a0b9aae4d19ddc6d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:51.671570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a73998d4-921d-472f-b3d5-7111049c5e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3847567ac9414450a0b9aae4d19ddc6d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:51.672294 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b5fd0-1685-43dc-bba1-0dad0901a767 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:51.672580 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b5fd0-1685-43dc-bba1-0dad0901a767 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:51.672854 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b5fd0-1685-43dc-bba1-0dad0901a767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:51.684639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a73998d4-921d-472f-b3d5-7111049c5e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3847567ac9414450a0b9aae4d19ddc6d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:51.691919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ac5b5fd0-1685-43dc-bba1-0dad0901a767 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:51.692830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a73998d4-921d-472f-b3d5-7111049c5e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3847567ac9414450a0b9aae4d19ddc6d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:51.693148 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ac5b5fd0-1685-43dc-bba1-0dad0901a767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:51.698815 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1336/2663] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:51 2022] DELETE /identity/v3/users/3847567ac9414450a0b9aae4d19ddc6d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:51.701037 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1328/2664] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:51.703160 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f0ddd-b8e2-4e0d-88b4-8fb1343178d0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:51.703448 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f0ddd-b8e2-4e0d-88b4-8fb1343178d0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:51.703718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f0ddd-b8e2-4e0d-88b4-8fb1343178d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:51.705263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b5fd0-1685-43dc-bba1-0dad0901a767 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:51.714330 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b5fd0-1685-43dc-bba1-0dad0901a767 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:51.722976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6c6f0ddd-b8e2-4e0d-88b4-8fb1343178d0 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:51.724185 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6c6f0ddd-b8e2-4e0d-88b4-8fb1343178d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:51.747000 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:51.778790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fff29-57bb-479a-a897-3c1c57b6e3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:51.780026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fff29-57bb-479a-a897-3c1c57b6e3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:51.780318 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fff29-57bb-479a-a897-3c1c57b6e3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:51.780568 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fff29-57bb-479a-a897-3c1c57b6e3b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:51.781206 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fff29-57bb-479a-a897-3c1c57b6e3b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:51.781529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fff29-57bb-479a-a897-3c1c57b6e3b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:51.783187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fff29-57bb-479a-a897-3c1c57b6e3b4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:51.784712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1337/2665] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:51.794579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f0ddd-b8e2-4e0d-88b4-8fb1343178d0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:51.799155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1329/2666] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:29:51.799300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6c6f0ddd-b8e2-4e0d-88b4-8fb1343178d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:51.800059 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fff29-57bb-479a-a897-3c1c57b6e3b4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:51.810469 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fff29-57bb-479a-a897-3c1c57b6e3b4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:51.815102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976fda3-d869-4baf-9108-3acc41ac1e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:51.815785 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976fda3-d869-4baf-9108-3acc41ac1e1f admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:51.816068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976fda3-d869-4baf-9108-3acc41ac1e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:51.816341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976fda3-d869-4baf-9108-3acc41ac1e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:51.816964 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976fda3-d869-4baf-9108-3acc41ac1e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:51.818877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976fda3-d869-4baf-9108-3acc41ac1e1f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:51.850523 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1330/2667] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:51 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:51.851649 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976fda3-d869-4baf-9108-3acc41ac1e1f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:51.856899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f0ddd-b8e2-4e0d-88b4-8fb1343178d0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:51.905607 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cbd68-bbcf-44ab-aa73-2d0b881a7713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:51.906244 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cbd68-bbcf-44ab-aa73-2d0b881a7713 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:51.906526 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cbd68-bbcf-44ab-aa73-2d0b881a7713 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:51.906798 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cbd68-bbcf-44ab-aa73-2d0b881a7713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:51.914266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:51.916061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976fda3-d869-4baf-9108-3acc41ac1e1f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:51.916671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cbd68-bbcf-44ab-aa73-2d0b881a7713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:51.918519 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cbd68-bbcf-44ab-aa73-2d0b881a7713 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:51.921881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f956d-8524-48e3-abc5-ab04e998fc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:51.922488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f956d-8524-48e3-abc5-ab04e998fc42 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:51.922764 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f956d-8524-48e3-abc5-ab04e998fc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:51.923034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f956d-8524-48e3-abc5-ab04e998fc42 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:51.923668 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f956d-8524-48e3-abc5-ab04e998fc42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:51.925610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f956d-8524-48e3-abc5-ab04e998fc42 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:51.933514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1338/2668] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:51.948987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1331/2669] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:51 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:51.953442 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cbd68-bbcf-44ab-aa73-2d0b881a7713 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:51.966358 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cbd68-bbcf-44ab-aa73-2d0b881a7713 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:51.971798 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c427de-ac21-4164-b4cb-b1fb8a7b10d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:51.972404 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c427de-ac21-4164-b4cb-b1fb8a7b10d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:51.972682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c427de-ac21-4164-b4cb-b1fb8a7b10d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:51.972950 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c427de-ac21-4164-b4cb-b1fb8a7b10d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:51.973579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c427de-ac21-4164-b4cb-b1fb8a7b10d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:51.975441 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c427de-ac21-4164-b4cb-b1fb8a7b10d9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:51.988100 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1339/2670] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:51.991796 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f956d-8524-48e3-abc5-ab04e998fc42 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:52.002883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f956d-8524-48e3-abc5-ab04e998fc42 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:52.012398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24231606-93e7-44a8-beef-81c5c7abd0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:52.013521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24231606-93e7-44a8-beef-81c5c7abd0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:52.014196 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24231606-93e7-44a8-beef-81c5c7abd0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:52.018004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24231606-93e7-44a8-beef-81c5c7abd0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:52.018982 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24231606-93e7-44a8-beef-81c5c7abd0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:52.020612 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24231606-93e7-44a8-beef-81c5c7abd0e1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:52.038468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1332/2671] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:52.042513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c427de-ac21-4164-b4cb-b1fb8a7b10d9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:52.055616 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c427de-ac21-4164-b4cb-b1fb8a7b10d9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:52.060923 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e0fd0-e2ff-498b-a395-fdacf2fa5dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:52.061592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e0fd0-e2ff-498b-a395-fdacf2fa5dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:52.061910 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e0fd0-e2ff-498b-a395-fdacf2fa5dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:52.062192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e0fd0-e2ff-498b-a395-fdacf2fa5dd2 admin admin] PATH_INFO: `/v3/projects/b82e4845266f41d8b876c3f8c0110c80/users/191951eb681849f6968b28529c5517ae/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:52.090598 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e0fd0-e2ff-498b-a395-fdacf2fa5dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b82e4845266f41d8b876c3f8c0110c80, user_id=191951eb681849f6968b28529c5517ae, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:52.094342 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e0fd0-e2ff-498b-a395-fdacf2fa5dd2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:52.110191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1340/2672] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:52 2022] PUT /identity/v3/projects/b82e4845266f41d8b876c3f8c0110c80/users/191951eb681849f6968b28529c5517ae/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:52.122303 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306624a3-2d10-4168-833f-59c262b605b3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:52.122703 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306624a3-2d10-4168-833f-59c262b605b3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:52.123662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306624a3-2d10-4168-833f-59c262b605b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:52.154649 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-306624a3-2d10-4168-833f-59c262b605b3 None None] MFA Rules not processed for user `191951eb681849f6968b28529c5517ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:52.155939 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-306624a3-2d10-4168-833f-59c262b605b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:52.233116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1333/2673] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:52.238242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e0fd0-e2ff-498b-a395-fdacf2fa5dd2 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:52.308075 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e0fd0-e2ff-498b-a395-fdacf2fa5dd2 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:52.314241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cf01c-745b-4952-b980-ae3d660c49e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:52.314859 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cf01c-745b-4952-b980-ae3d660c49e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:52.315140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cf01c-745b-4952-b980-ae3d660c49e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:52.315421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cf01c-745b-4952-b980-ae3d660c49e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:52.316072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cf01c-745b-4952-b980-ae3d660c49e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:52.318096 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cf01c-745b-4952-b980-ae3d660c49e6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:52.350881 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1341/2674] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:52 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:52.354607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306624a3-2d10-4168-833f-59c262b605b3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:52.367333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306624a3-2d10-4168-833f-59c262b605b3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:52.377625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:52.429420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a8daa-4597-4298-b7ab-419c3af07517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:52.430066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a8daa-4597-4298-b7ab-419c3af07517 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:52.430350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a8daa-4597-4298-b7ab-419c3af07517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:52.430833 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a8daa-4597-4298-b7ab-419c3af07517 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:52.431244 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a8daa-4597-4298-b7ab-419c3af07517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:52.433164 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a8daa-4597-4298-b7ab-419c3af07517 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:52.457075 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1334/2675] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:52 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:52.460988 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cf01c-745b-4952-b980-ae3d660c49e6 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:52.471906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cf01c-745b-4952-b980-ae3d660c49e6 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:52.477005 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e9c74-66c1-4725-9096-0bb9e476cd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:52.477749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e9c74-66c1-4725-9096-0bb9e476cd58 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:52.478005 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e9c74-66c1-4725-9096-0bb9e476cd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:52.478278 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e9c74-66c1-4725-9096-0bb9e476cd58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:52.478914 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e9c74-66c1-4725-9096-0bb9e476cd58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:52.480667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e9c74-66c1-4725-9096-0bb9e476cd58 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:52.491592 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a8daa-4597-4298-b7ab-419c3af07517 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:52.495136 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b72a8daa-4597-4298-b7ab-419c3af07517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:52.499919 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1342/2676] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:52.504026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e9c74-66c1-4725-9096-0bb9e476cd58 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:52.509038 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a8daa-4597-4298-b7ab-419c3af07517 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:52.515118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7d367-04eb-4aef-8071-edcae8d0421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:52.515599 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e9c74-66c1-4725-9096-0bb9e476cd58 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:52.516593 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7d367-04eb-4aef-8071-edcae8d0421a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:52.517088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7d367-04eb-4aef-8071-edcae8d0421a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:52.517308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7d367-04eb-4aef-8071-edcae8d0421a admin admin] PATH_INFO: `/v3/projects/2b4a2ca383534cad8f77365607be48a9` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:52.518484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7d367-04eb-4aef-8071-edcae8d0421a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4a2ca383534cad8f77365607be48a9)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:52.520469 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7d367-04eb-4aef-8071-edcae8d0421a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:52.520610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a2e51-2183-4f94-9be2-e9b25efc117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:52.521232 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a2e51-2183-4f94-9be2-e9b25efc117c admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:52.521484 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a2e51-2183-4f94-9be2-e9b25efc117c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:52.521798 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a2e51-2183-4f94-9be2-e9b25efc117c admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:52.522437 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a2e51-2183-4f94-9be2-e9b25efc117c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:52.524200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a2e51-2183-4f94-9be2-e9b25efc117c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:52.535280 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1343/2677] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:52.539183 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a2e51-2183-4f94-9be2-e9b25efc117c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:52.549241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a2e51-2183-4f94-9be2-e9b25efc117c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:52.554087 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ae89e-01f6-4cb8-b02e-7f3889fd3c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:52.554735 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ae89e-01f6-4cb8-b02e-7f3889fd3c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:52.555017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ae89e-01f6-4cb8-b02e-7f3889fd3c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:52.555293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ae89e-01f6-4cb8-b02e-7f3889fd3c2e admin admin] PATH_INFO: `/v3/projects/b8018a6a9011450886d177e705290919/users/7c6b3606ffe34cf7ac2e0ed4c529b9ae/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:52.571272 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7cd7d367-04eb-4aef-8071-edcae8d0421a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4a2ca383534cad8f77365607be48a9', 'request_id': 'req-7cd7d367-04eb-4aef-8071-edcae8d0421a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:52.571462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ae89e-01f6-4cb8-b02e-7f3889fd3c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8018a6a9011450886d177e705290919, user_id=7c6b3606ffe34cf7ac2e0ed4c529b9ae, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:52.574269 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ae89e-01f6-4cb8-b02e-7f3889fd3c2e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:52.578318 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7cd7d367-04eb-4aef-8071-edcae8d0421a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4a2ca383534cad8f77365607be48a9', 'request_id': 'req-7cd7d367-04eb-4aef-8071-edcae8d0421a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:52.585917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7cd7d367-04eb-4aef-8071-edcae8d0421a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4a2ca383534cad8f77365607be48a9', 'request_id': 'req-7cd7d367-04eb-4aef-8071-edcae8d0421a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:52.593408 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1344/2678] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:52 2022] PUT /identity/v3/projects/b8018a6a9011450886d177e705290919/users/7c6b3606ffe34cf7ac2e0ed4c529b9ae/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:52.605222 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7cd7d367-04eb-4aef-8071-edcae8d0421a admin admin] The token cache is being invalidate because project 2b4a2ca383534cad8f77365607be48a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:52.605514 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7cd7d367-04eb-4aef-8071-edcae8d0421a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:52.605643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22489750-50e9-432f-b5a1-a7b4baa922eb None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:52.605867 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22489750-50e9-432f-b5a1-a7b4baa922eb None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:52.606114 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22489750-50e9-432f-b5a1-a7b4baa922eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:52.606415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7cd7d367-04eb-4aef-8071-edcae8d0421a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:52.608226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1335/2679] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:52 2022] DELETE /identity/v3/projects/2b4a2ca383534cad8f77365607be48a9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:52.611964 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7d367-04eb-4aef-8071-edcae8d0421a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:52.613184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7cd7d367-04eb-4aef-8071-edcae8d0421a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:52.635843 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-22489750-50e9-432f-b5a1-a7b4baa922eb None None] MFA Rules not processed for user `7c6b3606ffe34cf7ac2e0ed4c529b9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:52.637174 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-22489750-50e9-432f-b5a1-a7b4baa922eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:52.679642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7d367-04eb-4aef-8071-edcae8d0421a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:52.683873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:52.704248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1345/2680] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:52.708660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22489750-50e9-432f-b5a1-a7b4baa922eb None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:52.709958 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-22489750-50e9-432f-b5a1-a7b4baa922eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:52.711804 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:52.742426 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a26c10-a08b-483a-9fc9-b775021b0acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:52.743146 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a26c10-a08b-483a-9fc9-b775021b0acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:52.743495 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a26c10-a08b-483a-9fc9-b775021b0acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:52.743843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a26c10-a08b-483a-9fc9-b775021b0acf admin admin] PATH_INFO: `/v3/users/9e8acf29d279454393420208932a647e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:52.745109 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a26c10-a08b-483a-9fc9-b775021b0acf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e8acf29d279454393420208932a647e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:52.747037 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a26c10-a08b-483a-9fc9-b775021b0acf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:52.777858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22489750-50e9-432f-b5a1-a7b4baa922eb None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:52.783219 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8c5a7-0ac2-4351-b8cd-90140efb0cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:52.783826 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c5a7-0ac2-4351-b8cd-90140efb0cae admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:52.784103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c5a7-0ac2-4351-b8cd-90140efb0cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:52.784380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c5a7-0ac2-4351-b8cd-90140efb0cae admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:52.785008 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8c5a7-0ac2-4351-b8cd-90140efb0cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:52.786929 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8c5a7-0ac2-4351-b8cd-90140efb0cae admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:52.793893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-31a26c10-a08b-483a-9fc9-b775021b0acf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e8acf29d279454393420208932a647e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:52.802295 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-31a26c10-a08b-483a-9fc9-b775021b0acf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e8acf29d279454393420208932a647e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:52.815563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1346/2681] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:52 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:52.818184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-31a26c10-a08b-483a-9fc9-b775021b0acf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e8acf29d279454393420208932a647e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:52.819730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8c5a7-0ac2-4351-b8cd-90140efb0cae admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:52.825672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-31a26c10-a08b-483a-9fc9-b775021b0acf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e8acf29d279454393420208932a647e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:52.827189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-31a26c10-a08b-483a-9fc9-b775021b0acf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e8acf29d279454393420208932a647e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:52.833308 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1336/2682] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:52 2022] DELETE /identity/v3/users/9e8acf29d279454393420208932a647e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:52.885273 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8c5a7-0ac2-4351-b8cd-90140efb0cae admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:52.961563 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1f99d-df3b-4dab-8cba-be9b285e9c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:52.962206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1f99d-df3b-4dab-8cba-be9b285e9c42 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:52.962511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1f99d-df3b-4dab-8cba-be9b285e9c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:52.962787 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1f99d-df3b-4dab-8cba-be9b285e9c42 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:52.963424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1f99d-df3b-4dab-8cba-be9b285e9c42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:52.965329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1f99d-df3b-4dab-8cba-be9b285e9c42 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:52.991694 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1347/2683] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:52 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:52.995578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a26c10-a08b-483a-9fc9-b775021b0acf admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:52.997017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-31a26c10-a08b-483a-9fc9-b775021b0acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:53.010385 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a26c10-a08b-483a-9fc9-b775021b0acf admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:53.015980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d348c3c-6b3b-46e1-941d-ab2c84af135e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:53.016579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d348c3c-6b3b-46e1-941d-ab2c84af135e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.016859 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d348c3c-6b3b-46e1-941d-ab2c84af135e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.017282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d348c3c-6b3b-46e1-941d-ab2c84af135e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.017803 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d348c3c-6b3b-46e1-941d-ab2c84af135e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:53.019399 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d348c3c-6b3b-46e1-941d-ab2c84af135e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:53.030009 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1337/2684] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:53.034254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1f99d-df3b-4dab-8cba-be9b285e9c42 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:53.044197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1f99d-df3b-4dab-8cba-be9b285e9c42 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:53.048835 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb75be-81ff-4bb9-9b9b-16375000bbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:53.049492 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb75be-81ff-4bb9-9b9b-16375000bbff admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.049797 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb75be-81ff-4bb9-9b9b-16375000bbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.050074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb75be-81ff-4bb9-9b9b-16375000bbff admin admin] PATH_INFO: `/v3/projects/9378b3e1d4b84c0b8875b49e6aa44585/users/ae9c9210d8b448fb8dc10d6d825e0346/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.058754 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:53.067384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb75be-81ff-4bb9-9b9b-16375000bbff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9378b3e1d4b84c0b8875b49e6aa44585, user_id=ae9c9210d8b448fb8dc10d6d825e0346, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:53.070180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb75be-81ff-4bb9-9b9b-16375000bbff admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:53.085152 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1348/2685] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:53 2022] PUT /identity/v3/projects/9378b3e1d4b84c0b8875b49e6aa44585/users/ae9c9210d8b448fb8dc10d6d825e0346/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:53.089465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d348c3c-6b3b-46e1-941d-ab2c84af135e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:53.101529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d348c3c-6b3b-46e1-941d-ab2c84af135e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:53.114642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb75be-81ff-4bb9-9b9b-16375000bbff admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:53.116826 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-29cb75be-81ff-4bb9-9b9b-16375000bbff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:53.176204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a28ec-86cf-432e-8378-3da2d8c50409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:53.176993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a28ec-86cf-432e-8378-3da2d8c50409 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.177327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a28ec-86cf-432e-8378-3da2d8c50409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.177787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a28ec-86cf-432e-8378-3da2d8c50409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.178376 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a28ec-86cf-432e-8378-3da2d8c50409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:53.180155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a28ec-86cf-432e-8378-3da2d8c50409 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:53.190221 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1338/2686] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:53.191026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a28ec-86cf-432e-8378-3da2d8c50409 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:53.192638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1d0a28ec-86cf-432e-8378-3da2d8c50409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:53.195920 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb75be-81ff-4bb9-9b9b-16375000bbff admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:53.201428 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3642910-9945-4421-ba92-93eb4078bc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:53.202466 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3642910-9945-4421-ba92-93eb4078bc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.202750 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3642910-9945-4421-ba92-93eb4078bc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.203021 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3642910-9945-4421-ba92-93eb4078bc4b admin admin] PATH_INFO: `/v3/users/0ce562113b5f4f39817100ffcaa5f46e` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.204163 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3642910-9945-4421-ba92-93eb4078bc4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce562113b5f4f39817100ffcaa5f46e)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:53.205153 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a28ec-86cf-432e-8378-3da2d8c50409 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:53.206117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3642910-9945-4421-ba92-93eb4078bc4b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:53.209927 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afc3fc-611d-4627-8e02-20857717d711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:53.210535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc3fc-611d-4627-8e02-20857717d711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.210816 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc3fc-611d-4627-8e02-20857717d711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.211089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc3fc-611d-4627-8e02-20857717d711 admin admin] PATH_INFO: `/v3/projects/2d897f868bf34badb8532c0d7c10d88b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.212211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afc3fc-611d-4627-8e02-20857717d711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d897f868bf34badb8532c0d7c10d88b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:53.214117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afc3fc-611d-4627-8e02-20857717d711 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:53.251121 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:53.253030 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d3642910-9945-4421-ba92-93eb4078bc4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce562113b5f4f39817100ffcaa5f46e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:53.253723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d3642910-9945-4421-ba92-93eb4078bc4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce562113b5f4f39817100ffcaa5f46e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:53.262667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d3642910-9945-4421-ba92-93eb4078bc4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce562113b5f4f39817100ffcaa5f46e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:53.266477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-64afc3fc-611d-4627-8e02-20857717d711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d897f868bf34badb8532c0d7c10d88b', 'request_id': 'req-64afc3fc-611d-4627-8e02-20857717d711'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:53.272315 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-64afc3fc-611d-4627-8e02-20857717d711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d897f868bf34badb8532c0d7c10d88b', 'request_id': 'req-64afc3fc-611d-4627-8e02-20857717d711'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:53.276121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d3642910-9945-4421-ba92-93eb4078bc4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce562113b5f4f39817100ffcaa5f46e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:53.279828 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-64afc3fc-611d-4627-8e02-20857717d711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d897f868bf34badb8532c0d7c10d88b', 'request_id': 'req-64afc3fc-611d-4627-8e02-20857717d711'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:53.284274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d3642910-9945-4421-ba92-93eb4078bc4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce562113b5f4f39817100ffcaa5f46e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:53.293102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-64afc3fc-611d-4627-8e02-20857717d711 admin admin] The token cache is being invalidate because project 2d897f868bf34badb8532c0d7c10d88b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:53.293393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-64afc3fc-611d-4627-8e02-20857717d711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:53.294104 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-64afc3fc-611d-4627-8e02-20857717d711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:53.294763 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1349/2687] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:53 2022] DELETE /identity/v3/users/0ce562113b5f4f39817100ffcaa5f46e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:53.295790 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3642910-9945-4421-ba92-93eb4078bc4b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:53.297178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d3642910-9945-4421-ba92-93eb4078bc4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:53.298704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1339/2688] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:53 2022] DELETE /identity/v3/projects/2d897f868bf34badb8532c0d7c10d88b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:53.300081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e803f-ce9c-4089-823e-5cd68000c7d7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.300791 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e803f-ce9c-4089-823e-5cd68000c7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.301164 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e803f-ce9c-4089-823e-5cd68000c7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.321101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e08e803f-ce9c-4089-823e-5cd68000c7d7 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:53.322322 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e08e803f-ce9c-4089-823e-5cd68000c7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:53.364052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3642910-9945-4421-ba92-93eb4078bc4b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:53.369778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c605c8-a57d-411f-85a2-91ff73a3bb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:53.370432 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c605c8-a57d-411f-85a2-91ff73a3bb52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.370714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c605c8-a57d-411f-85a2-91ff73a3bb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.370990 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c605c8-a57d-411f-85a2-91ff73a3bb52 admin admin] PATH_INFO: `/v3/projects/9378b3e1d4b84c0b8875b49e6aa44585/users/ae9c9210d8b448fb8dc10d6d825e0346/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.373422 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c605c8-a57d-411f-85a2-91ff73a3bb52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9378b3e1d4b84c0b8875b49e6aa44585, user_id=ae9c9210d8b448fb8dc10d6d825e0346, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:53.377423 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c605c8-a57d-411f-85a2-91ff73a3bb52 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:53.383099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1340/2689] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:53.386873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:53.387016 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dcab9-a93f-43d4-94cc-38e267f03f50 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.387016 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dcab9-a93f-43d4-94cc-38e267f03f50 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.387016 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dcab9-a93f-43d4-94cc-38e267f03f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.391615 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1350/2690] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:53 2022] PUT /identity/v3/projects/9378b3e1d4b84c0b8875b49e6aa44585/users/ae9c9210d8b448fb8dc10d6d825e0346/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:53.395214 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c605c8-a57d-411f-85a2-91ff73a3bb52 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:53.398309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-92c605c8-a57d-411f-85a2-91ff73a3bb52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:53.407175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4e0dcab9-a93f-43d4-94cc-38e267f03f50 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:53.408463 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4e0dcab9-a93f-43d4-94cc-38e267f03f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:53.461012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c605c8-a57d-411f-85a2-91ff73a3bb52 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:53.464758 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d01968-2872-424f-b10b-430603e90be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:53.465364 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d01968-2872-424f-b10b-430603e90be7 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.465643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d01968-2872-424f-b10b-430603e90be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.465940 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d01968-2872-424f-b10b-430603e90be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.470787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1341/2691] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:53.472184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cfd90-6e6c-48f9-9bbb-0fd0106fce55 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.472524 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cfd90-6e6c-48f9-9bbb-0fd0106fce55 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.472797 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cfd90-6e6c-48f9-9bbb-0fd0106fce55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.475604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d01968-2872-424f-b10b-430603e90be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:53.477030 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d01968-2872-424f-b10b-430603e90be7 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:53.487327 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1351/2692] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:53.488687 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b28b8e-3d83-42ac-8fa7-9138ecb72d3d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.488965 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b28b8e-3d83-42ac-8fa7-9138ecb72d3d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.489243 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b28b8e-3d83-42ac-8fa7-9138ecb72d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.505218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1f9cfd90-6e6c-48f9-9bbb-0fd0106fce55 None None] MFA Rules not processed for user `ae9c9210d8b448fb8dc10d6d825e0346`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:53.506479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1f9cfd90-6e6c-48f9-9bbb-0fd0106fce55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:53.510774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f7b28b8e-3d83-42ac-8fa7-9138ecb72d3d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:53.511954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f7b28b8e-3d83-42ac-8fa7-9138ecb72d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:53.520736 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1352/2693] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:53.525439 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b28b8e-3d83-42ac-8fa7-9138ecb72d3d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:53.536190 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b28b8e-3d83-42ac-8fa7-9138ecb72d3d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:53.541048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee40cb-09cf-4966-9a46-498ce0e16559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:53.541659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee40cb-09cf-4966-9a46-498ce0e16559 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.541971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee40cb-09cf-4966-9a46-498ce0e16559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.542244 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee40cb-09cf-4966-9a46-498ce0e16559 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.542933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee40cb-09cf-4966-9a46-498ce0e16559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:53.543236 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee40cb-09cf-4966-9a46-498ce0e16559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:53.545533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee40cb-09cf-4966-9a46-498ce0e16559 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:53.559831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1353/2694] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:29:53.564678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:53.566491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee40cb-09cf-4966-9a46-498ce0e16559 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:53.580080 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee40cb-09cf-4966-9a46-498ce0e16559 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:53.584798 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc069f-1cd4-4be6-afce-6e2ba181d224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:53.585427 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc069f-1cd4-4be6-afce-6e2ba181d224 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.585726 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc069f-1cd4-4be6-afce-6e2ba181d224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.585996 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc069f-1cd4-4be6-afce-6e2ba181d224 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.586620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc069f-1cd4-4be6-afce-6e2ba181d224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:53.588778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc069f-1cd4-4be6-afce-6e2ba181d224 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:53.593154 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1342/2695] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:53.605237 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cfd90-6e6c-48f9-9bbb-0fd0106fce55 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:53.606648 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1f9cfd90-6e6c-48f9-9bbb-0fd0106fce55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:53.623959 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1354/2696] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:53 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:53.628670 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc069f-1cd4-4be6-afce-6e2ba181d224 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:53.676015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cfd90-6e6c-48f9-9bbb-0fd0106fce55 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:53.708820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc069f-1cd4-4be6-afce-6e2ba181d224 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:53.713883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aab169-3b96-45a8-9f16-5d1e8fc5f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:53.714600 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aab169-3b96-45a8-9f16-5d1e8fc5f518 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.714898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aab169-3b96-45a8-9f16-5d1e8fc5f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.715241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aab169-3b96-45a8-9f16-5d1e8fc5f518 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.716134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aab169-3b96-45a8-9f16-5d1e8fc5f518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:53.718813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aab169-3b96-45a8-9f16-5d1e8fc5f518 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:53.735547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11d7d6-f18c-453c-a9e6-74671eaad31a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:53.736037 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11d7d6-f18c-453c-a9e6-74671eaad31a service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.736326 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11d7d6-f18c-453c-a9e6-74671eaad31a service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.736638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11d7d6-f18c-453c-a9e6-74671eaad31a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.743822 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1355/2697] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:53 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:53.748259 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aab169-3b96-45a8-9f16-5d1e8fc5f518 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:53.760197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aab169-3b96-45a8-9f16-5d1e8fc5f518 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:53.768119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f4dde-8ab4-410c-b14c-7239c12adb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:53.768723 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f4dde-8ab4-410c-b14c-7239c12adb31 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.769050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f4dde-8ab4-410c-b14c-7239c12adb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.769321 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f4dde-8ab4-410c-b14c-7239c12adb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.769989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f4dde-8ab4-410c-b14c-7239c12adb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:53.771792 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f4dde-8ab4-410c-b14c-7239c12adb31 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:53.786667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1356/2698] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:53.789021 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f4dde-8ab4-410c-b14c-7239c12adb31 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:53.791232 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d04f4dde-8ab4-410c-b14c-7239c12adb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:53.805497 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f4dde-8ab4-410c-b14c-7239c12adb31 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:53.812066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8340f49-f55c-40bd-9b6d-e00798cd568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:53.812834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8340f49-f55c-40bd-9b6d-e00798cd568b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.813227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8340f49-f55c-40bd-9b6d-e00798cd568b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.813580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8340f49-f55c-40bd-9b6d-e00798cd568b admin admin] PATH_INFO: `/v3/projects/75e4867487b049eaa8cb33ada3509151` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.815106 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8340f49-f55c-40bd-9b6d-e00798cd568b admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e4867487b049eaa8cb33ada3509151)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:53.817669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8340f49-f55c-40bd-9b6d-e00798cd568b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:53.818500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11d7d6-f18c-453c-a9e6-74671eaad31a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:53.820212 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11d7d6-f18c-453c-a9e6-74671eaad31a service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:53.832048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1343/2699] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:53.834603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11d7d6-f18c-453c-a9e6-74671eaad31a service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:53.848084 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11d7d6-f18c-453c-a9e6-74671eaad31a service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:53.853989 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca610d68-6ab0-4961-8d6f-1b4c5c44e23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:53.854684 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca610d68-6ab0-4961-8d6f-1b4c5c44e23a admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.855009 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca610d68-6ab0-4961-8d6f-1b4c5c44e23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.855255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca610d68-6ab0-4961-8d6f-1b4c5c44e23a admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.855962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca610d68-6ab0-4961-8d6f-1b4c5c44e23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:53.857578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca610d68-6ab0-4961-8d6f-1b4c5c44e23a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:53.867241 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:53.869429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1344/2700] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:53.873798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca610d68-6ab0-4961-8d6f-1b4c5c44e23a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:53.883160 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f8340f49-f55c-40bd-9b6d-e00798cd568b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e4867487b049eaa8cb33ada3509151', 'request_id': 'req-f8340f49-f55c-40bd-9b6d-e00798cd568b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:53.884393 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca610d68-6ab0-4961-8d6f-1b4c5c44e23a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:53.889970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f8340f49-f55c-40bd-9b6d-e00798cd568b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e4867487b049eaa8cb33ada3509151', 'request_id': 'req-f8340f49-f55c-40bd-9b6d-e00798cd568b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:53.896889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f8340f49-f55c-40bd-9b6d-e00798cd568b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e4867487b049eaa8cb33ada3509151', 'request_id': 'req-f8340f49-f55c-40bd-9b6d-e00798cd568b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:53.911618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f8340f49-f55c-40bd-9b6d-e00798cd568b admin admin] The token cache is being invalidate because project 75e4867487b049eaa8cb33ada3509151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:53.911918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f8340f49-f55c-40bd-9b6d-e00798cd568b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:53.912570 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f8340f49-f55c-40bd-9b6d-e00798cd568b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:53.925819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1357/2701] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:53 2022] DELETE /identity/v3/projects/75e4867487b049eaa8cb33ada3509151 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:53.925819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8340f49-f55c-40bd-9b6d-e00798cd568b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:53.935438 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:53.935709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f8340f49-f55c-40bd-9b6d-e00798cd568b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:53.949400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deed90e-1ca7-4f8b-8ce7-15ad35544664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:53.950191 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deed90e-1ca7-4f8b-8ce7-15ad35544664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:53.950471 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deed90e-1ca7-4f8b-8ce7-15ad35544664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:53.950744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deed90e-1ca7-4f8b-8ce7-15ad35544664 admin admin] PATH_INFO: `/v3/projects/4c62acc2990049c1a637bf239b254f14/users/885a78c3a54340fda7ecfd294a6fe98f/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:53.971765 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deed90e-1ca7-4f8b-8ce7-15ad35544664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c62acc2990049c1a637bf239b254f14, user_id=885a78c3a54340fda7ecfd294a6fe98f, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:53.974570 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deed90e-1ca7-4f8b-8ce7-15ad35544664 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:53.995439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1345/2702] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:53 2022] PUT /identity/v3/projects/4c62acc2990049c1a637bf239b254f14/users/885a78c3a54340fda7ecfd294a6fe98f/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:54.006470 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8340f49-f55c-40bd-9b6d-e00798cd568b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:54.009400 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf115f04-d99c-4852-b230-1e0fc3319a93 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:54.010969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf115f04-d99c-4852-b230-1e0fc3319a93 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:54.011601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf115f04-d99c-4852-b230-1e0fc3319a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:54.051410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cf115f04-d99c-4852-b230-1e0fc3319a93 None None] MFA Rules not processed for user `885a78c3a54340fda7ecfd294a6fe98f`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:54.052644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cf115f04-d99c-4852-b230-1e0fc3319a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:54.063366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f857ff-699f-4356-a65b-66e401f38918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:54.064136 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f857ff-699f-4356-a65b-66e401f38918 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:54.064527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f857ff-699f-4356-a65b-66e401f38918 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:54.065553 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f857ff-699f-4356-a65b-66e401f38918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:54.067954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f0f857ff-699f-4356-a65b-66e401f38918 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:54.143786 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1346/2703] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:54.152619 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f857ff-699f-4356-a65b-66e401f38918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:54.154215 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f857ff-699f-4356-a65b-66e401f38918 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:54.156660 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf115f04-d99c-4852-b230-1e0fc3319a93 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:54.158319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cf115f04-d99c-4852-b230-1e0fc3319a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:54.166187 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1358/2704] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:54.175524 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf115f04-d99c-4852-b230-1e0fc3319a93 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:54.179978 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6172f-1dc8-4a82-a1ba-292f486a1491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:54.180607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6172f-1dc8-4a82-a1ba-292f486a1491 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:54.180886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6172f-1dc8-4a82-a1ba-292f486a1491 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:54.181154 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6172f-1dc8-4a82-a1ba-292f486a1491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:54.191543 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6172f-1dc8-4a82-a1ba-292f486a1491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:54.193033 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6172f-1dc8-4a82-a1ba-292f486a1491 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:54.204071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1347/2705] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:56.796453 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f857ff-699f-4356-a65b-66e401f38918 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:56.797895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f0f857ff-699f-4356-a65b-66e401f38918 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:56.832011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:56.863461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f857ff-699f-4356-a65b-66e401f38918 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:56.868013 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e2f2e-e08e-4840-a0db-0178ba00d16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:56.868631 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e2f2e-e08e-4840-a0db-0178ba00d16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:56.868930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e2f2e-e08e-4840-a0db-0178ba00d16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:56.869201 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e2f2e-e08e-4840-a0db-0178ba00d16b admin admin] PATH_INFO: `/v3/users/885a78c3a54340fda7ecfd294a6fe98f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:56.870356 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e2f2e-e08e-4840-a0db-0178ba00d16b admin admin] RBAC: Authorizing `identity:delete_user(user_id=885a78c3a54340fda7ecfd294a6fe98f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:56.872264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e2f2e-e08e-4840-a0db-0178ba00d16b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:56.917048 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8e0e2f2e-e08e-4840-a0db-0178ba00d16b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885a78c3a54340fda7ecfd294a6fe98f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:56.917745 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8e0e2f2e-e08e-4840-a0db-0178ba00d16b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885a78c3a54340fda7ecfd294a6fe98f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:56.925632 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8e0e2f2e-e08e-4840-a0db-0178ba00d16b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885a78c3a54340fda7ecfd294a6fe98f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:56.938247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8e0e2f2e-e08e-4840-a0db-0178ba00d16b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885a78c3a54340fda7ecfd294a6fe98f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:56.944889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8e0e2f2e-e08e-4840-a0db-0178ba00d16b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885a78c3a54340fda7ecfd294a6fe98f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:56.950672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1359/2706] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:56 2022] DELETE /identity/v3/users/885a78c3a54340fda7ecfd294a6fe98f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:56.955316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad9a8f-e0c4-41cc-bdd1-cfd8f2d68cc2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:56.955798 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad9a8f-e0c4-41cc-bdd1-cfd8f2d68cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:56.955905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad9a8f-e0c4-41cc-bdd1-cfd8f2d68cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:56.974996 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e9ad9a8f-e0c4-41cc-bdd1-cfd8f2d68cc2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:56.976182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e9ad9a8f-e0c4-41cc-bdd1-cfd8f2d68cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:57.036778 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1348/2707] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:57.047058 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e2f2e-e08e-4840-a0db-0178ba00d16b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:57.048512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8e0e2f2e-e08e-4840-a0db-0178ba00d16b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:57.090114 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad9a8f-e0c4-41cc-bdd1-cfd8f2d68cc2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:57.091575 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e9ad9a8f-e0c4-41cc-bdd1-cfd8f2d68cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:57.103653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad9a8f-e0c4-41cc-bdd1-cfd8f2d68cc2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:57.109279 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b56b2a-0fe7-418d-a1a0-1f2fb04727cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:57.109942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56b2a-0fe7-418d-a1a0-1f2fb04727cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:57.110224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56b2a-0fe7-418d-a1a0-1f2fb04727cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:57.110501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56b2a-0fe7-418d-a1a0-1f2fb04727cb admin admin] PATH_INFO: `/v3/users/191951eb681849f6968b28529c5517ae` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:57.111649 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b56b2a-0fe7-418d-a1a0-1f2fb04727cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=191951eb681849f6968b28529c5517ae)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:57.113582 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b56b2a-0fe7-418d-a1a0-1f2fb04727cb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:57.117175 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e2f2e-e08e-4840-a0db-0178ba00d16b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:57.121060 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27e97a-26e1-40b1-9257-cd777693e3e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:57.121676 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27e97a-26e1-40b1-9257-cd777693e3e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:57.122073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27e97a-26e1-40b1-9257-cd777693e3e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:57.122350 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27e97a-26e1-40b1-9257-cd777693e3e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:57.132674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27e97a-26e1-40b1-9257-cd777693e3e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:57.134147 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27e97a-26e1-40b1-9257-cd777693e3e2 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:57.144833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1360/2708] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:57.155883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:57.166819 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-87b56b2a-0fe7-418d-a1a0-1f2fb04727cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191951eb681849f6968b28529c5517ae'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.175275 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-87b56b2a-0fe7-418d-a1a0-1f2fb04727cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191951eb681849f6968b28529c5517ae'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.188490 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-87b56b2a-0fe7-418d-a1a0-1f2fb04727cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191951eb681849f6968b28529c5517ae'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.196070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-87b56b2a-0fe7-418d-a1a0-1f2fb04727cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191951eb681849f6968b28529c5517ae'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.196945 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-87b56b2a-0fe7-418d-a1a0-1f2fb04727cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191951eb681849f6968b28529c5517ae'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.203538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1349/2709] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:57 2022] DELETE /identity/v3/users/191951eb681849f6968b28529c5517ae => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:57.208125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880b3cc-cd57-45f1-b67e-8e1b551a5fe2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:57.208411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880b3cc-cd57-45f1-b67e-8e1b551a5fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:57.208692 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880b3cc-cd57-45f1-b67e-8e1b551a5fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:57.230739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-c880b3cc-cd57-45f1-b67e-8e1b551a5fe2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:57.232515 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c880b3cc-cd57-45f1-b67e-8e1b551a5fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:57.281465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:57.296960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1361/2710] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:57.309502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b56b2a-0fe7-418d-a1a0-1f2fb04727cb admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:57.311864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-87b56b2a-0fe7-418d-a1a0-1f2fb04727cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:57.373706 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b56b2a-0fe7-418d-a1a0-1f2fb04727cb admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:57.377550 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68478013-c9b4-41d8-84da-127d68ea4f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:57.378189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68478013-c9b4-41d8-84da-127d68ea4f7a service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:57.378517 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68478013-c9b4-41d8-84da-127d68ea4f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:57.378748 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68478013-c9b4-41d8-84da-127d68ea4f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:57.388187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68478013-c9b4-41d8-84da-127d68ea4f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:57.389943 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68478013-c9b4-41d8-84da-127d68ea4f7a service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:57.400215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1350/2711] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:29:57.468365 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880b3cc-cd57-45f1-b67e-8e1b551a5fe2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:57.470329 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c880b3cc-cd57-45f1-b67e-8e1b551a5fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:57.482836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880b3cc-cd57-45f1-b67e-8e1b551a5fe2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:57.487682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b9e75-492e-4437-9268-ee0f505a57c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:57.488321 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9e75-492e-4437-9268-ee0f505a57c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:57.488629 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9e75-492e-4437-9268-ee0f505a57c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:57.488904 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9e75-492e-4437-9268-ee0f505a57c4 admin admin] PATH_INFO: `/v3/projects/4c62acc2990049c1a637bf239b254f14` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:57.490169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b9e75-492e-4437-9268-ee0f505a57c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c62acc2990049c1a637bf239b254f14)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:57.492076 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b9e75-492e-4437-9268-ee0f505a57c4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:57.549873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6e9b9e75-492e-4437-9268-ee0f505a57c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c62acc2990049c1a637bf239b254f14', 'request_id': 'req-6e9b9e75-492e-4437-9268-ee0f505a57c4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.555758 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6e9b9e75-492e-4437-9268-ee0f505a57c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c62acc2990049c1a637bf239b254f14', 'request_id': 'req-6e9b9e75-492e-4437-9268-ee0f505a57c4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.563308 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6e9b9e75-492e-4437-9268-ee0f505a57c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c62acc2990049c1a637bf239b254f14', 'request_id': 'req-6e9b9e75-492e-4437-9268-ee0f505a57c4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.577993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6e9b9e75-492e-4437-9268-ee0f505a57c4 admin admin] The token cache is being invalidate because project 4c62acc2990049c1a637bf239b254f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:57.578276 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6e9b9e75-492e-4437-9268-ee0f505a57c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.578905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6e9b9e75-492e-4437-9268-ee0f505a57c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.580395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1362/2712] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:57 2022] DELETE /identity/v3/projects/4c62acc2990049c1a637bf239b254f14 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:57.585790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b58340-dc7b-4e95-aec2-e24ec812843a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:57.586189 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b58340-dc7b-4e95-aec2-e24ec812843a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:57.586680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b58340-dc7b-4e95-aec2-e24ec812843a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:57.609176 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c2b58340-dc7b-4e95-aec2-e24ec812843a None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:57.610487 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c2b58340-dc7b-4e95-aec2-e24ec812843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:57.675361 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1351/2713] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:57.683172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0dac4-af79-4a94-957a-cf6a2987a577 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:57.683534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0dac4-af79-4a94-957a-cf6a2987a577 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:57.683883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0dac4-af79-4a94-957a-cf6a2987a577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:57.706406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-55c0dac4-af79-4a94-957a-cf6a2987a577 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:57.707671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-55c0dac4-af79-4a94-957a-cf6a2987a577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:57.716325 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1363/2714] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:57.721343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b58340-dc7b-4e95-aec2-e24ec812843a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:57.723538 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0dac4-af79-4a94-957a-cf6a2987a577 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:57.724837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-55c0dac4-af79-4a94-957a-cf6a2987a577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:57.731316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b58340-dc7b-4e95-aec2-e24ec812843a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:57.736666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0dac4-af79-4a94-957a-cf6a2987a577 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:57.737288 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f7e67-7e4f-46c3-bcc6-94bffa7f1524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:57.738016 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f7e67-7e4f-46c3-bcc6-94bffa7f1524 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:57.738365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f7e67-7e4f-46c3-bcc6-94bffa7f1524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:57.738755 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f7e67-7e4f-46c3-bcc6-94bffa7f1524 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:57.739445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f7e67-7e4f-46c3-bcc6-94bffa7f1524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:57.739811 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f7e67-7e4f-46c3-bcc6-94bffa7f1524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:57.741479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f7e67-7e4f-46c3-bcc6-94bffa7f1524 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:57.742074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a61ba0-0452-4a4c-b869-2b80e421eaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:57.742791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a61ba0-0452-4a4c-b869-2b80e421eaca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:57.743146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a61ba0-0452-4a4c-b869-2b80e421eaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:57.743545 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a61ba0-0452-4a4c-b869-2b80e421eaca admin admin] PATH_INFO: `/v3/projects/b82e4845266f41d8b876c3f8c0110c80` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:57.745231 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a61ba0-0452-4a4c-b869-2b80e421eaca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b82e4845266f41d8b876c3f8c0110c80)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:57.747277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a61ba0-0452-4a4c-b869-2b80e421eaca admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:57.758014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1352/2715] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:29:57.760973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f7e67-7e4f-46c3-bcc6-94bffa7f1524 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:57.772333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f7e67-7e4f-46c3-bcc6-94bffa7f1524 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:57.776914 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e04a27-5f9a-4579-81c9-eb962441fc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:57.777504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e04a27-5f9a-4579-81c9-eb962441fc4c admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:57.777882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e04a27-5f9a-4579-81c9-eb962441fc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:57.778337 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e04a27-5f9a-4579-81c9-eb962441fc4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:57.779869 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e04a27-5f9a-4579-81c9-eb962441fc4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:57.782131 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e04a27-5f9a-4579-81c9-eb962441fc4c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:57.801240 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-34a61ba0-0452-4a4c-b869-2b80e421eaca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b82e4845266f41d8b876c3f8c0110c80', 'request_id': 'req-34a61ba0-0452-4a4c-b869-2b80e421eaca'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.807232 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-34a61ba0-0452-4a4c-b869-2b80e421eaca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b82e4845266f41d8b876c3f8c0110c80', 'request_id': 'req-34a61ba0-0452-4a4c-b869-2b80e421eaca'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.809702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1353/2716] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:57 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:57.814035 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-34a61ba0-0452-4a4c-b869-2b80e421eaca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b82e4845266f41d8b876c3f8c0110c80', 'request_id': 'req-34a61ba0-0452-4a4c-b869-2b80e421eaca'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.814546 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e04a27-5f9a-4579-81c9-eb962441fc4c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:57.828099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-34a61ba0-0452-4a4c-b869-2b80e421eaca admin admin] The token cache is being invalidate because project b82e4845266f41d8b876c3f8c0110c80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:57.828391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-34a61ba0-0452-4a4c-b869-2b80e421eaca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.829082 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-34a61ba0-0452-4a4c-b869-2b80e421eaca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.830635 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1364/2717] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:57 2022] DELETE /identity/v3/projects/b82e4845266f41d8b876c3f8c0110c80 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:57.834432 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a61ba0-0452-4a4c-b869-2b80e421eaca admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:57.835749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-34a61ba0-0452-4a4c-b869-2b80e421eaca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:57.842658 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:57.883666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e04a27-5f9a-4579-81c9-eb962441fc4c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:57.888972 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94183299-4c73-4b99-a000-744f30d93a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:57.889581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94183299-4c73-4b99-a000-744f30d93a04 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:57.889892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94183299-4c73-4b99-a000-744f30d93a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:57.890167 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94183299-4c73-4b99-a000-744f30d93a04 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:57.890779 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94183299-4c73-4b99-a000-744f30d93a04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:57.892673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94183299-4c73-4b99-a000-744f30d93a04 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:57.896801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:57.902205 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a61ba0-0452-4a4c-b869-2b80e421eaca admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:57.909137 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e57ef-3e95-4ea8-a94e-0e638cd90f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:57.909863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e57ef-3e95-4ea8-a94e-0e638cd90f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:57.910381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e57ef-3e95-4ea8-a94e-0e638cd90f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:57.910786 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e57ef-3e95-4ea8-a94e-0e638cd90f29 admin admin] PATH_INFO: `/v3/users/7c6b3606ffe34cf7ac2e0ed4c529b9ae` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:57.912206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e57ef-3e95-4ea8-a94e-0e638cd90f29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6b3606ffe34cf7ac2e0ed4c529b9ae)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:57.914151 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e57ef-3e95-4ea8-a94e-0e638cd90f29 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:57.915364 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1354/2718] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:57 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:57.920345 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94183299-4c73-4b99-a000-744f30d93a04 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:57.922188 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-94183299-4c73-4b99-a000-744f30d93a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:57.934073 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94183299-4c73-4b99-a000-744f30d93a04 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:57.941652 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451974ae-0b45-46cc-b239-8f16d5ef2be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:57.942307 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451974ae-0b45-46cc-b239-8f16d5ef2be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:57.942583 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451974ae-0b45-46cc-b239-8f16d5ef2be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:57.942881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451974ae-0b45-46cc-b239-8f16d5ef2be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:57.943501 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451974ae-0b45-46cc-b239-8f16d5ef2be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:57.945173 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451974ae-0b45-46cc-b239-8f16d5ef2be3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:57.955883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1355/2719] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:57.959850 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451974ae-0b45-46cc-b239-8f16d5ef2be3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:57.967014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-564e57ef-3e95-4ea8-a94e-0e638cd90f29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6b3606ffe34cf7ac2e0ed4c529b9ae'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.968210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-564e57ef-3e95-4ea8-a94e-0e638cd90f29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6b3606ffe34cf7ac2e0ed4c529b9ae'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.970406 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451974ae-0b45-46cc-b239-8f16d5ef2be3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:57.975132 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35884bed-fc47-40fb-b673-2f9830cbcc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:57.975773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35884bed-fc47-40fb-b673-2f9830cbcc66 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:57.976051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35884bed-fc47-40fb-b673-2f9830cbcc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:57.976347 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35884bed-fc47-40fb-b673-2f9830cbcc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:57.976855 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-564e57ef-3e95-4ea8-a94e-0e638cd90f29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6b3606ffe34cf7ac2e0ed4c529b9ae'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.976984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35884bed-fc47-40fb-b673-2f9830cbcc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:57.978567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35884bed-fc47-40fb-b673-2f9830cbcc66 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:57.989678 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-564e57ef-3e95-4ea8-a94e-0e638cd90f29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6b3606ffe34cf7ac2e0ed4c529b9ae'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:57.990465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1356/2720] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:57.994507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35884bed-fc47-40fb-b673-2f9830cbcc66 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:57.996687 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-564e57ef-3e95-4ea8-a94e-0e638cd90f29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6b3606ffe34cf7ac2e0ed4c529b9ae'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:58.003229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1365/2721] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:57 2022] DELETE /identity/v3/users/7c6b3606ffe34cf7ac2e0ed4c529b9ae => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:58.004331 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35884bed-fc47-40fb-b673-2f9830cbcc66 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:58.065221 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e373d2b-7026-4d8b-8e18-f1221fc36370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:58.065969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e373d2b-7026-4d8b-8e18-f1221fc36370 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:58.066353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e373d2b-7026-4d8b-8e18-f1221fc36370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:58.066699 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e373d2b-7026-4d8b-8e18-f1221fc36370 admin admin] PATH_INFO: `/v3/projects/5b89dd4e2a5749d4bae6533bee337c66/users/73a1153d0982475dbf83c3ab1974c850/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:58.082288 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e373d2b-7026-4d8b-8e18-f1221fc36370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b89dd4e2a5749d4bae6533bee337c66, user_id=73a1153d0982475dbf83c3ab1974c850, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:58.085115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e373d2b-7026-4d8b-8e18-f1221fc36370 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:58.101635 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1357/2722] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:57 2022] PUT /identity/v3/projects/5b89dd4e2a5749d4bae6533bee337c66/users/73a1153d0982475dbf83c3ab1974c850/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:58.106955 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b38bb-f438-4a5a-a161-2c1401bfccdb None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:58.108011 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b38bb-f438-4a5a-a161-2c1401bfccdb None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:58.108301 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b38bb-f438-4a5a-a161-2c1401bfccdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:58.128293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-006b38bb-f438-4a5a-a161-2c1401bfccdb None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:58.129519 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-006b38bb-f438-4a5a-a161-2c1401bfccdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:58.195681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1366/2723] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:58.207161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e373d2b-7026-4d8b-8e18-f1221fc36370 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:58.208870 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2e373d2b-7026-4d8b-8e18-f1221fc36370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:58.270703 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e373d2b-7026-4d8b-8e18-f1221fc36370 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:58.274502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067e9ec-21d1-4309-ba74-38e56df3f4bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:58.275300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067e9ec-21d1-4309-ba74-38e56df3f4bd service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:58.275755 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067e9ec-21d1-4309-ba74-38e56df3f4bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:58.276026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067e9ec-21d1-4309-ba74-38e56df3f4bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:58.286147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067e9ec-21d1-4309-ba74-38e56df3f4bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:58.287571 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067e9ec-21d1-4309-ba74-38e56df3f4bd service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:58.291539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b38bb-f438-4a5a-a161-2c1401bfccdb None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:58.292990 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-006b38bb-f438-4a5a-a161-2c1401bfccdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:58.298230 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1358/2724] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:29:58.305289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b38bb-f438-4a5a-a161-2c1401bfccdb None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:58.311820 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90975f04-c867-4baf-88a9-c39a6cdd42bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:58.312503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90975f04-c867-4baf-88a9-c39a6cdd42bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:58.312780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90975f04-c867-4baf-88a9-c39a6cdd42bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:58.313062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90975f04-c867-4baf-88a9-c39a6cdd42bf admin admin] PATH_INFO: `/v3/projects/b8018a6a9011450886d177e705290919` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:58.314284 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90975f04-c867-4baf-88a9-c39a6cdd42bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8018a6a9011450886d177e705290919)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:58.316235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90975f04-c867-4baf-88a9-c39a6cdd42bf admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:58.374266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-90975f04-c867-4baf-88a9-c39a6cdd42bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8018a6a9011450886d177e705290919', 'request_id': 'req-90975f04-c867-4baf-88a9-c39a6cdd42bf'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:58.380085 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-90975f04-c867-4baf-88a9-c39a6cdd42bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8018a6a9011450886d177e705290919', 'request_id': 'req-90975f04-c867-4baf-88a9-c39a6cdd42bf'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:58.386705 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-90975f04-c867-4baf-88a9-c39a6cdd42bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8018a6a9011450886d177e705290919', 'request_id': 'req-90975f04-c867-4baf-88a9-c39a6cdd42bf'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:58.398078 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:58.403235 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-90975f04-c867-4baf-88a9-c39a6cdd42bf admin admin] The token cache is being invalidate because project b8018a6a9011450886d177e705290919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:58.404410 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-90975f04-c867-4baf-88a9-c39a6cdd42bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:58.405949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-90975f04-c867-4baf-88a9-c39a6cdd42bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:58.407791 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1367/2725] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:58 2022] DELETE /identity/v3/projects/b8018a6a9011450886d177e705290919 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:29:58.411745 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067e9ec-21d1-4309-ba74-38e56df3f4bd service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:58.423291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067e9ec-21d1-4309-ba74-38e56df3f4bd service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:58.439613 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:58.499030 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d3aa6-877d-41c2-9001-f1889f7de55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:58.499694 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d3aa6-877d-41c2-9001-f1889f7de55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:58.499969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d3aa6-877d-41c2-9001-f1889f7de55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:58.500236 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d3aa6-877d-41c2-9001-f1889f7de55d admin admin] PATH_INFO: `/v3/users/ae9c9210d8b448fb8dc10d6d825e0346` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:58.501485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d3aa6-877d-41c2-9001-f1889f7de55d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9c9210d8b448fb8dc10d6d825e0346)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:58.503518 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d3aa6-877d-41c2-9001-f1889f7de55d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:58.551218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ff9d3aa6-877d-41c2-9001-f1889f7de55d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9c9210d8b448fb8dc10d6d825e0346'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:58.558919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ff9d3aa6-877d-41c2-9001-f1889f7de55d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9c9210d8b448fb8dc10d6d825e0346'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:58.571973 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ff9d3aa6-877d-41c2-9001-f1889f7de55d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9c9210d8b448fb8dc10d6d825e0346'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:58.581149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ff9d3aa6-877d-41c2-9001-f1889f7de55d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9c9210d8b448fb8dc10d6d825e0346'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:58.581908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ff9d3aa6-877d-41c2-9001-f1889f7de55d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9c9210d8b448fb8dc10d6d825e0346'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:58.587899 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1359/2726] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:29:58 2022] DELETE /identity/v3/users/ae9c9210d8b448fb8dc10d6d825e0346 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:58.991890 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90975f04-c867-4baf-88a9-c39a6cdd42bf admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:58.993610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-90975f04-c867-4baf-88a9-c39a6cdd42bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:59.022810 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90975f04-c867-4baf-88a9-c39a6cdd42bf admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:59.096186 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90f7aa-a1b1-4319-9173-ebd146dc8a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:59.096889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90f7aa-a1b1-4319-9173-ebd146dc8a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:59.097224 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90f7aa-a1b1-4319-9173-ebd146dc8a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:59.097602 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90f7aa-a1b1-4319-9173-ebd146dc8a13 admin admin] PATH_INFO: `/v3/projects/9378b3e1d4b84c0b8875b49e6aa44585` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:59.099108 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90f7aa-a1b1-4319-9173-ebd146dc8a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9378b3e1d4b84c0b8875b49e6aa44585)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:59.101276 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90f7aa-a1b1-4319-9173-ebd146dc8a13 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:59.171154 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef90f7aa-a1b1-4319-9173-ebd146dc8a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9378b3e1d4b84c0b8875b49e6aa44585', 'request_id': 'req-ef90f7aa-a1b1-4319-9173-ebd146dc8a13'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:59.182216 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef90f7aa-a1b1-4319-9173-ebd146dc8a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9378b3e1d4b84c0b8875b49e6aa44585', 'request_id': 'req-ef90f7aa-a1b1-4319-9173-ebd146dc8a13'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:59.191602 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef90f7aa-a1b1-4319-9173-ebd146dc8a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9378b3e1d4b84c0b8875b49e6aa44585', 'request_id': 'req-ef90f7aa-a1b1-4319-9173-ebd146dc8a13'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:59.206002 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef90f7aa-a1b1-4319-9173-ebd146dc8a13 admin admin] The token cache is being invalidate because project 9378b3e1d4b84c0b8875b49e6aa44585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:29:59.206345 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef90f7aa-a1b1-4319-9173-ebd146dc8a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:59.207008 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef90f7aa-a1b1-4319-9173-ebd146dc8a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:29:59.213156 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1368/2727] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:29:58 2022] DELETE /identity/v3/projects/9378b3e1d4b84c0b8875b49e6aa44585 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:59.214899 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26293a98-49b2-4974-b5c0-1b5ca4f649fb None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:59.215394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26293a98-49b2-4974-b5c0-1b5ca4f649fb None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:59.215500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26293a98-49b2-4974-b5c0-1b5ca4f649fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:59.236947 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-26293a98-49b2-4974-b5c0-1b5ca4f649fb None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:59.237666 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-26293a98-49b2-4974-b5c0-1b5ca4f649fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:59.313095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1360/2728] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:59.315131 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8673ace-efd0-487d-967d-1a311a936e2b None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:59.315443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8673ace-efd0-487d-967d-1a311a936e2b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:59.315785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8673ace-efd0-487d-967d-1a311a936e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:59.341039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b8673ace-efd0-487d-967d-1a311a936e2b None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:59.342974 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b8673ace-efd0-487d-967d-1a311a936e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:59.354816 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1369/2729] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:29:59.356224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26293a98-49b2-4974-b5c0-1b5ca4f649fb None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:59.368497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26293a98-49b2-4974-b5c0-1b5ca4f649fb None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:59.374573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35409a-222a-4de3-b4e6-d77a007bde75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:59.375553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35409a-222a-4de3-b4e6-d77a007bde75 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:59.375949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35409a-222a-4de3-b4e6-d77a007bde75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:59.376432 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35409a-222a-4de3-b4e6-d77a007bde75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:59.377183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35409a-222a-4de3-b4e6-d77a007bde75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:29:59.377749 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35409a-222a-4de3-b4e6-d77a007bde75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:59.379543 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35409a-222a-4de3-b4e6-d77a007bde75 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:59.394055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1361/2730] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:29:59.398593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8673ace-efd0-487d-967d-1a311a936e2b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:59.411478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8673ace-efd0-487d-967d-1a311a936e2b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:59.416586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6d111-0b3d-438f-80dd-b227748be4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:59.417317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6d111-0b3d-438f-80dd-b227748be4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:59.417748 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6d111-0b3d-438f-80dd-b227748be4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:59.418103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6d111-0b3d-438f-80dd-b227748be4e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:59.418858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6d111-0b3d-438f-80dd-b227748be4e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:59.421383 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6d111-0b3d-438f-80dd-b227748be4e7 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:59.455950 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1370/2731] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:59 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:29:59.460199 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35409a-222a-4de3-b4e6-d77a007bde75 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:59.472000 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35409a-222a-4de3-b4e6-d77a007bde75 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:59.500170 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:59.549653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d66be-96b0-4d79-81c2-f42aa3b4eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:59.549653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d66be-96b0-4d79-81c2-f42aa3b4eaae admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:59.549653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d66be-96b0-4d79-81c2-f42aa3b4eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:59.549653 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d66be-96b0-4d79-81c2-f42aa3b4eaae admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:59.550271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d66be-96b0-4d79-81c2-f42aa3b4eaae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:59.552672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d66be-96b0-4d79-81c2-f42aa3b4eaae admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:59.578185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1362/2732] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:29:59 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:29:59.582038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6d111-0b3d-438f-80dd-b227748be4e7 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:59.598802 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6d111-0b3d-438f-80dd-b227748be4e7 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:59.604379 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d69d92-287d-4893-ae9f-08f1eb742a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:59.604994 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d69d92-287d-4893-ae9f-08f1eb742a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:59.605278 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d69d92-287d-4893-ae9f-08f1eb742a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:59.606005 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d69d92-287d-4893-ae9f-08f1eb742a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:59.606226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d69d92-287d-4893-ae9f-08f1eb742a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:59.608988 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d69d92-287d-4893-ae9f-08f1eb742a28 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:59.622243 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1371/2733] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:29:59.623758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d66be-96b0-4d79-81c2-f42aa3b4eaae admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:59.634392 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d66be-96b0-4d79-81c2-f42aa3b4eaae admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:59.640031 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d73e73-b525-462d-b2c0-030dfaba2e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:59.640712 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d73e73-b525-462d-b2c0-030dfaba2e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:59.641061 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d73e73-b525-462d-b2c0-030dfaba2e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:59.641429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d73e73-b525-462d-b2c0-030dfaba2e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:59.642202 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d73e73-b525-462d-b2c0-030dfaba2e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:59.643884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d73e73-b525-462d-b2c0-030dfaba2e72 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:59.656020 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1363/2734] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:29:59.660004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d69d92-287d-4893-ae9f-08f1eb742a28 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:59.671556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d69d92-287d-4893-ae9f-08f1eb742a28 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:59.676843 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd3ceb-4b75-48a3-b222-18779fb48a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:59.677609 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd3ceb-4b75-48a3-b222-18779fb48a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:59.678046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd3ceb-4b75-48a3-b222-18779fb48a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:59.678389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd3ceb-4b75-48a3-b222-18779fb48a8b admin admin] PATH_INFO: `/v3/projects/f248fb4e450047cdb17d0caa92e67e99/users/42893c5f011c4ee590145d7ce84ff108/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:59.695114 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd3ceb-4b75-48a3-b222-18779fb48a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f248fb4e450047cdb17d0caa92e67e99, user_id=42893c5f011c4ee590145d7ce84ff108, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:59.698159 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd3ceb-4b75-48a3-b222-18779fb48a8b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:29:59.722552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1372/2735] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:29:59 2022] PUT /identity/v3/projects/f248fb4e450047cdb17d0caa92e67e99/users/42893c5f011c4ee590145d7ce84ff108/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:29:59.734299 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b714c-734d-4219-b61d-8dda0ecaa68f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:59.734618 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b714c-734d-4219-b61d-8dda0ecaa68f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:59.735377 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b714c-734d-4219-b61d-8dda0ecaa68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:59.781381 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ee0b714c-734d-4219-b61d-8dda0ecaa68f None None] MFA Rules not processed for user `42893c5f011c4ee590145d7ce84ff108`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:29:59.782919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ee0b714c-734d-4219-b61d-8dda0ecaa68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:29:59.862571 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1364/2736] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:29:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:29:59.866922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd3ceb-4b75-48a3-b222-18779fb48a8b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:29:59.896143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:59.968579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd3ceb-4b75-48a3-b222-18779fb48a8b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:29:59.973919 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a039d4-efcc-4dee-9f2d-f01e1137f362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:29:59.974539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a039d4-efcc-4dee-9f2d-f01e1137f362 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:29:59.974989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a039d4-efcc-4dee-9f2d-f01e1137f362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:29:59.975262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a039d4-efcc-4dee-9f2d-f01e1137f362 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:29:59.975942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a039d4-efcc-4dee-9f2d-f01e1137f362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:29:59.979006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a039d4-efcc-4dee-9f2d-f01e1137f362 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:00.020154 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1373/2737] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:29:59 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:30:00.021905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b714c-734d-4219-b61d-8dda0ecaa68f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:00.033623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b714c-734d-4219-b61d-8dda0ecaa68f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:00.107467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01edb7c-650c-430d-b57c-f51d1689ac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:00.108078 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01edb7c-650c-430d-b57c-f51d1689ac85 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:00.108361 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01edb7c-650c-430d-b57c-f51d1689ac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:00.108634 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01edb7c-650c-430d-b57c-f51d1689ac85 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:00.109266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01edb7c-650c-430d-b57c-f51d1689ac85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:00.111211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01edb7c-650c-430d-b57c-f51d1689ac85 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:00.133412 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1365/2738] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:30:00 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:30:00.137160 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a039d4-efcc-4dee-9f2d-f01e1137f362 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:00.149708 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a039d4-efcc-4dee-9f2d-f01e1137f362 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:00.154755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ae867-2c56-4147-8486-970c0ab4cc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:00.155463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae867-2c56-4147-8486-970c0ab4cc16 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:00.155814 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae867-2c56-4147-8486-970c0ab4cc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:00.156180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae867-2c56-4147-8486-970c0ab4cc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:00.156895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ae867-2c56-4147-8486-970c0ab4cc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:00.158711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ae867-2c56-4147-8486-970c0ab4cc16 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:00.169911 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1374/2739] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:30:00.174804 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01edb7c-650c-430d-b57c-f51d1689ac85 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:00.186310 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01edb7c-650c-430d-b57c-f51d1689ac85 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:00.191042 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48561378-5246-442f-a596-9a6123901aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:00.191692 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48561378-5246-442f-a596-9a6123901aab admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:00.192092 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48561378-5246-442f-a596-9a6123901aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:00.192371 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48561378-5246-442f-a596-9a6123901aab admin admin] PATH_INFO: `/v3/projects/b127d337f24d41269be74820d4370b9e/users/99b99b73c0ba46d4a92f18f85e247304/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:00.208030 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48561378-5246-442f-a596-9a6123901aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b127d337f24d41269be74820d4370b9e, user_id=99b99b73c0ba46d4a92f18f85e247304, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:00.210747 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48561378-5246-442f-a596-9a6123901aab admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:00.214325 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:00.227742 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1366/2740] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:30:00 2022] PUT /identity/v3/projects/b127d337f24d41269be74820d4370b9e/users/99b99b73c0ba46d4a92f18f85e247304/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:00.232684 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ae867-2c56-4147-8486-970c0ab4cc16 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:00.243104 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ae867-2c56-4147-8486-970c0ab4cc16 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:00.320685 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000e18d-7e4d-4a7a-ac21-655017fb35ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:00.321506 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000e18d-7e4d-4a7a-ac21-655017fb35ee admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:00.321975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000e18d-7e4d-4a7a-ac21-655017fb35ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:00.322313 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000e18d-7e4d-4a7a-ac21-655017fb35ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:00.323018 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000e18d-7e4d-4a7a-ac21-655017fb35ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:00.324877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000e18d-7e4d-4a7a-ac21-655017fb35ee admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:00.339315 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1375/2741] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:30:00.340702 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48561378-5246-442f-a596-9a6123901aab admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:00.352017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48561378-5246-442f-a596-9a6123901aab admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:00.357553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f17a2-c6d1-4f39-94a0-1595d07b6267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:00.358354 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f17a2-c6d1-4f39-94a0-1595d07b6267 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:00.358699 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f17a2-c6d1-4f39-94a0-1595d07b6267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:00.359050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f17a2-c6d1-4f39-94a0-1595d07b6267 admin admin] PATH_INFO: `/v3/projects/b127d337f24d41269be74820d4370b9e/users/99b99b73c0ba46d4a92f18f85e247304/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:00.361101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f17a2-c6d1-4f39-94a0-1595d07b6267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b127d337f24d41269be74820d4370b9e, user_id=99b99b73c0ba46d4a92f18f85e247304, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:00.363839 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f17a2-c6d1-4f39-94a0-1595d07b6267 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:00.378429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1367/2742] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:30:00 2022] PUT /identity/v3/projects/b127d337f24d41269be74820d4370b9e/users/99b99b73c0ba46d4a92f18f85e247304/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:30:00.386975 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032534f5-dc45-41d9-a907-c159a9374a6e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:00.387497 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032534f5-dc45-41d9-a907-c159a9374a6e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:00.388857 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032534f5-dc45-41d9-a907-c159a9374a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:00.437899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-032534f5-dc45-41d9-a907-c159a9374a6e None None] MFA Rules not processed for user `99b99b73c0ba46d4a92f18f85e247304`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:00.439355 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-032534f5-dc45-41d9-a907-c159a9374a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:00.543558 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1376/2743] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:00.556948 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f17a2-c6d1-4f39-94a0-1595d07b6267 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:00.559485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-792f17a2-c6d1-4f39-94a0-1595d07b6267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:00.649167 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f17a2-c6d1-4f39-94a0-1595d07b6267 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:00.653088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55770e9-6ff1-436c-8b7f-28aedacc60ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:00.654289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55770e9-6ff1-436c-8b7f-28aedacc60ce service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:00.654581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55770e9-6ff1-436c-8b7f-28aedacc60ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:00.654883 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55770e9-6ff1-436c-8b7f-28aedacc60ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:00.666854 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55770e9-6ff1-436c-8b7f-28aedacc60ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:00.668632 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55770e9-6ff1-436c-8b7f-28aedacc60ce service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:00.679139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1368/2744] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:01.433288 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032534f5-dc45-41d9-a907-c159a9374a6e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:01.475503 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:01.553650 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032534f5-dc45-41d9-a907-c159a9374a6e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:01.561192 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc82f8-63b7-4e90-a61b-1905d4e916e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:01.562033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc82f8-63b7-4e90-a61b-1905d4e916e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:01.562380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc82f8-63b7-4e90-a61b-1905d4e916e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:01.562854 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc82f8-63b7-4e90-a61b-1905d4e916e3 admin admin] PATH_INFO: `/v3/users/42893c5f011c4ee590145d7ce84ff108` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:01.564454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc82f8-63b7-4e90-a61b-1905d4e916e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42893c5f011c4ee590145d7ce84ff108)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:01.566510 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc82f8-63b7-4e90-a61b-1905d4e916e3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:01.631903 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fddc82f8-63b7-4e90-a61b-1905d4e916e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42893c5f011c4ee590145d7ce84ff108'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:01.632699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fddc82f8-63b7-4e90-a61b-1905d4e916e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42893c5f011c4ee590145d7ce84ff108'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:01.643650 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fddc82f8-63b7-4e90-a61b-1905d4e916e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42893c5f011c4ee590145d7ce84ff108'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:01.661794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fddc82f8-63b7-4e90-a61b-1905d4e916e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42893c5f011c4ee590145d7ce84ff108'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:01.671410 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fddc82f8-63b7-4e90-a61b-1905d4e916e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42893c5f011c4ee590145d7ce84ff108'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:01.681796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1377/2745] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:30:01 2022] DELETE /identity/v3/users/42893c5f011c4ee590145d7ce84ff108 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:01.685837 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69875103-1860-477d-b68e-d6bf67410066 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:01.687781 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69875103-1860-477d-b68e-d6bf67410066 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:01.688159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69875103-1860-477d-b68e-d6bf67410066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:01.710029 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-69875103-1860-477d-b68e-d6bf67410066 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:01.711247 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-69875103-1860-477d-b68e-d6bf67410066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:01.804763 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1369/2746] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:01.811484 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc82f8-63b7-4e90-a61b-1905d4e916e3 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:01.812946 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fddc82f8-63b7-4e90-a61b-1905d4e916e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:01.904672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc82f8-63b7-4e90-a61b-1905d4e916e3 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:01.908476 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d080b-449a-427a-9c64-6f11014bbcc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:01.909103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d080b-449a-427a-9c64-6f11014bbcc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:01.909388 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d080b-449a-427a-9c64-6f11014bbcc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:01.909666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d080b-449a-427a-9c64-6f11014bbcc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:01.920659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d080b-449a-427a-9c64-6f11014bbcc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:01.922164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d080b-449a-427a-9c64-6f11014bbcc9 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:01.939289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1378/2747] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:02.282611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69875103-1860-477d-b68e-d6bf67410066 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:02.284151 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-69875103-1860-477d-b68e-d6bf67410066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:02.311207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69875103-1860-477d-b68e-d6bf67410066 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:02.317749 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9b989-bd08-4ce3-846d-1397cdeb1d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:02.318652 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9b989-bd08-4ce3-846d-1397cdeb1d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:02.318833 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9b989-bd08-4ce3-846d-1397cdeb1d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:02.319109 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9b989-bd08-4ce3-846d-1397cdeb1d6b admin admin] PATH_INFO: `/v3/projects/f248fb4e450047cdb17d0caa92e67e99` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:02.321292 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9b989-bd08-4ce3-846d-1397cdeb1d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f248fb4e450047cdb17d0caa92e67e99)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:02.323919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9b989-bd08-4ce3-846d-1397cdeb1d6b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:02.428979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-beb9b989-bd08-4ce3-846d-1397cdeb1d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f248fb4e450047cdb17d0caa92e67e99', 'request_id': 'req-beb9b989-bd08-4ce3-846d-1397cdeb1d6b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:02.438863 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-beb9b989-bd08-4ce3-846d-1397cdeb1d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f248fb4e450047cdb17d0caa92e67e99', 'request_id': 'req-beb9b989-bd08-4ce3-846d-1397cdeb1d6b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:02.448981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-beb9b989-bd08-4ce3-846d-1397cdeb1d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f248fb4e450047cdb17d0caa92e67e99', 'request_id': 'req-beb9b989-bd08-4ce3-846d-1397cdeb1d6b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:02.470551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-beb9b989-bd08-4ce3-846d-1397cdeb1d6b admin admin] The token cache is being invalidate because project f248fb4e450047cdb17d0caa92e67e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:30:02.471182 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-beb9b989-bd08-4ce3-846d-1397cdeb1d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:02.472104 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-beb9b989-bd08-4ce3-846d-1397cdeb1d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:02.474293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1370/2748] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:30:02 2022] DELETE /identity/v3/projects/f248fb4e450047cdb17d0caa92e67e99 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:02.478486 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d080b-449a-427a-9c64-6f11014bbcc9 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:02.489932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d080b-449a-427a-9c64-6f11014bbcc9 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:02.549217 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:02.576531 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e859b-7b4f-4175-bfc9-962781a3d1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:02.577200 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e859b-7b4f-4175-bfc9-962781a3d1ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:02.577482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e859b-7b4f-4175-bfc9-962781a3d1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:02.577796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e859b-7b4f-4175-bfc9-962781a3d1ee admin admin] PATH_INFO: `/v3/users/99b99b73c0ba46d4a92f18f85e247304` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:02.578970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e859b-7b4f-4175-bfc9-962781a3d1ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=99b99b73c0ba46d4a92f18f85e247304)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:02.580942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e859b-7b4f-4175-bfc9-962781a3d1ee admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:02.661440 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f40e859b-7b4f-4175-bfc9-962781a3d1ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99b99b73c0ba46d4a92f18f85e247304'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:02.662278 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f40e859b-7b4f-4175-bfc9-962781a3d1ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99b99b73c0ba46d4a92f18f85e247304'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:02.673927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f40e859b-7b4f-4175-bfc9-962781a3d1ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99b99b73c0ba46d4a92f18f85e247304'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:02.691755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f40e859b-7b4f-4175-bfc9-962781a3d1ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99b99b73c0ba46d4a92f18f85e247304'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:02.700670 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f40e859b-7b4f-4175-bfc9-962781a3d1ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99b99b73c0ba46d4a92f18f85e247304'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:02.714883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1379/2749] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:30:02 2022] DELETE /identity/v3/users/99b99b73c0ba46d4a92f18f85e247304 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:02.922565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43cce6-8c4d-47c2-b35a-b834ae978b91 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:02.923719 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43cce6-8c4d-47c2-b35a-b834ae978b91 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:02.924328 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43cce6-8c4d-47c2-b35a-b834ae978b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:02.963191 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:02.988011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2f43cce6-8c4d-47c2-b35a-b834ae978b91 None None] MFA Rules not processed for user `73a1153d0982475dbf83c3ab1974c850`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:02.989345 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2f43cce6-8c4d-47c2-b35a-b834ae978b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:03.137139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e859b-7b4f-4175-bfc9-962781a3d1ee admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:03.139378 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f40e859b-7b4f-4175-bfc9-962781a3d1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:03.142936 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1371/2750] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:03.147701 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43cce6-8c4d-47c2-b35a-b834ae978b91 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:03.149027 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2f43cce6-8c4d-47c2-b35a-b834ae978b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:03.254010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43cce6-8c4d-47c2-b35a-b834ae978b91 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:03.258779 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00281a31-fc61-430c-ad63-f111a046ad9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:03.259434 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00281a31-fc61-430c-ad63-f111a046ad9f admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:03.259735 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00281a31-fc61-430c-ad63-f111a046ad9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:03.260001 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00281a31-fc61-430c-ad63-f111a046ad9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:03.260766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00281a31-fc61-430c-ad63-f111a046ad9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:03.263279 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00281a31-fc61-430c-ad63-f111a046ad9f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:03.266319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e859b-7b4f-4175-bfc9-962781a3d1ee admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:03.271264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c8575-ce05-4b96-b07e-2406d405999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:03.271927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c8575-ce05-4b96-b07e-2406d405999a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:03.272212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c8575-ce05-4b96-b07e-2406d405999a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:03.272573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c8575-ce05-4b96-b07e-2406d405999a admin admin] PATH_INFO: `/v3/projects/b127d337f24d41269be74820d4370b9e` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:03.273790 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c8575-ce05-4b96-b07e-2406d405999a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b127d337f24d41269be74820d4370b9e)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:03.276010 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c8575-ce05-4b96-b07e-2406d405999a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:03.295156 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1372/2751] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:30:03 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:30:03.298768 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00281a31-fc61-430c-ad63-f111a046ad9f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:03.334068 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-392c8575-ce05-4b96-b07e-2406d405999a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b127d337f24d41269be74820d4370b9e', 'request_id': 'req-392c8575-ce05-4b96-b07e-2406d405999a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:03.340362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-392c8575-ce05-4b96-b07e-2406d405999a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b127d337f24d41269be74820d4370b9e', 'request_id': 'req-392c8575-ce05-4b96-b07e-2406d405999a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:03.348500 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-392c8575-ce05-4b96-b07e-2406d405999a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b127d337f24d41269be74820d4370b9e', 'request_id': 'req-392c8575-ce05-4b96-b07e-2406d405999a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:03.350548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:03.371237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-392c8575-ce05-4b96-b07e-2406d405999a admin admin] The token cache is being invalidate because project b127d337f24d41269be74820d4370b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:30:03.371686 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-392c8575-ce05-4b96-b07e-2406d405999a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:03.373067 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-392c8575-ce05-4b96-b07e-2406d405999a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:03.375357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1380/2752] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:30:03 2022] DELETE /identity/v3/projects/b127d337f24d41269be74820d4370b9e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:03.380954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2b730-4fea-4548-9895-ac308f4412d9 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:03.381136 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2b730-4fea-4548-9895-ac308f4412d9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:03.381314 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2b730-4fea-4548-9895-ac308f4412d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:03.385133 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00281a31-fc61-430c-ad63-f111a046ad9f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:03.404741 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8ea2b730-4fea-4548-9895-ac308f4412d9 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:03.406078 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8ea2b730-4fea-4548-9895-ac308f4412d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:03.419688 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:03.455740 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6fd93-84aa-463a-975f-2d4bc3b86696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:03.456979 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6fd93-84aa-463a-975f-2d4bc3b86696 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:03.457383 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6fd93-84aa-463a-975f-2d4bc3b86696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:03.457790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6fd93-84aa-463a-975f-2d4bc3b86696 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:03.458498 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6fd93-84aa-463a-975f-2d4bc3b86696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:03.461153 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6fd93-84aa-463a-975f-2d4bc3b86696 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:03.481332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1381/2753] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:30:03.489807 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effcabc-6b4f-4322-9f18-25a160d6303f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:03.490184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effcabc-6b4f-4322-9f18-25a160d6303f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:03.490580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effcabc-6b4f-4322-9f18-25a160d6303f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:03.494743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1373/2754] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:30:03 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:30:03.497853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6fd93-84aa-463a-975f-2d4bc3b86696 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:03.500041 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5ca6fd93-84aa-463a-975f-2d4bc3b86696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:03.514720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7effcabc-6b4f-4322-9f18-25a160d6303f None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:03.516037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7effcabc-6b4f-4322-9f18-25a160d6303f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:03.518024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6fd93-84aa-463a-975f-2d4bc3b86696 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:03.523585 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1c718-6892-459b-908a-a75e1c732d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:03.524698 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1c718-6892-459b-908a-a75e1c732d58 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:03.525191 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1c718-6892-459b-908a-a75e1c732d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:03.525663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1c718-6892-459b-908a-a75e1c732d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:03.526529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1c718-6892-459b-908a-a75e1c732d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:03.528247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1382/2755] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:03.528662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1c718-6892-459b-908a-a75e1c732d58 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:03.530306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effcabc-6b4f-4322-9f18-25a160d6303f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:03.542137 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1374/2756] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:30:03.546042 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effcabc-6b4f-4322-9f18-25a160d6303f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:03.546322 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1c718-6892-459b-908a-a75e1c732d58 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:03.552017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab4efd-6d71-4f84-bbb8-bde5960a624e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:03.552979 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab4efd-6d71-4f84-bbb8-bde5960a624e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:03.553818 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab4efd-6d71-4f84-bbb8-bde5960a624e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:03.554842 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab4efd-6d71-4f84-bbb8-bde5960a624e admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:03.555508 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab4efd-6d71-4f84-bbb8-bde5960a624e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:30:03.555770 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab4efd-6d71-4f84-bbb8-bde5960a624e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:03.556729 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1c718-6892-459b-908a-a75e1c732d58 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:03.557367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab4efd-6d71-4f84-bbb8-bde5960a624e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:03.563568 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f2c91-6769-47f6-8b88-73f06a790851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:03.564403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f2c91-6769-47f6-8b88-73f06a790851 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:03.564802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f2c91-6769-47f6-8b88-73f06a790851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:03.565116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f2c91-6769-47f6-8b88-73f06a790851 admin admin] PATH_INFO: `/v3/projects/1bbb42e89a8443ca9a3b9904fda827af/users/cdd7204cb0374a91995abb03f703ed73/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:03.574236 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1383/2757] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:30:03.576178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab4efd-6d71-4f84-bbb8-bde5960a624e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:03.589223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab4efd-6d71-4f84-bbb8-bde5960a624e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:03.592600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f2c91-6769-47f6-8b88-73f06a790851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbb42e89a8443ca9a3b9904fda827af, user_id=cdd7204cb0374a91995abb03f703ed73, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:03.605551 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f2c91-6769-47f6-8b88-73f06a790851 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:03.611924 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac6012-ad02-4997-9c54-f39cdb432f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:03.612560 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac6012-ad02-4997-9c54-f39cdb432f28 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:03.612842 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac6012-ad02-4997-9c54-f39cdb432f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:03.613212 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac6012-ad02-4997-9c54-f39cdb432f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:03.616695 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac6012-ad02-4997-9c54-f39cdb432f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:03.623340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac6012-ad02-4997-9c54-f39cdb432f28 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:03.635009 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1375/2758] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:30:03 2022] PUT /identity/v3/projects/1bbb42e89a8443ca9a3b9904fda827af/users/cdd7204cb0374a91995abb03f703ed73/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:03.640198 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f2c91-6769-47f6-8b88-73f06a790851 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:03.675293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1384/2759] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:30:03 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:30:03.679237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac6012-ad02-4997-9c54-f39cdb432f28 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:03.724944 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f2c91-6769-47f6-8b88-73f06a790851 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:03.763541 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac6012-ad02-4997-9c54-f39cdb432f28 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:03.768556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0081d-1fd1-4268-b3a4-95d75502f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:03.769729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0081d-1fd1-4268-b3a4-95d75502f1fa admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:03.769729 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0081d-1fd1-4268-b3a4-95d75502f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:03.769939 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0081d-1fd1-4268-b3a4-95d75502f1fa admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:03.770576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0081d-1fd1-4268-b3a4-95d75502f1fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:03.772628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0081d-1fd1-4268-b3a4-95d75502f1fa admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:03.798386 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1385/2760] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:30:03 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:30:03.802385 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0081d-1fd1-4268-b3a4-95d75502f1fa admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:03.809589 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af4283-8402-4353-91cd-2b3ccb15392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:03.810972 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af4283-8402-4353-91cd-2b3ccb15392e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:03.811302 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af4283-8402-4353-91cd-2b3ccb15392e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:03.811581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af4283-8402-4353-91cd-2b3ccb15392e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:03.812233 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af4283-8402-4353-91cd-2b3ccb15392e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:03.813993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af4283-8402-4353-91cd-2b3ccb15392e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:03.816077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0081d-1fd1-4268-b3a4-95d75502f1fa admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:03.822137 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0123d4-5b45-4397-9db8-16205e9ed345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:03.822871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0123d4-5b45-4397-9db8-16205e9ed345 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:03.823332 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0123d4-5b45-4397-9db8-16205e9ed345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:03.823819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0123d4-5b45-4397-9db8-16205e9ed345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:03.824482 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0123d4-5b45-4397-9db8-16205e9ed345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:03.826709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0123d4-5b45-4397-9db8-16205e9ed345 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:03.828499 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1376/2761] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:30:03.833264 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af4283-8402-4353-91cd-2b3ccb15392e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:03.841045 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1386/2762] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:30:03.845328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0123d4-5b45-4397-9db8-16205e9ed345 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:03.851596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af4283-8402-4353-91cd-2b3ccb15392e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:03.855938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0123d4-5b45-4397-9db8-16205e9ed345 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:03.857448 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75799a-5bf2-4d69-a155-08f25d3b372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:03.858328 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75799a-5bf2-4d69-a155-08f25d3b372a admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:03.858865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75799a-5bf2-4d69-a155-08f25d3b372a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:03.859423 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75799a-5bf2-4d69-a155-08f25d3b372a admin admin] PATH_INFO: `/v3/projects/1bbb42e89a8443ca9a3b9904fda827af/users/cdd7204cb0374a91995abb03f703ed73/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:03.861914 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03be39-6c0b-4ef8-a1ec-6d7b3a9f634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:03.862336 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75799a-5bf2-4d69-a155-08f25d3b372a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbb42e89a8443ca9a3b9904fda827af, user_id=cdd7204cb0374a91995abb03f703ed73, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:03.862518 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03be39-6c0b-4ef8-a1ec-6d7b3a9f634b admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:03.862801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03be39-6c0b-4ef8-a1ec-6d7b3a9f634b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:03.863073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03be39-6c0b-4ef8-a1ec-6d7b3a9f634b admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:03.863717 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03be39-6c0b-4ef8-a1ec-6d7b3a9f634b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:03.865362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03be39-6c0b-4ef8-a1ec-6d7b3a9f634b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:03.866347 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75799a-5bf2-4d69-a155-08f25d3b372a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:03.881720 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1387/2763] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:30:03.881925 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1377/2764] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:30:03 2022] PUT /identity/v3/projects/1bbb42e89a8443ca9a3b9904fda827af/users/cdd7204cb0374a91995abb03f703ed73/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:30:03.884424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03be39-6c0b-4ef8-a1ec-6d7b3a9f634b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:03.896609 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03be39-6c0b-4ef8-a1ec-6d7b3a9f634b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:03.922845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:03.980681 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d90225-c869-462d-a1f2-52498a15b96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:03.981425 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d90225-c869-462d-a1f2-52498a15b96d admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:03.982448 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d90225-c869-462d-a1f2-52498a15b96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:03.982797 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d90225-c869-462d-a1f2-52498a15b96d admin admin] PATH_INFO: `/v3/projects/b4fb5a84e7a34dd5909b3cf61ff24271/users/f2ba655b2f374a129fc10daeb9a0ace2/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:04.003625 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d90225-c869-462d-a1f2-52498a15b96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4fb5a84e7a34dd5909b3cf61ff24271, user_id=f2ba655b2f374a129fc10daeb9a0ace2, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:04.006383 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d90225-c869-462d-a1f2-52498a15b96d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:04.025020 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1388/2765] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:30:03 2022] PUT /identity/v3/projects/b4fb5a84e7a34dd5909b3cf61ff24271/users/f2ba655b2f374a129fc10daeb9a0ace2/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:04.036373 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cb719-4cc0-46c1-851c-971de0d203f8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:04.036893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cb719-4cc0-46c1-851c-971de0d203f8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:04.036893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cb719-4cc0-46c1-851c-971de0d203f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:04.079022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-532cb719-4cc0-46c1-851c-971de0d203f8 None None] MFA Rules not processed for user `f2ba655b2f374a129fc10daeb9a0ace2`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:04.080397 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-532cb719-4cc0-46c1-851c-971de0d203f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:04.086297 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:04.173869 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1378/2766] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:04.182949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d90225-c869-462d-a1f2-52498a15b96d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:04.185435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c4d90225-c869-462d-a1f2-52498a15b96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:04.251373 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d90225-c869-462d-a1f2-52498a15b96d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:04.255877 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e04e4-5c1b-4db1-8d2b-3618902ce605 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6c4a886aec4dd290b13118e2528fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:04.256571 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e04e4-5c1b-4db1-8d2b-3618902ce605 service glance] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:04.256852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e04e4-5c1b-4db1-8d2b-3618902ce605 service glance] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:04.257164 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e04e4-5c1b-4db1-8d2b-3618902ce605 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:04.272262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e04e4-5c1b-4db1-8d2b-3618902ce605 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:04.273942 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e04e4-5c1b-4db1-8d2b-3618902ce605 service glance] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:04.289368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1389/2767] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:06.033141 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cb719-4cc0-46c1-851c-971de0d203f8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:06.034807 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-532cb719-4cc0-46c1-851c-971de0d203f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:06.226160 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cb719-4cc0-46c1-851c-971de0d203f8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:06.235976 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03592c-994e-4982-a09d-69807071d545 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:06.237277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03592c-994e-4982-a09d-69807071d545 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:06.237976 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03592c-994e-4982-a09d-69807071d545 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:06.238565 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03592c-994e-4982-a09d-69807071d545 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:06.241187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3c03592c-994e-4982-a09d-69807071d545 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:06.281130 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03592c-994e-4982-a09d-69807071d545 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:06.283529 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03592c-994e-4982-a09d-69807071d545 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:06.314626 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1379/2768] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:09.717061 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8b617-865a-45d8-8721-4b0f6082ad56 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:09.717535 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8b617-865a-45d8-8721-4b0f6082ad56 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:09.717833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8b617-865a-45d8-8721-4b0f6082ad56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:09.798900 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2ed8b617-865a-45d8-8721-4b0f6082ad56 None None] MFA Rules not processed for user `cdd7204cb0374a91995abb03f703ed73`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:09.800140 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2ed8b617-865a-45d8-8721-4b0f6082ad56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:09.947836 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1390/2769] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:09.962105 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03592c-994e-4982-a09d-69807071d545 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:09.963781 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3c03592c-994e-4982-a09d-69807071d545 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:09.987893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03592c-994e-4982-a09d-69807071d545 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:10.001316 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552e674-eb7d-484c-b7be-6cde17ac5665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:10.001976 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552e674-eb7d-484c-b7be-6cde17ac5665 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:10.002257 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552e674-eb7d-484c-b7be-6cde17ac5665 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:10.002558 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552e674-eb7d-484c-b7be-6cde17ac5665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:10.004387 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8552e674-eb7d-484c-b7be-6cde17ac5665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:10.084949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552e674-eb7d-484c-b7be-6cde17ac5665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:10.086613 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552e674-eb7d-484c-b7be-6cde17ac5665 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:10.097775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1380/2770] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:11.004264 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8b617-865a-45d8-8721-4b0f6082ad56 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:11.005813 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2ed8b617-865a-45d8-8721-4b0f6082ad56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:11.055922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:11.086395 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8b617-865a-45d8-8721-4b0f6082ad56 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:11.090446 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a9a07-51e9-4ad4-93de-06cefd0a585d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:11.091428 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a9a07-51e9-4ad4-93de-06cefd0a585d service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:11.091722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a9a07-51e9-4ad4-93de-06cefd0a585d service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:11.091995 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a9a07-51e9-4ad4-93de-06cefd0a585d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:11.096996 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fb2a9a07-51e9-4ad4-93de-06cefd0a585d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:11.188689 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a9a07-51e9-4ad4-93de-06cefd0a585d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:11.190135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a9a07-51e9-4ad4-93de-06cefd0a585d service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:11.201828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1391/2771] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:11.612729 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7045d-4485-4f27-ad94-1931f8746897 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:11.613616 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7045d-4485-4f27-ad94-1931f8746897 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:11.614123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7045d-4485-4f27-ad94-1931f8746897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:11.640611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b9e7045d-4485-4f27-ad94-1931f8746897 None None] MFA Rules not processed for user `73a1153d0982475dbf83c3ab1974c850`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:11.642664 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b9e7045d-4485-4f27-ad94-1931f8746897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:11.656304 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1381/2772] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:15.374298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a9a07-51e9-4ad4-93de-06cefd0a585d service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:15.376293 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fb2a9a07-51e9-4ad4-93de-06cefd0a585d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:15.394475 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a9a07-51e9-4ad4-93de-06cefd0a585d service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:15.400511 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1857220-dba3-42ca-8582-0f13effd1a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:15.401591 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1857220-dba3-42ca-8582-0f13effd1a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:15.402151 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1857220-dba3-42ca-8582-0f13effd1a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:15.402662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1857220-dba3-42ca-8582-0f13effd1a9f admin admin] PATH_INFO: `/v3/users/28c03fdc58424a9793e3df8579a8f78b` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:15.405270 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1857220-dba3-42ca-8582-0f13effd1a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c03fdc58424a9793e3df8579a8f78b)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:15.409166 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1857220-dba3-42ca-8582-0f13effd1a9f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:15.471227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a1857220-dba3-42ca-8582-0f13effd1a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c03fdc58424a9793e3df8579a8f78b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:15.471831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a1857220-dba3-42ca-8582-0f13effd1a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c03fdc58424a9793e3df8579a8f78b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:15.480361 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a1857220-dba3-42ca-8582-0f13effd1a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c03fdc58424a9793e3df8579a8f78b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:15.493380 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a1857220-dba3-42ca-8582-0f13effd1a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c03fdc58424a9793e3df8579a8f78b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:15.500930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a1857220-dba3-42ca-8582-0f13effd1a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c03fdc58424a9793e3df8579a8f78b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:15.506807 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1392/2773] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:30:15 2022] DELETE /identity/v3/users/28c03fdc58424a9793e3df8579a8f78b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:15.699136 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7045d-4485-4f27-ad94-1931f8746897 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:15.717187 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7045d-4485-4f27-ad94-1931f8746897 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:15.749923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:15.787716 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66cf53-2ff0-4982-82ec-3df2e04031d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:15.788159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66cf53-2ff0-4982-82ec-3df2e04031d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:15.788442 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66cf53-2ff0-4982-82ec-3df2e04031d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:15.788724 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66cf53-2ff0-4982-82ec-3df2e04031d5 admin admin] PATH_INFO: `/v3/projects/22876639e9a446a3902e19c2e3ad90a5` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:15.790123 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66cf53-2ff0-4982-82ec-3df2e04031d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22876639e9a446a3902e19c2e3ad90a5)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:15.792488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66cf53-2ff0-4982-82ec-3df2e04031d5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:15.861781 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cb66cf53-2ff0-4982-82ec-3df2e04031d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22876639e9a446a3902e19c2e3ad90a5', 'request_id': 'req-cb66cf53-2ff0-4982-82ec-3df2e04031d5'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:15.867603 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cb66cf53-2ff0-4982-82ec-3df2e04031d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22876639e9a446a3902e19c2e3ad90a5', 'request_id': 'req-cb66cf53-2ff0-4982-82ec-3df2e04031d5'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:15.874488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cb66cf53-2ff0-4982-82ec-3df2e04031d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22876639e9a446a3902e19c2e3ad90a5', 'request_id': 'req-cb66cf53-2ff0-4982-82ec-3df2e04031d5'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:15.887305 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cb66cf53-2ff0-4982-82ec-3df2e04031d5 admin admin] The token cache is being invalidate because project 22876639e9a446a3902e19c2e3ad90a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:30:15.888115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cb66cf53-2ff0-4982-82ec-3df2e04031d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:15.888753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cb66cf53-2ff0-4982-82ec-3df2e04031d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:15.890286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1382/2774] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:30:15 2022] DELETE /identity/v3/projects/22876639e9a446a3902e19c2e3ad90a5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:15.895987 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837958ba-e200-4db3-a57f-d376331221a8 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:15.896277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837958ba-e200-4db3-a57f-d376331221a8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:15.896578 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837958ba-e200-4db3-a57f-d376331221a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:15.920239 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-837958ba-e200-4db3-a57f-d376331221a8 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:15.921436 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-837958ba-e200-4db3-a57f-d376331221a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:15.966643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:15.983426 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1393/2775] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:15.991899 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cb30a-5299-42a2-8309-1e461e76d2ae None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:15.992185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cb30a-5299-42a2-8309-1e461e76d2ae None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:15.992459 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cb30a-5299-42a2-8309-1e461e76d2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:16.012931 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-339cb30a-5299-42a2-8309-1e461e76d2ae None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:16.014171 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-339cb30a-5299-42a2-8309-1e461e76d2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:16.022108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1383/2776] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:16.026498 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837958ba-e200-4db3-a57f-d376331221a8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:16.036187 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837958ba-e200-4db3-a57f-d376331221a8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:16.040742 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f4022-7356-41d9-b0da-299743b521de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:16.041340 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f4022-7356-41d9-b0da-299743b521de admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:16.041614 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f4022-7356-41d9-b0da-299743b521de admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:16.041918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f4022-7356-41d9-b0da-299743b521de admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:16.042557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f4022-7356-41d9-b0da-299743b521de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:30:16.042858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f4022-7356-41d9-b0da-299743b521de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:16.044968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f4022-7356-41d9-b0da-299743b521de admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:16.056764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1394/2777] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:30:16.061983 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cb30a-5299-42a2-8309-1e461e76d2ae None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:16.071813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cb30a-5299-42a2-8309-1e461e76d2ae None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:16.076799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a31b30-edaa-46b2-ade2-5910b2a1308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:16.077430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a31b30-edaa-46b2-ade2-5910b2a1308c admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:16.077731 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a31b30-edaa-46b2-ade2-5910b2a1308c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:16.078174 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a31b30-edaa-46b2-ade2-5910b2a1308c admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:16.078919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a31b30-edaa-46b2-ade2-5910b2a1308c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:16.081213 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a31b30-edaa-46b2-ade2-5910b2a1308c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:16.110907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1384/2778] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:30:16 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:30:16.115389 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f4022-7356-41d9-b0da-299743b521de admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:16.128142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f4022-7356-41d9-b0da-299743b521de admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:16.186967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916b7ea-9bf1-4dd6-8e4b-6b395a550887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:16.187573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916b7ea-9bf1-4dd6-8e4b-6b395a550887 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:16.187852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916b7ea-9bf1-4dd6-8e4b-6b395a550887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:16.188121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916b7ea-9bf1-4dd6-8e4b-6b395a550887 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:16.188743 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916b7ea-9bf1-4dd6-8e4b-6b395a550887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:16.190673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916b7ea-9bf1-4dd6-8e4b-6b395a550887 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:16.211989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1395/2779] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:30:16 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:30:16.216460 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a31b30-edaa-46b2-ade2-5910b2a1308c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:16.228661 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a31b30-edaa-46b2-ade2-5910b2a1308c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:16.234168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846c710-0745-41e2-834d-76cbe02fbd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:16.234695 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846c710-0745-41e2-834d-76cbe02fbd0c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:16.234976 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846c710-0745-41e2-834d-76cbe02fbd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:16.235252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846c710-0745-41e2-834d-76cbe02fbd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:16.235938 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846c710-0745-41e2-834d-76cbe02fbd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:16.237542 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846c710-0745-41e2-834d-76cbe02fbd0c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:16.248573 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1385/2780] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:30:16.252731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916b7ea-9bf1-4dd6-8e4b-6b395a550887 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:16.262789 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916b7ea-9bf1-4dd6-8e4b-6b395a550887 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:16.267448 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03513d30-3ac7-4e54-9522-0626d91ff225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:16.268044 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03513d30-3ac7-4e54-9522-0626d91ff225 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:16.268324 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03513d30-3ac7-4e54-9522-0626d91ff225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:16.268596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03513d30-3ac7-4e54-9522-0626d91ff225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:16.269232 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03513d30-3ac7-4e54-9522-0626d91ff225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:16.270846 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03513d30-3ac7-4e54-9522-0626d91ff225 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:16.282933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1396/2781] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:30:16.288216 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846c710-0745-41e2-834d-76cbe02fbd0c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:16.302204 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846c710-0745-41e2-834d-76cbe02fbd0c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:16.306852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a7640-2934-4586-b7f5-38ada247a668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:16.307500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a7640-2934-4586-b7f5-38ada247a668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:16.307780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a7640-2934-4586-b7f5-38ada247a668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:16.308059 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a7640-2934-4586-b7f5-38ada247a668 admin admin] PATH_INFO: `/v3/projects/6b4240a404db47749e045aa34da00682/users/50ef4b7f2d564cb9be1758ae89e4381c/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:16.329582 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a7640-2934-4586-b7f5-38ada247a668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4240a404db47749e045aa34da00682, user_id=50ef4b7f2d564cb9be1758ae89e4381c, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:16.332725 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a7640-2934-4586-b7f5-38ada247a668 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:16.352889 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1386/2782] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:30:16 2022] PUT /identity/v3/projects/6b4240a404db47749e045aa34da00682/users/50ef4b7f2d564cb9be1758ae89e4381c/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:30:16.364199 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfee39-3c28-4151-8583-7d27b2fa65b8 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:16.364565 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfee39-3c28-4151-8583-7d27b2fa65b8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:16.364930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfee39-3c28-4151-8583-7d27b2fa65b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:16.399560 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8ebfee39-3c28-4151-8583-7d27b2fa65b8 None None] MFA Rules not processed for user `50ef4b7f2d564cb9be1758ae89e4381c`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:16.400831 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8ebfee39-3c28-4151-8583-7d27b2fa65b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:16.472012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1397/2783] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:16.484460 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a7640-2934-4586-b7f5-38ada247a668 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:16.486300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-806a7640-2934-4586-b7f5-38ada247a668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:16.552561 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:16.581485 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a7640-2934-4586-b7f5-38ada247a668 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:16.587358 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3dfcb-8c64-4c72-9758-bb442ae8c01d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:16.588005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3dfcb-8c64-4c72-9758-bb442ae8c01d service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:16.588293 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3dfcb-8c64-4c72-9758-bb442ae8c01d service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:16.588567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3dfcb-8c64-4c72-9758-bb442ae8c01d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:16.598055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3dfcb-8c64-4c72-9758-bb442ae8c01d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:16.599631 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3dfcb-8c64-4c72-9758-bb442ae8c01d service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:16.609186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1387/2784] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:19.622505 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfee39-3c28-4151-8583-7d27b2fa65b8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:19.623971 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8ebfee39-3c28-4151-8583-7d27b2fa65b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:19.675062 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:19.693474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfee39-3c28-4151-8583-7d27b2fa65b8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:19.698808 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1923e3-6947-41fd-acd2-13552a8a3276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:19.700014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1923e3-6947-41fd-acd2-13552a8a3276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:19.700297 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1923e3-6947-41fd-acd2-13552a8a3276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:19.700572 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1923e3-6947-41fd-acd2-13552a8a3276 admin admin] PATH_INFO: `/v3/users/f2ba655b2f374a129fc10daeb9a0ace2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:19.701939 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1923e3-6947-41fd-acd2-13552a8a3276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ba655b2f374a129fc10daeb9a0ace2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:19.703903 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1923e3-6947-41fd-acd2-13552a8a3276 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:19.753592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cc1923e3-6947-41fd-acd2-13552a8a3276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ba655b2f374a129fc10daeb9a0ace2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:19.754281 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cc1923e3-6947-41fd-acd2-13552a8a3276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ba655b2f374a129fc10daeb9a0ace2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:19.761696 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cc1923e3-6947-41fd-acd2-13552a8a3276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ba655b2f374a129fc10daeb9a0ace2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:19.774256 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cc1923e3-6947-41fd-acd2-13552a8a3276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ba655b2f374a129fc10daeb9a0ace2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:19.782024 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cc1923e3-6947-41fd-acd2-13552a8a3276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ba655b2f374a129fc10daeb9a0ace2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:19.789259 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1398/2785] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:30:19 2022] DELETE /identity/v3/users/f2ba655b2f374a129fc10daeb9a0ace2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:19.794864 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb443c-b79f-403f-a45a-af42bb7ce0b8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:19.795604 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb443c-b79f-403f-a45a-af42bb7ce0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:19.795894 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb443c-b79f-403f-a45a-af42bb7ce0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:19.814902 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0edb443c-b79f-403f-a45a-af42bb7ce0b8 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:19.816087 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0edb443c-b79f-403f-a45a-af42bb7ce0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:19.879606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1388/2786] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:19.890364 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1923e3-6947-41fd-acd2-13552a8a3276 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:19.892002 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cc1923e3-6947-41fd-acd2-13552a8a3276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:19.958452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1923e3-6947-41fd-acd2-13552a8a3276 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:19.963171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015b6f6-76c7-48f8-beaa-2af3f00f8c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:19.963802 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015b6f6-76c7-48f8-beaa-2af3f00f8c88 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:19.964073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015b6f6-76c7-48f8-beaa-2af3f00f8c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:19.964345 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015b6f6-76c7-48f8-beaa-2af3f00f8c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:19.975120 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015b6f6-76c7-48f8-beaa-2af3f00f8c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:19.976539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015b6f6-76c7-48f8-beaa-2af3f00f8c88 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:19.987058 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1399/2787] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:20.266004 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb443c-b79f-403f-a45a-af42bb7ce0b8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:20.267541 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0edb443c-b79f-403f-a45a-af42bb7ce0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:20.280036 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb443c-b79f-403f-a45a-af42bb7ce0b8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:20.287591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083e7b-98b9-4b58-ac50-908a507adfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:20.288248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083e7b-98b9-4b58-ac50-908a507adfc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:20.288544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083e7b-98b9-4b58-ac50-908a507adfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:20.288845 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083e7b-98b9-4b58-ac50-908a507adfc8 admin admin] PATH_INFO: `/v3/projects/b4fb5a84e7a34dd5909b3cf61ff24271` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:20.290224 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36083e7b-98b9-4b58-ac50-908a507adfc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4fb5a84e7a34dd5909b3cf61ff24271)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:20.292361 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36083e7b-98b9-4b58-ac50-908a507adfc8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:20.348439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-36083e7b-98b9-4b58-ac50-908a507adfc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4fb5a84e7a34dd5909b3cf61ff24271', 'request_id': 'req-36083e7b-98b9-4b58-ac50-908a507adfc8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:20.355081 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-36083e7b-98b9-4b58-ac50-908a507adfc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4fb5a84e7a34dd5909b3cf61ff24271', 'request_id': 'req-36083e7b-98b9-4b58-ac50-908a507adfc8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:20.361911 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-36083e7b-98b9-4b58-ac50-908a507adfc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4fb5a84e7a34dd5909b3cf61ff24271', 'request_id': 'req-36083e7b-98b9-4b58-ac50-908a507adfc8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:20.375223 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-36083e7b-98b9-4b58-ac50-908a507adfc8 admin admin] The token cache is being invalidate because project b4fb5a84e7a34dd5909b3cf61ff24271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:30:20.375514 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-36083e7b-98b9-4b58-ac50-908a507adfc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:20.376125 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-36083e7b-98b9-4b58-ac50-908a507adfc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:20.377601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1389/2788] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:30:20 2022] DELETE /identity/v3/projects/b4fb5a84e7a34dd5909b3cf61ff24271 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:20.382646 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9c3a4-ba94-49c6-b942-386809db36b2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:20.382962 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9c3a4-ba94-49c6-b942-386809db36b2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:20.383234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9c3a4-ba94-49c6-b942-386809db36b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:20.404871 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7dd9c3a4-ba94-49c6-b942-386809db36b2 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:20.406084 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7dd9c3a4-ba94-49c6-b942-386809db36b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:20.476854 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1400/2789] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:20.486198 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc193071-f3e7-4f81-a19b-273ed8e8928d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:20.486479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc193071-f3e7-4f81-a19b-273ed8e8928d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:20.486749 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc193071-f3e7-4f81-a19b-273ed8e8928d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:20.507474 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fc193071-f3e7-4f81-a19b-273ed8e8928d None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:20.509015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fc193071-f3e7-4f81-a19b-273ed8e8928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:20.518951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1390/2790] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:20.523279 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9c3a4-ba94-49c6-b942-386809db36b2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:20.533178 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9c3a4-ba94-49c6-b942-386809db36b2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:20.537636 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3581e64-9cc1-4c79-8886-f170e853fc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:20.538253 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3581e64-9cc1-4c79-8886-f170e853fc62 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:20.538527 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3581e64-9cc1-4c79-8886-f170e853fc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:20.538795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3581e64-9cc1-4c79-8886-f170e853fc62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:20.539424 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3581e64-9cc1-4c79-8886-f170e853fc62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:30:20.539722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3581e64-9cc1-4c79-8886-f170e853fc62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:20.541312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3581e64-9cc1-4c79-8886-f170e853fc62 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:20.544963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:20.555576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1401/2791] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:30:20.619039 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc193071-f3e7-4f81-a19b-273ed8e8928d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:20.635951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc193071-f3e7-4f81-a19b-273ed8e8928d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:20.641650 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf414f-4a2e-415f-8b92-31cef78befe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:20.642281 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf414f-4a2e-415f-8b92-31cef78befe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:20.642584 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf414f-4a2e-415f-8b92-31cef78befe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:20.642884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf414f-4a2e-415f-8b92-31cef78befe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:20.643504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf414f-4a2e-415f-8b92-31cef78befe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:20.645415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf414f-4a2e-415f-8b92-31cef78befe6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:20.675161 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1391/2792] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:30:20 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:30:20.679697 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3581e64-9cc1-4c79-8886-f170e853fc62 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:20.695735 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3581e64-9cc1-4c79-8886-f170e853fc62 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:20.761237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce665302-003e-41a4-a48d-2ba48a32b0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:20.761878 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce665302-003e-41a4-a48d-2ba48a32b0ed admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:20.762500 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce665302-003e-41a4-a48d-2ba48a32b0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:20.762780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce665302-003e-41a4-a48d-2ba48a32b0ed admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:20.763407 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce665302-003e-41a4-a48d-2ba48a32b0ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:20.765328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce665302-003e-41a4-a48d-2ba48a32b0ed admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:20.793912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1402/2793] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:30:20 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:30:20.798274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf414f-4a2e-415f-8b92-31cef78befe6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:20.808595 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf414f-4a2e-415f-8b92-31cef78befe6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:20.813655 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ac7a8-ec7f-497b-9725-c81728058cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:20.814276 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac7a8-ec7f-497b-9725-c81728058cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:20.814601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac7a8-ec7f-497b-9725-c81728058cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:20.814890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac7a8-ec7f-497b-9725-c81728058cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:20.815504 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ac7a8-ec7f-497b-9725-c81728058cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:20.817119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ac7a8-ec7f-497b-9725-c81728058cd8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:20.827781 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1392/2794] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:30:20.831849 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce665302-003e-41a4-a48d-2ba48a32b0ed admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:20.843655 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce665302-003e-41a4-a48d-2ba48a32b0ed admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:20.848809 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f1289-1f98-453a-ab7f-e25c64d1cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:20.849409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1289-1f98-453a-ab7f-e25c64d1cabe admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:20.849718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1289-1f98-453a-ab7f-e25c64d1cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:20.850034 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1289-1f98-453a-ab7f-e25c64d1cabe admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:20.850667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f1289-1f98-453a-ab7f-e25c64d1cabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:20.852253 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f1289-1f98-453a-ab7f-e25c64d1cabe admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:20.864580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1403/2795] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:30:20.868773 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ac7a8-ec7f-497b-9725-c81728058cd8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:20.878884 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ac7a8-ec7f-497b-9725-c81728058cd8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:20.884245 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88ff78-6630-43b6-873f-52690a74d7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:20.884958 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88ff78-6630-43b6-873f-52690a74d7db admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:20.885239 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88ff78-6630-43b6-873f-52690a74d7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:20.885534 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88ff78-6630-43b6-873f-52690a74d7db admin admin] PATH_INFO: `/v3/projects/0fd5ba32d9a44d6187d1da5945958598/users/12b12912749b42939ce7c6cabd70faa4/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:20.901638 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88ff78-6630-43b6-873f-52690a74d7db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd5ba32d9a44d6187d1da5945958598, user_id=12b12912749b42939ce7c6cabd70faa4, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:20.904986 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88ff78-6630-43b6-873f-52690a74d7db admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:20.907206 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:20.923040 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1393/2796] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:30:20 2022] PUT /identity/v3/projects/0fd5ba32d9a44d6187d1da5945958598/users/12b12912749b42939ce7c6cabd70faa4/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:20.932949 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc2290-49a0-4597-9df5-7ac81d782dbe None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:20.933266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc2290-49a0-4597-9df5-7ac81d782dbe None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:20.933560 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc2290-49a0-4597-9df5-7ac81d782dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:20.961384 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-c8dc2290-49a0-4597-9df5-7ac81d782dbe None None] MFA Rules not processed for user `12b12912749b42939ce7c6cabd70faa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:20.962620 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c8dc2290-49a0-4597-9df5-7ac81d782dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:21.033734 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1404/2797] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:21.042746 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88ff78-6630-43b6-873f-52690a74d7db admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:21.045274 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-da88ff78-6630-43b6-873f-52690a74d7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:21.105668 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88ff78-6630-43b6-873f-52690a74d7db admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:21.110015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb31dd-1cd0-45d9-b6ca-050654659379 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6c4a886aec4dd290b13118e2528fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:21.110621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb31dd-1cd0-45d9-b6ca-050654659379 service glance] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:21.110897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb31dd-1cd0-45d9-b6ca-050654659379 service glance] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:21.111168 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb31dd-1cd0-45d9-b6ca-050654659379 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:21.120055 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb31dd-1cd0-45d9-b6ca-050654659379 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:21.122006 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb31dd-1cd0-45d9-b6ca-050654659379 service glance] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:21.130961 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1394/2798] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:21.936206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc2290-49a0-4597-9df5-7ac81d782dbe None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:21.937623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c8dc2290-49a0-4597-9df5-7ac81d782dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:22.008311 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc2290-49a0-4597-9df5-7ac81d782dbe None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:22.015033 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00be76f-0e08-49c0-bc09-3cb738c1f95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:22.015798 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00be76f-0e08-49c0-bc09-3cb738c1f95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:22.016111 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00be76f-0e08-49c0-bc09-3cb738c1f95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:22.016452 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00be76f-0e08-49c0-bc09-3cb738c1f95d admin admin] PATH_INFO: `/v3/users/50ef4b7f2d564cb9be1758ae89e4381c` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:22.017634 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00be76f-0e08-49c0-bc09-3cb738c1f95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ef4b7f2d564cb9be1758ae89e4381c)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:22.019628 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00be76f-0e08-49c0-bc09-3cb738c1f95d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:22.024930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:22.073143 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f00be76f-0e08-49c0-bc09-3cb738c1f95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ef4b7f2d564cb9be1758ae89e4381c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:22.076337 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f00be76f-0e08-49c0-bc09-3cb738c1f95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ef4b7f2d564cb9be1758ae89e4381c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:22.084987 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f00be76f-0e08-49c0-bc09-3cb738c1f95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ef4b7f2d564cb9be1758ae89e4381c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:22.098828 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f00be76f-0e08-49c0-bc09-3cb738c1f95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ef4b7f2d564cb9be1758ae89e4381c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:22.108105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f00be76f-0e08-49c0-bc09-3cb738c1f95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ef4b7f2d564cb9be1758ae89e4381c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:22.114344 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1405/2799] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:30:21 2022] DELETE /identity/v3/users/50ef4b7f2d564cb9be1758ae89e4381c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:22.118822 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd27e5-f0f4-4f26-bc28-ffe68af1e019 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:22.119268 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd27e5-f0f4-4f26-bc28-ffe68af1e019 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:22.119379 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd27e5-f0f4-4f26-bc28-ffe68af1e019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:22.138886 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-accd27e5-f0f4-4f26-bc28-ffe68af1e019 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:22.140084 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-accd27e5-f0f4-4f26-bc28-ffe68af1e019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:22.207367 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1395/2800] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:22.217617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00be76f-0e08-49c0-bc09-3cb738c1f95d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:22.219119 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f00be76f-0e08-49c0-bc09-3cb738c1f95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:22.284627 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00be76f-0e08-49c0-bc09-3cb738c1f95d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:22.288262 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69749a-c9f5-4a18-a2d3-05e8c15ddb05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:22.288866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69749a-c9f5-4a18-a2d3-05e8c15ddb05 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:22.289145 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69749a-c9f5-4a18-a2d3-05e8c15ddb05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:22.289415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69749a-c9f5-4a18-a2d3-05e8c15ddb05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:22.298945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69749a-c9f5-4a18-a2d3-05e8c15ddb05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:22.300367 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69749a-c9f5-4a18-a2d3-05e8c15ddb05 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:22.309912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1406/2801] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:22.612398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd27e5-f0f4-4f26-bc28-ffe68af1e019 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:22.613981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-accd27e5-f0f4-4f26-bc28-ffe68af1e019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:22.639118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd27e5-f0f4-4f26-bc28-ffe68af1e019 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:22.654228 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6c073-7fd0-4bca-b06a-9813b47a5fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:22.654228 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6c073-7fd0-4bca-b06a-9813b47a5fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:22.654228 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6c073-7fd0-4bca-b06a-9813b47a5fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:22.654228 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6c073-7fd0-4bca-b06a-9813b47a5fe0 admin admin] PATH_INFO: `/v3/projects/6b4240a404db47749e045aa34da00682` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:22.655079 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6c073-7fd0-4bca-b06a-9813b47a5fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b4240a404db47749e045aa34da00682)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:22.655079 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6c073-7fd0-4bca-b06a-9813b47a5fe0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:22.704615 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dfc6c073-7fd0-4bca-b06a-9813b47a5fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b4240a404db47749e045aa34da00682', 'request_id': 'req-dfc6c073-7fd0-4bca-b06a-9813b47a5fe0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:22.709980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dfc6c073-7fd0-4bca-b06a-9813b47a5fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b4240a404db47749e045aa34da00682', 'request_id': 'req-dfc6c073-7fd0-4bca-b06a-9813b47a5fe0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:22.716571 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dfc6c073-7fd0-4bca-b06a-9813b47a5fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b4240a404db47749e045aa34da00682', 'request_id': 'req-dfc6c073-7fd0-4bca-b06a-9813b47a5fe0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:22.729234 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dfc6c073-7fd0-4bca-b06a-9813b47a5fe0 admin admin] The token cache is being invalidate because project 6b4240a404db47749e045aa34da00682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:30:22.729559 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dfc6c073-7fd0-4bca-b06a-9813b47a5fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:22.730241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dfc6c073-7fd0-4bca-b06a-9813b47a5fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:22.731804 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1396/2802] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:30:22 2022] DELETE /identity/v3/projects/6b4240a404db47749e045aa34da00682 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:22.736735 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce42ad-6eef-4ff2-988f-8c7d8afacc05 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:22.737037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce42ad-6eef-4ff2-988f-8c7d8afacc05 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:22.737308 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce42ad-6eef-4ff2-988f-8c7d8afacc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:22.762876 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6cce42ad-6eef-4ff2-988f-8c7d8afacc05 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:22.764131 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6cce42ad-6eef-4ff2-988f-8c7d8afacc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:22.825927 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1407/2803] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:22.833714 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdff76-67de-40e2-ab20-5b196d3e8ddf None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:22.834014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdff76-67de-40e2-ab20-5b196d3e8ddf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:22.834286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdff76-67de-40e2-ab20-5b196d3e8ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:22.859711 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-90cdff76-67de-40e2-ab20-5b196d3e8ddf None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:22.860917 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-90cdff76-67de-40e2-ab20-5b196d3e8ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:22.868797 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1397/2804] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:30:22.873345 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce42ad-6eef-4ff2-988f-8c7d8afacc05 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:22.883541 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce42ad-6eef-4ff2-988f-8c7d8afacc05 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:22.888817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b59ea-0728-4229-9cbc-412abe37c2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:22.889443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b59ea-0728-4229-9cbc-412abe37c2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:22.889760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b59ea-0728-4229-9cbc-412abe37c2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:22.890036 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b59ea-0728-4229-9cbc-412abe37c2a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:22.890682 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b59ea-0728-4229-9cbc-412abe37c2a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:30:22.890967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b59ea-0728-4229-9cbc-412abe37c2a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:22.892581 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b59ea-0728-4229-9cbc-412abe37c2a8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:22.905648 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1408/2805] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:30:22.910152 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdff76-67de-40e2-ab20-5b196d3e8ddf None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:22.920861 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdff76-67de-40e2-ab20-5b196d3e8ddf None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:22.925730 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4ef32-138b-41e0-84a4-c4db4c9514dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:22.926343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4ef32-138b-41e0-84a4-c4db4c9514dd admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:22.926621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4ef32-138b-41e0-84a4-c4db4c9514dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:22.926892 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4ef32-138b-41e0-84a4-c4db4c9514dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:22.927522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4ef32-138b-41e0-84a4-c4db4c9514dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:22.929544 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4ef32-138b-41e0-84a4-c4db4c9514dd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:22.941381 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:22.959421 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1398/2806] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:30:22 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:30:22.963780 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b59ea-0728-4229-9cbc-412abe37c2a8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:22.975221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b59ea-0728-4229-9cbc-412abe37c2a8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:22.984092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:23.036512 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb3a09-7dd4-4507-aa81-5677fd8e7807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:23.037122 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb3a09-7dd4-4507-aa81-5677fd8e7807 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:23.037409 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb3a09-7dd4-4507-aa81-5677fd8e7807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:23.037722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb3a09-7dd4-4507-aa81-5677fd8e7807 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:23.038355 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb3a09-7dd4-4507-aa81-5677fd8e7807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:23.040255 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb3a09-7dd4-4507-aa81-5677fd8e7807 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:23.062266 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1409/2807] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:30:22 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:30:23.066596 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4ef32-138b-41e0-84a4-c4db4c9514dd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:23.079985 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4ef32-138b-41e0-84a4-c4db4c9514dd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:23.084758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b979d-a765-4531-a03e-e862727f20db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:23.085389 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b979d-a765-4531-a03e-e862727f20db admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:23.085665 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b979d-a765-4531-a03e-e862727f20db admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:23.086043 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b979d-a765-4531-a03e-e862727f20db admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:23.086678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b979d-a765-4531-a03e-e862727f20db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:23.088218 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b979d-a765-4531-a03e-e862727f20db admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:23.099708 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1399/2808] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:30:23.103730 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb3a09-7dd4-4507-aa81-5677fd8e7807 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:23.113829 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb3a09-7dd4-4507-aa81-5677fd8e7807 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:23.118443 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8281ade-bc76-45b9-ae60-764925690a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:23.119037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8281ade-bc76-45b9-ae60-764925690a98 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:23.119319 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8281ade-bc76-45b9-ae60-764925690a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:23.119592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8281ade-bc76-45b9-ae60-764925690a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:23.120227 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8281ade-bc76-45b9-ae60-764925690a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:23.122437 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8281ade-bc76-45b9-ae60-764925690a98 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:23.134008 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1410/2809] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:30:23.138924 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b979d-a765-4531-a03e-e862727f20db admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:23.149045 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b979d-a765-4531-a03e-e862727f20db admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:23.155215 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3802265-ab6b-4eec-b3ef-4b8da3ab9aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:23.156139 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3802265-ab6b-4eec-b3ef-4b8da3ab9aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:23.156656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3802265-ab6b-4eec-b3ef-4b8da3ab9aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:23.157045 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3802265-ab6b-4eec-b3ef-4b8da3ab9aaf admin admin] PATH_INFO: `/v3/projects/635da8d2888b45a0a09e72db6abe9775/users/2d82f4c13fbd4160af3666eee55fe0b7/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:23.183467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3802265-ab6b-4eec-b3ef-4b8da3ab9aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=635da8d2888b45a0a09e72db6abe9775, user_id=2d82f4c13fbd4160af3666eee55fe0b7, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:23.187365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3802265-ab6b-4eec-b3ef-4b8da3ab9aaf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:23.201241 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1400/2810] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:30:23 2022] PUT /identity/v3/projects/635da8d2888b45a0a09e72db6abe9775/users/2d82f4c13fbd4160af3666eee55fe0b7/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:23.213070 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ccbf0-12cc-4ef3-96b6-5afb5e676802 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:23.213359 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ccbf0-12cc-4ef3-96b6-5afb5e676802 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:23.213633 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ccbf0-12cc-4ef3-96b6-5afb5e676802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:23.241484 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-bd1ccbf0-12cc-4ef3-96b6-5afb5e676802 None None] MFA Rules not processed for user `2d82f4c13fbd4160af3666eee55fe0b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:23.242721 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bd1ccbf0-12cc-4ef3-96b6-5afb5e676802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:23.315157 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1411/2811] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:23.319621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3802265-ab6b-4eec-b3ef-4b8da3ab9aaf admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:23.388260 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3802265-ab6b-4eec-b3ef-4b8da3ab9aaf admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:23.393277 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185e45b-96ab-4c25-b549-ae667eb668cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:23.393897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185e45b-96ab-4c25-b549-ae667eb668cd admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:23.394176 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185e45b-96ab-4c25-b549-ae667eb668cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:23.394445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185e45b-96ab-4c25-b549-ae667eb668cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:23.395080 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185e45b-96ab-4c25-b549-ae667eb668cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:23.396975 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185e45b-96ab-4c25-b549-ae667eb668cd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:23.427365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1401/2812] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:30:23 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:30:23.431412 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ccbf0-12cc-4ef3-96b6-5afb5e676802 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:23.445325 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ccbf0-12cc-4ef3-96b6-5afb5e676802 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:23.507597 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53af71-65bf-447a-a0a8-8a6667ad7b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:23.508204 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53af71-65bf-447a-a0a8-8a6667ad7b8d admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:23.508481 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53af71-65bf-447a-a0a8-8a6667ad7b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:23.508760 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53af71-65bf-447a-a0a8-8a6667ad7b8d admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:23.509372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53af71-65bf-447a-a0a8-8a6667ad7b8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:23.511344 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53af71-65bf-447a-a0a8-8a6667ad7b8d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:23.535021 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1412/2813] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:30:23 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:30:23.539000 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185e45b-96ab-4c25-b549-ae667eb668cd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:23.550165 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185e45b-96ab-4c25-b549-ae667eb668cd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:23.555401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c44cf9-9c8b-40d8-bf08-c7b16980a5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:23.556206 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c44cf9-9c8b-40d8-bf08-c7b16980a5ba admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:23.556590 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c44cf9-9c8b-40d8-bf08-c7b16980a5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:23.557007 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c44cf9-9c8b-40d8-bf08-c7b16980a5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:23.557836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c44cf9-9c8b-40d8-bf08-c7b16980a5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:23.560505 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c44cf9-9c8b-40d8-bf08-c7b16980a5ba admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:23.572236 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1402/2814] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:30:23.576638 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53af71-65bf-447a-a0a8-8a6667ad7b8d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:23.586556 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53af71-65bf-447a-a0a8-8a6667ad7b8d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:23.591197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d95311-6438-4a52-9bec-4a4bebd6ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:23.591839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d95311-6438-4a52-9bec-4a4bebd6ac79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:23.592120 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d95311-6438-4a52-9bec-4a4bebd6ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:23.592392 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d95311-6438-4a52-9bec-4a4bebd6ac79 admin admin] PATH_INFO: `/v3/projects/224c6904df314d6d887558399629661c/users/7fbf65ad0e414f809649c35bc7b6e653/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:23.601153 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:23.611092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d95311-6438-4a52-9bec-4a4bebd6ac79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=224c6904df314d6d887558399629661c, user_id=7fbf65ad0e414f809649c35bc7b6e653, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:23.614755 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d95311-6438-4a52-9bec-4a4bebd6ac79 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:23.643306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1413/2815] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:30:23 2022] PUT /identity/v3/projects/224c6904df314d6d887558399629661c/users/7fbf65ad0e414f809649c35bc7b6e653/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:23.648154 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c44cf9-9c8b-40d8-bf08-c7b16980a5ba admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:23.659439 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c44cf9-9c8b-40d8-bf08-c7b16980a5ba admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:23.720044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f62242-a4cd-4415-a6de-80d355235a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:23.720662 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f62242-a4cd-4415-a6de-80d355235a68 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:23.720942 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f62242-a4cd-4415-a6de-80d355235a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:23.721216 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f62242-a4cd-4415-a6de-80d355235a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:23.721882 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f62242-a4cd-4415-a6de-80d355235a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:23.723465 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f62242-a4cd-4415-a6de-80d355235a68 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:23.733856 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1403/2816] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:30:23.738115 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d95311-6438-4a52-9bec-4a4bebd6ac79 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:23.751920 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d95311-6438-4a52-9bec-4a4bebd6ac79 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:23.756948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dffbe-4d83-4a2a-8476-46b1fb9dba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:23.757640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dffbe-4d83-4a2a-8476-46b1fb9dba8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:23.758012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dffbe-4d83-4a2a-8476-46b1fb9dba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:23.758312 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dffbe-4d83-4a2a-8476-46b1fb9dba8e admin admin] PATH_INFO: `/v3/projects/224c6904df314d6d887558399629661c/users/7fbf65ad0e414f809649c35bc7b6e653/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:23.760223 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dffbe-4d83-4a2a-8476-46b1fb9dba8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=224c6904df314d6d887558399629661c, user_id=7fbf65ad0e414f809649c35bc7b6e653, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:23.762930 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dffbe-4d83-4a2a-8476-46b1fb9dba8e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:23.773478 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1414/2817] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:30:23 2022] PUT /identity/v3/projects/224c6904df314d6d887558399629661c/users/7fbf65ad0e414f809649c35bc7b6e653/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:23.784593 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021899c-c0f7-4d7c-b545-a53857470fb6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:23.784874 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021899c-c0f7-4d7c-b545-a53857470fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:23.785149 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021899c-c0f7-4d7c-b545-a53857470fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:23.814930 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7021899c-c0f7-4d7c-b545-a53857470fb6 None None] MFA Rules not processed for user `7fbf65ad0e414f809649c35bc7b6e653`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:23.816122 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7021899c-c0f7-4d7c-b545-a53857470fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:23.832502 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:23.890248 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1404/2818] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:23.902151 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dffbe-4d83-4a2a-8476-46b1fb9dba8e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:23.904576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7f5dffbe-4d83-4a2a-8476-46b1fb9dba8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:23.964952 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dffbe-4d83-4a2a-8476-46b1fb9dba8e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:23.969421 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09880edb-ffcf-4c80-83b7-1dbc7f1f62c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:23.970324 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09880edb-ffcf-4c80-83b7-1dbc7f1f62c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:23.970605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09880edb-ffcf-4c80-83b7-1dbc7f1f62c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:23.970882 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09880edb-ffcf-4c80-83b7-1dbc7f1f62c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:23.981589 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09880edb-ffcf-4c80-83b7-1dbc7f1f62c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:23.983661 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09880edb-ffcf-4c80-83b7-1dbc7f1f62c3 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:23.994691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1415/2819] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:24.077054 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021899c-c0f7-4d7c-b545-a53857470fb6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:24.092094 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021899c-c0f7-4d7c-b545-a53857470fb6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:24.096062 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde5725-36ac-4b78-a4af-3079df533f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:24.096672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde5725-36ac-4b78-a4af-3079df533f3c service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:24.096951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde5725-36ac-4b78-a4af-3079df533f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:24.097219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde5725-36ac-4b78-a4af-3079df533f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:24.160956 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde5725-36ac-4b78-a4af-3079df533f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:24.162355 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde5725-36ac-4b78-a4af-3079df533f3c service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:24.172176 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1405/2820] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:28.849028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09880edb-ffcf-4c80-83b7-1dbc7f1f62c3 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:28.850534 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-09880edb-ffcf-4c80-83b7-1dbc7f1f62c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:28.912019 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09880edb-ffcf-4c80-83b7-1dbc7f1f62c3 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:28.917288 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2472c-6167-45f0-9c31-31cff373a175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:28.918673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2472c-6167-45f0-9c31-31cff373a175 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:28.918673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2472c-6167-45f0-9c31-31cff373a175 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:28.919672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2472c-6167-45f0-9c31-31cff373a175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:28.922787 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-72e2472c-6167-45f0-9c31-31cff373a175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:28.935639 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2472c-6167-45f0-9c31-31cff373a175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:28.937073 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2472c-6167-45f0-9c31-31cff373a175 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:28.947844 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1416/2821] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:34.167857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=50 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:38.943792 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=62,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:42.364581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde5725-36ac-4b78-a4af-3079df533f3c service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:42.366024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ebde5725-36ac-4b78-a4af-3079df533f3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:42.377802 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde5725-36ac-4b78-a4af-3079df533f3c service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:42.381475 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc37798-4556-4daf-b513-d44849d47790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:42.382097 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc37798-4556-4daf-b513-d44849d47790 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:42.382378 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc37798-4556-4daf-b513-d44849d47790 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:42.382647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc37798-4556-4daf-b513-d44849d47790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:42.384284 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2dc37798-4556-4daf-b513-d44849d47790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:42.447578 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc37798-4556-4daf-b513-d44849d47790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:42.449082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc37798-4556-4daf-b513-d44849d47790 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:42.458715 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1406/2822] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:46.348940 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2472c-6167-45f0-9c31-31cff373a175 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:46.350398 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-72e2472c-6167-45f0-9c31-31cff373a175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:46.416915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2472c-6167-45f0-9c31-31cff373a175 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:46.422100 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35cea4-2528-47c3-9578-e8bd3904fbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:46.422795 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35cea4-2528-47c3-9578-e8bd3904fbcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:46.423077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35cea4-2528-47c3-9578-e8bd3904fbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:46.423352 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35cea4-2528-47c3-9578-e8bd3904fbcc admin admin] PATH_INFO: `/v3/users/12b12912749b42939ce7c6cabd70faa4` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:46.424533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35cea4-2528-47c3-9578-e8bd3904fbcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b12912749b42939ce7c6cabd70faa4)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:46.427915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35cea4-2528-47c3-9578-e8bd3904fbcc admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:46.475124 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cb35cea4-2528-47c3-9578-e8bd3904fbcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b12912749b42939ce7c6cabd70faa4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:46.475792 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cb35cea4-2528-47c3-9578-e8bd3904fbcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b12912749b42939ce7c6cabd70faa4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:46.484003 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cb35cea4-2528-47c3-9578-e8bd3904fbcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b12912749b42939ce7c6cabd70faa4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:46.496099 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cb35cea4-2528-47c3-9578-e8bd3904fbcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b12912749b42939ce7c6cabd70faa4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:46.503656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cb35cea4-2528-47c3-9578-e8bd3904fbcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b12912749b42939ce7c6cabd70faa4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:46.509419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1417/2823] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:30:46 2022] DELETE /identity/v3/users/12b12912749b42939ce7c6cabd70faa4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:46.514488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ebc78-7b35-42c1-8e01-559fb3fe43da None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:46.514966 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ebc78-7b35-42c1-8e01-559fb3fe43da None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:46.515072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ebc78-7b35-42c1-8e01-559fb3fe43da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:46.534099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-344ebc78-7b35-42c1-8e01-559fb3fe43da None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:46.535323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-344ebc78-7b35-42c1-8e01-559fb3fe43da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:46.595602 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1407/2824] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:46.605226 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35cea4-2528-47c3-9578-e8bd3904fbcc admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:46.607103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cb35cea4-2528-47c3-9578-e8bd3904fbcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:46.663272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35cea4-2528-47c3-9578-e8bd3904fbcc admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:46.666906 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81933d37-5b14-436f-9f3f-79459d04df43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:46.667509 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81933d37-5b14-436f-9f3f-79459d04df43 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:46.667788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81933d37-5b14-436f-9f3f-79459d04df43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:46.668060 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81933d37-5b14-436f-9f3f-79459d04df43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:46.677552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81933d37-5b14-436f-9f3f-79459d04df43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:46.678998 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81933d37-5b14-436f-9f3f-79459d04df43 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:46.688799 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1418/2825] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:46.956326 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ebc78-7b35-42c1-8e01-559fb3fe43da None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:46.957766 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-344ebc78-7b35-42c1-8e01-559fb3fe43da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:46.975369 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ebc78-7b35-42c1-8e01-559fb3fe43da None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:46.980154 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87e55b-ad58-4ef2-bd19-6ebc8062b996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:46.981098 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87e55b-ad58-4ef2-bd19-6ebc8062b996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:46.981454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87e55b-ad58-4ef2-bd19-6ebc8062b996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:46.981656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87e55b-ad58-4ef2-bd19-6ebc8062b996 admin admin] PATH_INFO: `/v3/projects/0fd5ba32d9a44d6187d1da5945958598` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:46.982836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87e55b-ad58-4ef2-bd19-6ebc8062b996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd5ba32d9a44d6187d1da5945958598)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:46.984794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87e55b-ad58-4ef2-bd19-6ebc8062b996 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:47.032032 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5b87e55b-ad58-4ef2-bd19-6ebc8062b996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd5ba32d9a44d6187d1da5945958598', 'request_id': 'req-5b87e55b-ad58-4ef2-bd19-6ebc8062b996'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:47.037693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5b87e55b-ad58-4ef2-bd19-6ebc8062b996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd5ba32d9a44d6187d1da5945958598', 'request_id': 'req-5b87e55b-ad58-4ef2-bd19-6ebc8062b996'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:47.044477 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5b87e55b-ad58-4ef2-bd19-6ebc8062b996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd5ba32d9a44d6187d1da5945958598', 'request_id': 'req-5b87e55b-ad58-4ef2-bd19-6ebc8062b996'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:47.056117 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5b87e55b-ad58-4ef2-bd19-6ebc8062b996 admin admin] The token cache is being invalidate because project 0fd5ba32d9a44d6187d1da5945958598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:30:47.056406 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5b87e55b-ad58-4ef2-bd19-6ebc8062b996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:47.057017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5b87e55b-ad58-4ef2-bd19-6ebc8062b996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:47.058531 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1408/2826] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:30:46 2022] DELETE /identity/v3/projects/0fd5ba32d9a44d6187d1da5945958598 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:54.103685 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81933d37-5b14-436f-9f3f-79459d04df43 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:54.105080 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-81933d37-5b14-436f-9f3f-79459d04df43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:54.118196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81933d37-5b14-436f-9f3f-79459d04df43 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:54.135827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:54.175841 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bc149-3602-4e28-94d6-342526261bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:54.176473 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bc149-3602-4e28-94d6-342526261bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:54.176753 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bc149-3602-4e28-94d6-342526261bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:54.177025 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bc149-3602-4e28-94d6-342526261bde admin admin] PATH_INFO: `/v3/users/2d82f4c13fbd4160af3666eee55fe0b7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:54.178171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bc149-3602-4e28-94d6-342526261bde admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d82f4c13fbd4160af3666eee55fe0b7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:54.180080 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bc149-3602-4e28-94d6-342526261bde admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:54.226973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d52bc149-3602-4e28-94d6-342526261bde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d82f4c13fbd4160af3666eee55fe0b7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:54.227606 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d52bc149-3602-4e28-94d6-342526261bde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d82f4c13fbd4160af3666eee55fe0b7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:54.234751 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d52bc149-3602-4e28-94d6-342526261bde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d82f4c13fbd4160af3666eee55fe0b7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:54.247331 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d52bc149-3602-4e28-94d6-342526261bde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d82f4c13fbd4160af3666eee55fe0b7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:54.254156 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d52bc149-3602-4e28-94d6-342526261bde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d82f4c13fbd4160af3666eee55fe0b7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:54.260065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1419/2827] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:30:54 2022] DELETE /identity/v3/users/2d82f4c13fbd4160af3666eee55fe0b7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:54.265103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bf0a7-b589-49e9-a95f-de0d211f7b6c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:54.265576 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bf0a7-b589-49e9-a95f-de0d211f7b6c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:54.265673 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bf0a7-b589-49e9-a95f-de0d211f7b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:54.284987 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-bc0bf0a7-b589-49e9-a95f-de0d211f7b6c None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:54.286219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bc0bf0a7-b589-49e9-a95f-de0d211f7b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:54.297940 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:54.353879 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1409/2828] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:54.363467 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bc149-3602-4e28-94d6-342526261bde admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:54.364861 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d52bc149-3602-4e28-94d6-342526261bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:54.421996 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bc149-3602-4e28-94d6-342526261bde admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:54.425638 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866441e-b316-42d4-b6b0-e71c0db694cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:54.426309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866441e-b316-42d4-b6b0-e71c0db694cd service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:54.426592 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866441e-b316-42d4-b6b0-e71c0db694cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:54.426867 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866441e-b316-42d4-b6b0-e71c0db694cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:54.436134 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866441e-b316-42d4-b6b0-e71c0db694cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:54.437605 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4866441e-b316-42d4-b6b0-e71c0db694cd service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:54.447746 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1420/2829] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:54.723983 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bf0a7-b589-49e9-a95f-de0d211f7b6c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:54.725394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bc0bf0a7-b589-49e9-a95f-de0d211f7b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:54.737411 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bf0a7-b589-49e9-a95f-de0d211f7b6c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:54.742113 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c79c3-dbeb-49b3-a271-895106e5e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:54.742843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c79c3-dbeb-49b3-a271-895106e5e09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:54.743022 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c79c3-dbeb-49b3-a271-895106e5e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:54.743324 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c79c3-dbeb-49b3-a271-895106e5e09b admin admin] PATH_INFO: `/v3/projects/635da8d2888b45a0a09e72db6abe9775` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:54.745118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c79c3-dbeb-49b3-a271-895106e5e09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=635da8d2888b45a0a09e72db6abe9775)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:54.747246 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c79c3-dbeb-49b3-a271-895106e5e09b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:54.794736 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d10c79c3-dbeb-49b3-a271-895106e5e09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635da8d2888b45a0a09e72db6abe9775', 'request_id': 'req-d10c79c3-dbeb-49b3-a271-895106e5e09b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:54.800213 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d10c79c3-dbeb-49b3-a271-895106e5e09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635da8d2888b45a0a09e72db6abe9775', 'request_id': 'req-d10c79c3-dbeb-49b3-a271-895106e5e09b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:54.806211 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d10c79c3-dbeb-49b3-a271-895106e5e09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635da8d2888b45a0a09e72db6abe9775', 'request_id': 'req-d10c79c3-dbeb-49b3-a271-895106e5e09b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:54.819116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d10c79c3-dbeb-49b3-a271-895106e5e09b admin admin] The token cache is being invalidate because project 635da8d2888b45a0a09e72db6abe9775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:30:54.819401 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d10c79c3-dbeb-49b3-a271-895106e5e09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:54.820014 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d10c79c3-dbeb-49b3-a271-895106e5e09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:54.821489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1410/2830] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:30:54 2022] DELETE /identity/v3/projects/635da8d2888b45a0a09e72db6abe9775 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:54.826397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866441e-b316-42d4-b6b0-e71c0db694cd service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:54.835823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866441e-b316-42d4-b6b0-e71c0db694cd service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:54.879189 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:54.895875 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241095d-4ca9-4011-95b2-10cf53bf5cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:54.896504 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241095d-4ca9-4011-95b2-10cf53bf5cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:54.896785 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241095d-4ca9-4011-95b2-10cf53bf5cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:54.897058 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241095d-4ca9-4011-95b2-10cf53bf5cc2 admin admin] PATH_INFO: `/v3/users/7fbf65ad0e414f809649c35bc7b6e653` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:54.898191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241095d-4ca9-4011-95b2-10cf53bf5cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fbf65ad0e414f809649c35bc7b6e653)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:54.900123 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241095d-4ca9-4011-95b2-10cf53bf5cc2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:54.945539 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a241095d-4ca9-4011-95b2-10cf53bf5cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fbf65ad0e414f809649c35bc7b6e653'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:54.946333 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a241095d-4ca9-4011-95b2-10cf53bf5cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fbf65ad0e414f809649c35bc7b6e653'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:54.953529 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a241095d-4ca9-4011-95b2-10cf53bf5cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fbf65ad0e414f809649c35bc7b6e653'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:54.965308 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a241095d-4ca9-4011-95b2-10cf53bf5cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fbf65ad0e414f809649c35bc7b6e653'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:54.972642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a241095d-4ca9-4011-95b2-10cf53bf5cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fbf65ad0e414f809649c35bc7b6e653'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:54.979254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1421/2831] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:30:54 2022] DELETE /identity/v3/users/7fbf65ad0e414f809649c35bc7b6e653 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:55.253868 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c79c3-dbeb-49b3-a271-895106e5e09b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:55.255403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d10c79c3-dbeb-49b3-a271-895106e5e09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:55.269503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c79c3-dbeb-49b3-a271-895106e5e09b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:55.327520 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9ca6f-0c40-4c37-9e0d-0912b6f38445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:55.328070 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9ca6f-0c40-4c37-9e0d-0912b6f38445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:55.328353 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9ca6f-0c40-4c37-9e0d-0912b6f38445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:55.328628 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9ca6f-0c40-4c37-9e0d-0912b6f38445 admin admin] PATH_INFO: `/v3/projects/224c6904df314d6d887558399629661c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:55.329781 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9ca6f-0c40-4c37-9e0d-0912b6f38445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=224c6904df314d6d887558399629661c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:55.331721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9ca6f-0c40-4c37-9e0d-0912b6f38445 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:55.375057 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:55.379041 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bbb9ca6f-0c40-4c37-9e0d-0912b6f38445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224c6904df314d6d887558399629661c', 'request_id': 'req-bbb9ca6f-0c40-4c37-9e0d-0912b6f38445'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:55.385537 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bbb9ca6f-0c40-4c37-9e0d-0912b6f38445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224c6904df314d6d887558399629661c', 'request_id': 'req-bbb9ca6f-0c40-4c37-9e0d-0912b6f38445'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:55.392256 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bbb9ca6f-0c40-4c37-9e0d-0912b6f38445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224c6904df314d6d887558399629661c', 'request_id': 'req-bbb9ca6f-0c40-4c37-9e0d-0912b6f38445'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:55.404663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bbb9ca6f-0c40-4c37-9e0d-0912b6f38445 admin admin] The token cache is being invalidate because project 224c6904df314d6d887558399629661c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:30:55.404955 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bbb9ca6f-0c40-4c37-9e0d-0912b6f38445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:55.405579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-bbb9ca6f-0c40-4c37-9e0d-0912b6f38445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:30:55.407104 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1411/2832] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:30:55 2022] DELETE /identity/v3/projects/224c6904df314d6d887558399629661c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:55.411974 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8074989-fbeb-43a5-b989-f4af97cc5361 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:55.412465 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8074989-fbeb-43a5-b989-f4af97cc5361 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:55.412576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8074989-fbeb-43a5-b989-f4af97cc5361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:55.432300 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f8074989-fbeb-43a5-b989-f4af97cc5361 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:55.434107 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f8074989-fbeb-43a5-b989-f4af97cc5361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:55.492947 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1422/2833] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:55.501775 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18782d-157f-4f5d-8f20-d9739151fffe None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:55.502065 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18782d-157f-4f5d-8f20-d9739151fffe None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:55.502343 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18782d-157f-4f5d-8f20-d9739151fffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:55.522332 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-bc18782d-157f-4f5d-8f20-d9739151fffe None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:55.523535 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bc18782d-157f-4f5d-8f20-d9739151fffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:55.531422 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1412/2834] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:30:55.535587 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8074989-fbeb-43a5-b989-f4af97cc5361 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:55.545422 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8074989-fbeb-43a5-b989-f4af97cc5361 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:55.550028 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5388c-fb32-4155-b5a4-9b38efca58ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:55.550626 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5388c-fb32-4155-b5a4-9b38efca58ac admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:55.550905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5388c-fb32-4155-b5a4-9b38efca58ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:55.551179 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5388c-fb32-4155-b5a4-9b38efca58ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:55.551819 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5388c-fb32-4155-b5a4-9b38efca58ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:30:55.552125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5388c-fb32-4155-b5a4-9b38efca58ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:55.553774 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5388c-fb32-4155-b5a4-9b38efca58ac admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:55.565807 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1423/2835] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 17:30:55.570010 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18782d-157f-4f5d-8f20-d9739151fffe None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:55.579865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18782d-157f-4f5d-8f20-d9739151fffe None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:55.584743 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac9d67-110e-4ccf-a166-f03e2909a3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:55.585310 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac9d67-110e-4ccf-a166-f03e2909a3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:55.585599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac9d67-110e-4ccf-a166-f03e2909a3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:55.585894 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac9d67-110e-4ccf-a166-f03e2909a3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:55.586522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac9d67-110e-4ccf-a166-f03e2909a3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:55.588447 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac9d67-110e-4ccf-a166-f03e2909a3f2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:55.616921 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1413/2836] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:30:55 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:30:55.621677 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5388c-fb32-4155-b5a4-9b38efca58ac admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:55.631579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5388c-fb32-4155-b5a4-9b38efca58ac admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:55.684983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:55.696088 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7169c-6c0b-4ada-97d7-c87d1ae08944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:55.696703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7169c-6c0b-4ada-97d7-c87d1ae08944 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:55.696989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7169c-6c0b-4ada-97d7-c87d1ae08944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:55.697272 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7169c-6c0b-4ada-97d7-c87d1ae08944 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:55.697936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7169c-6c0b-4ada-97d7-c87d1ae08944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:55.699960 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7169c-6c0b-4ada-97d7-c87d1ae08944 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:55.721569 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1424/2837] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:30:55 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:30:55.726021 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac9d67-110e-4ccf-a166-f03e2909a3f2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:55.736642 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac9d67-110e-4ccf-a166-f03e2909a3f2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:55.741185 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4661bac-bbe4-4e89-a0fc-2bc6e86ff8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:55.741820 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4661bac-bbe4-4e89-a0fc-2bc6e86ff8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:55.742102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4661bac-bbe4-4e89-a0fc-2bc6e86ff8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:55.742374 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4661bac-bbe4-4e89-a0fc-2bc6e86ff8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:55.743006 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4661bac-bbe4-4e89-a0fc-2bc6e86ff8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:55.744593 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4661bac-bbe4-4e89-a0fc-2bc6e86ff8a5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:55.755053 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1414/2838] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:30:55.759158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7169c-6c0b-4ada-97d7-c87d1ae08944 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:55.769296 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7169c-6c0b-4ada-97d7-c87d1ae08944 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:55.773902 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffa498-e30a-4f87-b0f8-4d7945aa2970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:55.774488 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffa498-e30a-4f87-b0f8-4d7945aa2970 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:55.774772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffa498-e30a-4f87-b0f8-4d7945aa2970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:55.775039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffa498-e30a-4f87-b0f8-4d7945aa2970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:55.775666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffa498-e30a-4f87-b0f8-4d7945aa2970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:55.777376 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffa498-e30a-4f87-b0f8-4d7945aa2970 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:55.787196 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1425/2839] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 17:30:55.791112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4661bac-bbe4-4e89-a0fc-2bc6e86ff8a5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:55.801382 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4661bac-bbe4-4e89-a0fc-2bc6e86ff8a5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:55.806041 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f14f12-1d68-42cf-a513-aab822b1edd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:55.806683 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f14f12-1d68-42cf-a513-aab822b1edd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:55.806963 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f14f12-1d68-42cf-a513-aab822b1edd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:55.807235 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f14f12-1d68-42cf-a513-aab822b1edd4 admin admin] PATH_INFO: `/v3/projects/9f101d4ed7db40ccb0ce2166c95b38bc/users/13ebfe0c16e347fe839cd46c3b5b298e/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:55.822057 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f14f12-1d68-42cf-a513-aab822b1edd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f101d4ed7db40ccb0ce2166c95b38bc, user_id=13ebfe0c16e347fe839cd46c3b5b298e, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:55.824841 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f14f12-1d68-42cf-a513-aab822b1edd4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:55.837647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1415/2840] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:30:55 2022] PUT /identity/v3/projects/9f101d4ed7db40ccb0ce2166c95b38bc/users/13ebfe0c16e347fe839cd46c3b5b298e/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:55.842842 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1703da-1f2e-486e-a11e-0ba26f1a1ead None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:55.843130 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1703da-1f2e-486e-a11e-0ba26f1a1ead None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:55.843407 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1703da-1f2e-486e-a11e-0ba26f1a1ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:55.863147 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-aa1703da-1f2e-486e-a11e-0ba26f1a1ead None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:55.864338 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-aa1703da-1f2e-486e-a11e-0ba26f1a1ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:55.923169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1426/2841] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:55.932668 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f14f12-1d68-42cf-a513-aab822b1edd4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:55.935098 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-99f14f12-1d68-42cf-a513-aab822b1edd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:55.991340 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f14f12-1d68-42cf-a513-aab822b1edd4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:55.994968 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eca900-4331-43b0-bfb3-4c61f51e5035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:55.995571 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eca900-4331-43b0-bfb3-4c61f51e5035 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:55.995887 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eca900-4331-43b0-bfb3-4c61f51e5035 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:55.996253 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eca900-4331-43b0-bfb3-4c61f51e5035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:56.005083 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eca900-4331-43b0-bfb3-4c61f51e5035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:56.006539 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eca900-4331-43b0-bfb3-4c61f51e5035 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:56.016005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1416/2842] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:30:56.891744 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7adf76-3dbc-4a29-a232-40bbdc3bb5dc None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:56.892283 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7adf76-3dbc-4a29-a232-40bbdc3bb5dc None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:56.892283 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7adf76-3dbc-4a29-a232-40bbdc3bb5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:56.920088 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8b7adf76-3dbc-4a29-a232-40bbdc3bb5dc None None] MFA Rules not processed for user `13ebfe0c16e347fe839cd46c3b5b298e`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:56.921311 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8b7adf76-3dbc-4a29-a232-40bbdc3bb5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:56.988220 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1427/2843] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:56.992789 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eca900-4331-43b0-bfb3-4c61f51e5035 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:57.003429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eca900-4331-43b0-bfb3-4c61f51e5035 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:57.008103 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f464ce0-d2f3-4084-b83a-788be19b40e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:57.008799 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f464ce0-d2f3-4084-b83a-788be19b40e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:57.009089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f464ce0-d2f3-4084-b83a-788be19b40e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:57.009366 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f464ce0-d2f3-4084-b83a-788be19b40e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:57.010043 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f464ce0-d2f3-4084-b83a-788be19b40e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:57.012569 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f464ce0-d2f3-4084-b83a-788be19b40e6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:57.043410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1417/2844] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:30:56 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:30:57.044524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7adf76-3dbc-4a29-a232-40bbdc3bb5dc None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:57.055826 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7adf76-3dbc-4a29-a232-40bbdc3bb5dc None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:57.112913 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e1a20-9039-44dc-a4a9-72d0890033d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:57.113524 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e1a20-9039-44dc-a4a9-72d0890033d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:57.113838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e1a20-9039-44dc-a4a9-72d0890033d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:57.114114 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e1a20-9039-44dc-a4a9-72d0890033d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:57.114754 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e1a20-9039-44dc-a4a9-72d0890033d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:57.116660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e1a20-9039-44dc-a4a9-72d0890033d0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:57.125069 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:57.138670 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1428/2845] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:30:57 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:30:57.142844 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f464ce0-d2f3-4084-b83a-788be19b40e6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:57.153106 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f464ce0-d2f3-4084-b83a-788be19b40e6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:57.157707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6ac84-f4f8-416c-b1c8-8e10d71da39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:57.158306 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ac84-f4f8-416c-b1c8-8e10d71da39d admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:57.158589 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ac84-f4f8-416c-b1c8-8e10d71da39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:57.158865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ac84-f4f8-416c-b1c8-8e10d71da39d admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:57.159499 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6ac84-f4f8-416c-b1c8-8e10d71da39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:57.161086 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6ac84-f4f8-416c-b1c8-8e10d71da39d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:57.172104 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1418/2846] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:30:57.176103 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e1a20-9039-44dc-a4a9-72d0890033d0 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:57.187428 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e1a20-9039-44dc-a4a9-72d0890033d0 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:57.192079 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1172a78-5da5-4c4a-99d0-95a7b8b2375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:57.192728 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1172a78-5da5-4c4a-99d0-95a7b8b2375b admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:57.193041 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1172a78-5da5-4c4a-99d0-95a7b8b2375b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:57.193317 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1172a78-5da5-4c4a-99d0-95a7b8b2375b admin admin] PATH_INFO: `/v3/projects/99b043a68c104205a17ababe92e7658f/users/112fae6fb65b4ce3881789cf1a4fdc0b/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:57.208120 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1172a78-5da5-4c4a-99d0-95a7b8b2375b admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b043a68c104205a17ababe92e7658f, user_id=112fae6fb65b4ce3881789cf1a4fdc0b, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:57.210804 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1172a78-5da5-4c4a-99d0-95a7b8b2375b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:57.223673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1429/2847] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:30:57 2022] PUT /identity/v3/projects/99b043a68c104205a17ababe92e7658f/users/112fae6fb65b4ce3881789cf1a4fdc0b/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:57.227590 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6ac84-f4f8-416c-b1c8-8e10d71da39d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:57.238291 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6ac84-f4f8-416c-b1c8-8e10d71da39d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:57.271193 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:57.295905 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179df445-1a40-4ee2-be35-4e9d73d3efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:57.296507 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179df445-1a40-4ee2-be35-4e9d73d3efee admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:57.296788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179df445-1a40-4ee2-be35-4e9d73d3efee admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:57.297060 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179df445-1a40-4ee2-be35-4e9d73d3efee admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:57.297701 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179df445-1a40-4ee2-be35-4e9d73d3efee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:57.299317 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179df445-1a40-4ee2-be35-4e9d73d3efee admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:57.309545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1419/2848] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:30:57.313647 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1172a78-5da5-4c4a-99d0-95a7b8b2375b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:57.324050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1172a78-5da5-4c4a-99d0-95a7b8b2375b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:57.328577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00427922-a539-4a9c-a6a8-97f11d74cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:57.329221 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00427922-a539-4a9c-a6a8-97f11d74cf53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:57.329501 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00427922-a539-4a9c-a6a8-97f11d74cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:57.329812 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00427922-a539-4a9c-a6a8-97f11d74cf53 admin admin] PATH_INFO: `/v3/projects/99b043a68c104205a17ababe92e7658f/users/112fae6fb65b4ce3881789cf1a4fdc0b/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:57.331718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00427922-a539-4a9c-a6a8-97f11d74cf53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b043a68c104205a17ababe92e7658f, user_id=112fae6fb65b4ce3881789cf1a4fdc0b, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:57.334372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00427922-a539-4a9c-a6a8-97f11d74cf53 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:57.344970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1430/2849] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:30:57 2022] PUT /identity/v3/projects/99b043a68c104205a17ababe92e7658f/users/112fae6fb65b4ce3881789cf1a4fdc0b/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:30:57.963923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5b1de-6ffb-43da-816c-1b413518f83c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:57.964210 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5b1de-6ffb-43da-816c-1b413518f83c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:57.964488 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5b1de-6ffb-43da-816c-1b413518f83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:57.993542 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-bdd5b1de-6ffb-43da-816c-1b413518f83c None None] MFA Rules not processed for user `112fae6fb65b4ce3881789cf1a4fdc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:57.994792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bdd5b1de-6ffb-43da-816c-1b413518f83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:58.070312 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1420/2850] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:30:58.081209 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3e3ea-8c64-415b-bfa6-f94e628f0887 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:58.081983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3e3ea-8c64-415b-bfa6-f94e628f0887 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:58.081983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3e3ea-8c64-415b-bfa6-f94e628f0887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:58.102671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-fca3e3ea-8c64-415b-bfa6-f94e628f0887 None None] MFA Rules not processed for user `13ebfe0c16e347fe839cd46c3b5b298e`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:30:58.103796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fca3e3ea-8c64-415b-bfa6-f94e628f0887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:58.162397 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1431/2851] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:30:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:30:58.176015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5b1de-6ffb-43da-816c-1b413518f83c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:30:58.177581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bdd5b1de-6ffb-43da-816c-1b413518f83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:30:58.252607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5b1de-6ffb-43da-816c-1b413518f83c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:30:58.258090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdd54e-ec47-4ccd-9f4c-e11e92243bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:30:58.258705 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdd54e-ec47-4ccd-9f4c-e11e92243bc1 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:30:58.258985 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdd54e-ec47-4ccd-9f4c-e11e92243bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:30:58.259260 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdd54e-ec47-4ccd-9f4c-e11e92243bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:30:58.267512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdd54e-ec47-4ccd-9f4c-e11e92243bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:30:58.269116 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdd54e-ec47-4ccd-9f4c-e11e92243bc1 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:30:58.278703 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1421/2852] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:30:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:31:08.155794 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:INSERT=5,keystone:SELECT=42 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:31:08.273776 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=80 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:31:09.912050 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3e3ea-8c64-415b-bfa6-f94e628f0887 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:09.913460 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fca3e3ea-8c64-415b-bfa6-f94e628f0887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:09.970032 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3e3ea-8c64-415b-bfa6-f94e628f0887 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:09.973449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c1b5e-5665-416d-a611-bc6c0e3a3848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:09.974077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c1b5e-5665-416d-a611-bc6c0e3a3848 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:09.974354 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c1b5e-5665-416d-a611-bc6c0e3a3848 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:09.974666 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c1b5e-5665-416d-a611-bc6c0e3a3848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:09.985194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c1b5e-5665-416d-a611-bc6c0e3a3848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:09.986652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c1b5e-5665-416d-a611-bc6c0e3a3848 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:09.996660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1432/2853] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:31:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:31:19.991689 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=26 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:31:29.706724 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdd54e-ec47-4ccd-9f4c-e11e92243bc1 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:29.771686 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdd54e-ec47-4ccd-9f4c-e11e92243bc1 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:29.776240 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44093e-dca0-44ee-9615-e3f160837c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:29.776855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44093e-dca0-44ee-9615-e3f160837c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:29.777128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44093e-dca0-44ee-9615-e3f160837c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:29.777398 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44093e-dca0-44ee-9615-e3f160837c2b admin admin] PATH_INFO: `/v3/users/13ebfe0c16e347fe839cd46c3b5b298e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:29.779327 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44093e-dca0-44ee-9615-e3f160837c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ebfe0c16e347fe839cd46c3b5b298e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:29.781264 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44093e-dca0-44ee-9615-e3f160837c2b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:29.827644 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9f44093e-dca0-44ee-9615-e3f160837c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ebfe0c16e347fe839cd46c3b5b298e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:29.834730 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9f44093e-dca0-44ee-9615-e3f160837c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ebfe0c16e347fe839cd46c3b5b298e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:29.847759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9f44093e-dca0-44ee-9615-e3f160837c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ebfe0c16e347fe839cd46c3b5b298e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:29.854625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9f44093e-dca0-44ee-9615-e3f160837c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ebfe0c16e347fe839cd46c3b5b298e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:29.855282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9f44093e-dca0-44ee-9615-e3f160837c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ebfe0c16e347fe839cd46c3b5b298e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:29.861722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1422/2854] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:31:29 2022] DELETE /identity/v3/users/13ebfe0c16e347fe839cd46c3b5b298e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:31:30.030967 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c1b5e-5665-416d-a611-bc6c0e3a3848 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:30.041577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c1b5e-5665-416d-a611-bc6c0e3a3848 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:30.100974 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae137c-a323-43e2-8735-72c5b4adf095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:30.101532 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae137c-a323-43e2-8735-72c5b4adf095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:30.101852 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae137c-a323-43e2-8735-72c5b4adf095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:30.102135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae137c-a323-43e2-8735-72c5b4adf095 admin admin] PATH_INFO: `/v3/projects/9f101d4ed7db40ccb0ce2166c95b38bc` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:30.103277 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae137c-a323-43e2-8735-72c5b4adf095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f101d4ed7db40ccb0ce2166c95b38bc)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:30.105206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae137c-a323-43e2-8735-72c5b4adf095 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:30.150885 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4ae137c-a323-43e2-8735-72c5b4adf095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f101d4ed7db40ccb0ce2166c95b38bc', 'request_id': 'req-d4ae137c-a323-43e2-8735-72c5b4adf095'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:30.161092 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4ae137c-a323-43e2-8735-72c5b4adf095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f101d4ed7db40ccb0ce2166c95b38bc', 'request_id': 'req-d4ae137c-a323-43e2-8735-72c5b4adf095'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:30.167355 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4ae137c-a323-43e2-8735-72c5b4adf095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f101d4ed7db40ccb0ce2166c95b38bc', 'request_id': 'req-d4ae137c-a323-43e2-8735-72c5b4adf095'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:30.179796 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4ae137c-a323-43e2-8735-72c5b4adf095 admin admin] The token cache is being invalidate because project 9f101d4ed7db40ccb0ce2166c95b38bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:31:30.180081 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4ae137c-a323-43e2-8735-72c5b4adf095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:30.180718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d4ae137c-a323-43e2-8735-72c5b4adf095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:30.182298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1433/2855] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:31:30 2022] DELETE /identity/v3/projects/9f101d4ed7db40ccb0ce2166c95b38bc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:31:30.186756 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44093e-dca0-44ee-9615-e3f160837c2b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:30.188444 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9f44093e-dca0-44ee-9615-e3f160837c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:30.202289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44093e-dca0-44ee-9615-e3f160837c2b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:30.257610 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233a17e-d9fa-48b2-b287-9ec1d223e179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:30.258252 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233a17e-d9fa-48b2-b287-9ec1d223e179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:30.258526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233a17e-d9fa-48b2-b287-9ec1d223e179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:30.258792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233a17e-d9fa-48b2-b287-9ec1d223e179 admin admin] PATH_INFO: `/v3/users/112fae6fb65b4ce3881789cf1a4fdc0b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:30.259893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233a17e-d9fa-48b2-b287-9ec1d223e179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=112fae6fb65b4ce3881789cf1a4fdc0b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:30.261843 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233a17e-d9fa-48b2-b287-9ec1d223e179 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:30.284005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:31:30.310140 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b233a17e-d9fa-48b2-b287-9ec1d223e179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '112fae6fb65b4ce3881789cf1a4fdc0b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:30.317606 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b233a17e-d9fa-48b2-b287-9ec1d223e179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '112fae6fb65b4ce3881789cf1a4fdc0b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:30.330425 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b233a17e-d9fa-48b2-b287-9ec1d223e179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '112fae6fb65b4ce3881789cf1a4fdc0b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:30.337165 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b233a17e-d9fa-48b2-b287-9ec1d223e179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '112fae6fb65b4ce3881789cf1a4fdc0b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:30.337919 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b233a17e-d9fa-48b2-b287-9ec1d223e179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '112fae6fb65b4ce3881789cf1a4fdc0b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:30.345044 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1423/2856] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:31:30 2022] DELETE /identity/v3/users/112fae6fb65b4ce3881789cf1a4fdc0b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:31:30.520964 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae137c-a323-43e2-8735-72c5b4adf095 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:30.522525 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d4ae137c-a323-43e2-8735-72c5b4adf095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:30.562637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae137c-a323-43e2-8735-72c5b4adf095 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:30.626286 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:31:30.663130 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe2ede-a597-40a9-8f34-3ad6d6ed0165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:30.663690 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe2ede-a597-40a9-8f34-3ad6d6ed0165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:30.663963 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe2ede-a597-40a9-8f34-3ad6d6ed0165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:30.664231 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe2ede-a597-40a9-8f34-3ad6d6ed0165 admin admin] PATH_INFO: `/v3/projects/99b043a68c104205a17ababe92e7658f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:30.665437 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe2ede-a597-40a9-8f34-3ad6d6ed0165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b043a68c104205a17ababe92e7658f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:30.676737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe2ede-a597-40a9-8f34-3ad6d6ed0165 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:30.716021 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-27fe2ede-a597-40a9-8f34-3ad6d6ed0165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b043a68c104205a17ababe92e7658f', 'request_id': 'req-27fe2ede-a597-40a9-8f34-3ad6d6ed0165'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:30.721659 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-27fe2ede-a597-40a9-8f34-3ad6d6ed0165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b043a68c104205a17ababe92e7658f', 'request_id': 'req-27fe2ede-a597-40a9-8f34-3ad6d6ed0165'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:30.727627 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-27fe2ede-a597-40a9-8f34-3ad6d6ed0165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b043a68c104205a17ababe92e7658f', 'request_id': 'req-27fe2ede-a597-40a9-8f34-3ad6d6ed0165'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:30.740772 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-27fe2ede-a597-40a9-8f34-3ad6d6ed0165 admin admin] The token cache is being invalidate because project 99b043a68c104205a17ababe92e7658f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:31:30.741067 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-27fe2ede-a597-40a9-8f34-3ad6d6ed0165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:30.741714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-27fe2ede-a597-40a9-8f34-3ad6d6ed0165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:30.743184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1434/2857] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:31:30 2022] DELETE /identity/v3/projects/99b043a68c104205a17ababe92e7658f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:31:30.748236 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b6e7-1ad4-43a4-9785-78c426615d5e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:30.748720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b6e7-1ad4-43a4-9785-78c426615d5e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:30.748834 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b6e7-1ad4-43a4-9785-78c426615d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:30.805744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4e23b6e7-1ad4-43a4-9785-78c426615d5e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:31:30.806936 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4e23b6e7-1ad4-43a4-9785-78c426615d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:30.865047 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1424/2858] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:31:30.873823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a153-d411-492d-8d92-f2b4d15f6907 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:30.874105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a153-d411-492d-8d92-f2b4d15f6907 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:30.874377 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6a153-d411-492d-8d92-f2b4d15f6907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:30.894026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7dc6a153-d411-492d-8d92-f2b4d15f6907 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:31:30.895214 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7dc6a153-d411-492d-8d92-f2b4d15f6907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:30.902800 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1435/2859] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:31:30.907778 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23b6e7-1ad4-43a4-9785-78c426615d5e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:30.917620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23b6e7-1ad4-43a4-9785-78c426615d5e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:30.922091 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4aac7-3601-4a2b-a495-ae7de13664e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:30.922699 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4aac7-3601-4a2b-a495-ae7de13664e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:30.922960 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4aac7-3601-4a2b-a495-ae7de13664e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:30.923231 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4aac7-3601-4a2b-a495-ae7de13664e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:30.923860 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4aac7-3601-4a2b-a495-ae7de13664e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:31:30.924162 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4aac7-3601-4a2b-a495-ae7de13664e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:30.925762 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4aac7-3601-4a2b-a495-ae7de13664e1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:30.937323 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1425/2860] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:31:30.941432 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a153-d411-492d-8d92-f2b4d15f6907 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:30.951295 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6a153-d411-492d-8d92-f2b4d15f6907 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:30.955961 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b490b-2b91-4a43-aa88-1b4e0685a781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:30.956553 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b490b-2b91-4a43-aa88-1b4e0685a781 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:30.956837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b490b-2b91-4a43-aa88-1b4e0685a781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:30.957111 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b490b-2b91-4a43-aa88-1b4e0685a781 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:30.957775 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b490b-2b91-4a43-aa88-1b4e0685a781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:30.959657 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b490b-2b91-4a43-aa88-1b4e0685a781 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:30.988260 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1436/2861] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:31:30 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:31:30.992350 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4aac7-3601-4a2b-a495-ae7de13664e1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:31.002333 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4aac7-3601-4a2b-a495-ae7de13664e1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:31.051405 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:31:31.059521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a1d22-5b06-481d-b6ed-a64d6cea2287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:31.060177 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a1d22-5b06-481d-b6ed-a64d6cea2287 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:31.060632 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a1d22-5b06-481d-b6ed-a64d6cea2287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:31.060908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a1d22-5b06-481d-b6ed-a64d6cea2287 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:31.061545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a1d22-5b06-481d-b6ed-a64d6cea2287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:31.063526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a1d22-5b06-481d-b6ed-a64d6cea2287 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:31.084523 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1426/2862] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:31:30 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:31:31.088812 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b490b-2b91-4a43-aa88-1b4e0685a781 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:31.100171 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b490b-2b91-4a43-aa88-1b4e0685a781 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:31.104821 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e77e77-18b1-431c-9b58-c0d3c1315983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:31.105407 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e77e77-18b1-431c-9b58-c0d3c1315983 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:31.105711 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e77e77-18b1-431c-9b58-c0d3c1315983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:31.106036 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e77e77-18b1-431c-9b58-c0d3c1315983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:31.106854 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e77e77-18b1-431c-9b58-c0d3c1315983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:31.108445 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e77e77-18b1-431c-9b58-c0d3c1315983 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:31.118257 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1437/2863] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:31:31.122467 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a1d22-5b06-481d-b6ed-a64d6cea2287 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:31.132206 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a1d22-5b06-481d-b6ed-a64d6cea2287 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:31.136737 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e6567-2264-4ae3-82a6-58e099ce207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:31.137891 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e6567-2264-4ae3-82a6-58e099ce207b admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:31.138167 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e6567-2264-4ae3-82a6-58e099ce207b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:31.138520 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e6567-2264-4ae3-82a6-58e099ce207b admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:31.139155 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e6567-2264-4ae3-82a6-58e099ce207b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:31.140758 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e6567-2264-4ae3-82a6-58e099ce207b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:31.151009 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1427/2864] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:31:31.155582 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e77e77-18b1-431c-9b58-c0d3c1315983 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:31.165321 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e77e77-18b1-431c-9b58-c0d3c1315983 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:31.170234 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2d609-89fb-452d-b803-d632f8d2c2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:31.170811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2d609-89fb-452d-b803-d632f8d2c2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:31.171091 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2d609-89fb-452d-b803-d632f8d2c2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:31.171366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2d609-89fb-452d-b803-d632f8d2c2a0 admin admin] PATH_INFO: `/v3/projects/f0544f429dcc43f0bc7367db822341fa/users/e2c1a7f8fcf549f18e977e5f646fe097/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:31.186343 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2d609-89fb-452d-b803-d632f8d2c2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0544f429dcc43f0bc7367db822341fa, user_id=e2c1a7f8fcf549f18e977e5f646fe097, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:31.189131 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2d609-89fb-452d-b803-d632f8d2c2a0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:31.201897 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1438/2865] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:31:31 2022] PUT /identity/v3/projects/f0544f429dcc43f0bc7367db822341fa/users/e2c1a7f8fcf549f18e977e5f646fe097/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:31:31.212167 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9af53-abe8-4f3d-826a-57ebf295dfa5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:31.212454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9af53-abe8-4f3d-826a-57ebf295dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:31.212728 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9af53-abe8-4f3d-826a-57ebf295dfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:31.239790 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-92a9af53-abe8-4f3d-826a-57ebf295dfa5 None None] MFA Rules not processed for user `e2c1a7f8fcf549f18e977e5f646fe097`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:31:31.240974 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-92a9af53-abe8-4f3d-826a-57ebf295dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:31.303196 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1428/2866] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:31:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:31:31.314917 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2d609-89fb-452d-b803-d632f8d2c2a0 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:31.316579 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f0f2d609-89fb-452d-b803-d632f8d2c2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:31.375225 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:31:31.392031 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2d609-89fb-452d-b803-d632f8d2c2a0 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:31.395675 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba875f25-c91b-4ce5-a55f-29a1f1ce2205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:31.396274 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba875f25-c91b-4ce5-a55f-29a1f1ce2205 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:31.396550 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba875f25-c91b-4ce5-a55f-29a1f1ce2205 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:31.396821 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba875f25-c91b-4ce5-a55f-29a1f1ce2205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:31.405046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba875f25-c91b-4ce5-a55f-29a1f1ce2205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:31.406485 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba875f25-c91b-4ce5-a55f-29a1f1ce2205 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:31.415121 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1439/2867] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:31:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:31:31.434183 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9af53-abe8-4f3d-826a-57ebf295dfa5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:31.496184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9af53-abe8-4f3d-826a-57ebf295dfa5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:31.501346 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b2cba-3e77-4cdc-80bf-70d4b150b394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:31.502008 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b2cba-3e77-4cdc-80bf-70d4b150b394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:31.502298 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b2cba-3e77-4cdc-80bf-70d4b150b394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:31.502572 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b2cba-3e77-4cdc-80bf-70d4b150b394 admin admin] PATH_INFO: `/v3/users/e2c1a7f8fcf549f18e977e5f646fe097` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:31.503704 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b2cba-3e77-4cdc-80bf-70d4b150b394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c1a7f8fcf549f18e977e5f646fe097)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:31.505608 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b2cba-3e77-4cdc-80bf-70d4b150b394 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:31.552904 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e67b2cba-3e77-4cdc-80bf-70d4b150b394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c1a7f8fcf549f18e977e5f646fe097'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:31.560687 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e67b2cba-3e77-4cdc-80bf-70d4b150b394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c1a7f8fcf549f18e977e5f646fe097'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:31.568777 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:31:31.573722 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e67b2cba-3e77-4cdc-80bf-70d4b150b394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c1a7f8fcf549f18e977e5f646fe097'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:31.581547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e67b2cba-3e77-4cdc-80bf-70d4b150b394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c1a7f8fcf549f18e977e5f646fe097'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:31.582263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e67b2cba-3e77-4cdc-80bf-70d4b150b394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c1a7f8fcf549f18e977e5f646fe097'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:31.588082 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1429/2868] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:31:31 2022] DELETE /identity/v3/users/e2c1a7f8fcf549f18e977e5f646fe097 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:31:31.592991 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1439eb4-2562-45d6-ae17-410b41f8ffcf None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:31.593275 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1439eb4-2562-45d6-ae17-410b41f8ffcf None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:31.593548 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1439eb4-2562-45d6-ae17-410b41f8ffcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:31.613672 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d1439eb4-2562-45d6-ae17-410b41f8ffcf None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:31:31.614889 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d1439eb4-2562-45d6-ae17-410b41f8ffcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:31.673001 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1440/2869] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:31:31.682695 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b2cba-3e77-4cdc-80bf-70d4b150b394 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:31.684135 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e67b2cba-3e77-4cdc-80bf-70d4b150b394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:31.741505 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b2cba-3e77-4cdc-80bf-70d4b150b394 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:31.745184 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61171cf9-1b47-4c66-a8b3-6998c4f10b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:31.745808 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61171cf9-1b47-4c66-a8b3-6998c4f10b31 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:31.746089 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61171cf9-1b47-4c66-a8b3-6998c4f10b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:31.746360 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61171cf9-1b47-4c66-a8b3-6998c4f10b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:31.755907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61171cf9-1b47-4c66-a8b3-6998c4f10b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:31.757319 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61171cf9-1b47-4c66-a8b3-6998c4f10b31 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:31.766809 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1430/2870] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:31:32.037788 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1439eb4-2562-45d6-ae17-410b41f8ffcf None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:32.040176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d1439eb4-2562-45d6-ae17-410b41f8ffcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:32.054739 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1439eb4-2562-45d6-ae17-410b41f8ffcf None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:32.059551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa465c-b1d8-4e49-be61-22bc1b35227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:32.060402 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa465c-b1d8-4e49-be61-22bc1b35227c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:32.060700 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa465c-b1d8-4e49-be61-22bc1b35227c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:32.060933 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa465c-b1d8-4e49-be61-22bc1b35227c admin admin] PATH_INFO: `/v3/projects/f0544f429dcc43f0bc7367db822341fa` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:32.062018 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa465c-b1d8-4e49-be61-22bc1b35227c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0544f429dcc43f0bc7367db822341fa)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:32.063834 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa465c-b1d8-4e49-be61-22bc1b35227c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:32.110748 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-defa465c-b1d8-4e49-be61-22bc1b35227c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0544f429dcc43f0bc7367db822341fa', 'request_id': 'req-defa465c-b1d8-4e49-be61-22bc1b35227c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:32.116191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-defa465c-b1d8-4e49-be61-22bc1b35227c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0544f429dcc43f0bc7367db822341fa', 'request_id': 'req-defa465c-b1d8-4e49-be61-22bc1b35227c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:32.122190 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-defa465c-b1d8-4e49-be61-22bc1b35227c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0544f429dcc43f0bc7367db822341fa', 'request_id': 'req-defa465c-b1d8-4e49-be61-22bc1b35227c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:32.134305 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-defa465c-b1d8-4e49-be61-22bc1b35227c admin admin] The token cache is being invalidate because project f0544f429dcc43f0bc7367db822341fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:31:32.134590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-defa465c-b1d8-4e49-be61-22bc1b35227c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:32.135197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-defa465c-b1d8-4e49-be61-22bc1b35227c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:31:32.136675 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1441/2871] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:31:32 2022] DELETE /identity/v3/projects/f0544f429dcc43f0bc7367db822341fa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:31:32.141677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bd4ba-da1b-45d5-bb22-b52c0a0612f7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:32.141990 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bd4ba-da1b-45d5-bb22-b52c0a0612f7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:32.142264 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bd4ba-da1b-45d5-bb22-b52c0a0612f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:32.161867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-377bd4ba-da1b-45d5-bb22-b52c0a0612f7 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:31:32.163059 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-377bd4ba-da1b-45d5-bb22-b52c0a0612f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:32.221533 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1431/2872] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:31:32.229265 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425cd1a-efcc-4834-b50f-03733d9797a9 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:32.229551 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425cd1a-efcc-4834-b50f-03733d9797a9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:32.230148 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425cd1a-efcc-4834-b50f-03733d9797a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:32.250282 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-9425cd1a-efcc-4834-b50f-03733d9797a9 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:31:32.251495 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9425cd1a-efcc-4834-b50f-03733d9797a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:32.259458 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1442/2873] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:31:32.264620 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bd4ba-da1b-45d5-bb22-b52c0a0612f7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:32.274090 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bd4ba-da1b-45d5-bb22-b52c0a0612f7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:32.278654 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4af559-f597-4734-b1b1-0ca45a517811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:32.279737 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4af559-f597-4734-b1b1-0ca45a517811 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:32.280015 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4af559-f597-4734-b1b1-0ca45a517811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:32.280280 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4af559-f597-4734-b1b1-0ca45a517811 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:32.280912 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4af559-f597-4734-b1b1-0ca45a517811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:31:32.281207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4af559-f597-4734-b1b1-0ca45a517811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:32.282877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4af559-f597-4734-b1b1-0ca45a517811 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:32.294255 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1432/2874] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:31:32.298722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425cd1a-efcc-4834-b50f-03733d9797a9 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:32.307873 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425cd1a-efcc-4834-b50f-03733d9797a9 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:32.312899 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffa5a5-a530-48f2-a11d-620663ea7475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:32.313491 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffa5a5-a530-48f2-a11d-620663ea7475 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:32.313800 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffa5a5-a530-48f2-a11d-620663ea7475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:32.314071 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffa5a5-a530-48f2-a11d-620663ea7475 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:32.314701 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ffa5a5-a530-48f2-a11d-620663ea7475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:32.316578 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ffa5a5-a530-48f2-a11d-620663ea7475 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:32.344146 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1443/2875] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:31:32 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:31:32.348552 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4af559-f597-4734-b1b1-0ca45a517811 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:32.358546 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4af559-f597-4734-b1b1-0ca45a517811 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:32.414263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445e41-4595-4e4c-b001-b392bed0d540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:32.414865 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445e41-4595-4e4c-b001-b392bed0d540 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:32.415147 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445e41-4595-4e4c-b001-b392bed0d540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:32.415446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445e41-4595-4e4c-b001-b392bed0d540 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:32.416108 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28445e41-4595-4e4c-b001-b392bed0d540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:32.418060 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28445e41-4595-4e4c-b001-b392bed0d540 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:32.439890 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1433/2876] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:31:32 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:31:32.444083 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffa5a5-a530-48f2-a11d-620663ea7475 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:32.455065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffa5a5-a530-48f2-a11d-620663ea7475 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:32.459708 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42931f52-0edc-4ff2-b656-569051d59672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:32.460328 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42931f52-0edc-4ff2-b656-569051d59672 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:32.460612 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42931f52-0edc-4ff2-b656-569051d59672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:32.460884 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42931f52-0edc-4ff2-b656-569051d59672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:32.461537 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42931f52-0edc-4ff2-b656-569051d59672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:32.463141 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42931f52-0edc-4ff2-b656-569051d59672 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:32.474139 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1444/2877] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:31:32.477947 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445e41-4595-4e4c-b001-b392bed0d540 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:32.483122 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:31:32.490066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445e41-4595-4e4c-b001-b392bed0d540 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:32.495937 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acb9a0-3e61-4373-8919-d475fbf34e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:32.496534 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acb9a0-3e61-4373-8919-d475fbf34e91 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:32.496819 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acb9a0-3e61-4373-8919-d475fbf34e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:32.497101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acb9a0-3e61-4373-8919-d475fbf34e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:32.497806 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acb9a0-3e61-4373-8919-d475fbf34e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:32.499395 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acb9a0-3e61-4373-8919-d475fbf34e91 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:32.510197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1434/2878] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:31:32.514807 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42931f52-0edc-4ff2-b656-569051d59672 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:32.524823 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42931f52-0edc-4ff2-b656-569051d59672 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:32.530026 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610a2ca-797d-4394-a04a-097c481a3fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:32.530686 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610a2ca-797d-4394-a04a-097c481a3fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:32.530945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610a2ca-797d-4394-a04a-097c481a3fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:32.531217 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610a2ca-797d-4394-a04a-097c481a3fbb admin admin] PATH_INFO: `/v3/projects/2951044f8dbe43b1af4ae86233da984c/users/e0882b6615f8405b928bbca0f0d7c359/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:32.545655 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610a2ca-797d-4394-a04a-097c481a3fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2951044f8dbe43b1af4ae86233da984c, user_id=e0882b6615f8405b928bbca0f0d7c359, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:32.548415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610a2ca-797d-4394-a04a-097c481a3fbb admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:32.561559 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1445/2879] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:31:32 2022] PUT /identity/v3/projects/2951044f8dbe43b1af4ae86233da984c/users/e0882b6615f8405b928bbca0f0d7c359/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:31:32.566518 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d040ba-c56d-4471-9e36-e8437c434028 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:32.566831 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d040ba-c56d-4471-9e36-e8437c434028 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:32.567111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d040ba-c56d-4471-9e36-e8437c434028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:32.586266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a5d040ba-c56d-4471-9e36-e8437c434028 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:31:32.587462 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a5d040ba-c56d-4471-9e36-e8437c434028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:32.647101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1435/2880] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:31:32.656618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610a2ca-797d-4394-a04a-097c481a3fbb admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:32.658406 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1610a2ca-797d-4394-a04a-097c481a3fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:32.663718 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:31:32.730435 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610a2ca-797d-4394-a04a-097c481a3fbb admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:32.738001 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e5815-93ca-4376-93a1-9d96baddaf8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:32.738603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e5815-93ca-4376-93a1-9d96baddaf8a service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:32.738886 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e5815-93ca-4376-93a1-9d96baddaf8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:32.739160 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e5815-93ca-4376-93a1-9d96baddaf8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:32.748596 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e5815-93ca-4376-93a1-9d96baddaf8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:32.750049 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e5815-93ca-4376-93a1-9d96baddaf8a service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:32.759400 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1446/2881] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:31:33.382893 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944bb80-e159-4eca-aeed-0c056d5c5f3d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:33.383466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944bb80-e159-4eca-aeed-0c056d5c5f3d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:33.383466 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944bb80-e159-4eca-aeed-0c056d5c5f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:33.412744 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3944bb80-e159-4eca-aeed-0c056d5c5f3d None None] MFA Rules not processed for user `e0882b6615f8405b928bbca0f0d7c359`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:31:33.417980 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3944bb80-e159-4eca-aeed-0c056d5c5f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:33.484680 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1436/2882] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:31:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:31:33.496024 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e5815-93ca-4376-93a1-9d96baddaf8a service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:33.497413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-550e5815-93ca-4376-93a1-9d96baddaf8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:33.554462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e5815-93ca-4376-93a1-9d96baddaf8a service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:33.558038 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420520f-c9ff-4425-b5a4-3e01ec4ab3f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:33.558640 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420520f-c9ff-4425-b5a4-3e01ec4ab3f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:33.558915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420520f-c9ff-4425-b5a4-3e01ec4ab3f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:33.559184 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420520f-c9ff-4425-b5a4-3e01ec4ab3f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:33.567848 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420520f-c9ff-4425-b5a4-3e01ec4ab3f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:33.569252 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420520f-c9ff-4425-b5a4-3e01ec4ab3f5 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:33.578197 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1447/2883] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:31:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:31:34.930647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc3f9f-f66a-4a2e-ab4a-1e76a739a4e3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:34.931148 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc3f9f-f66a-4a2e-ab4a-1e76a739a4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:34.931263 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc3f9f-f66a-4a2e-ab4a-1e76a739a4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:34.949999 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-67bc3f9f-f66a-4a2e-ab4a-1e76a739a4e3 None None] MFA Rules not processed for user `e0882b6615f8405b928bbca0f0d7c359`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:31:34.951300 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-67bc3f9f-f66a-4a2e-ab4a-1e76a739a4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:34.958282 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1437/2884] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:31:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:31:42.329366 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420520f-c9ff-4425-b5a4-3e01ec4ab3f5 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:31:42.330838 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6420520f-c9ff-4425-b5a4-3e01ec4ab3f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:42.420117 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420520f-c9ff-4425-b5a4-3e01ec4ab3f5 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:31:42.425282 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee3691-6074-4115-8403-ef7a1f347b16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cedb97f3c84faeaeef2b3209356842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:31:42.425924 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee3691-6074-4115-8403-ef7a1f347b16 service placement] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:42.426845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee3691-6074-4115-8403-ef7a1f347b16 service placement] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:42.426845 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee3691-6074-4115-8403-ef7a1f347b16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:42.428253 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-82ee3691-6074-4115-8403-ef7a1f347b16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:42.440970 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee3691-6074-4115-8403-ef7a1f347b16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:31:42.442586 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee3691-6074-4115-8403-ef7a1f347b16 service placement] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:31:42.453637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1448/2885] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:31:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:31:44.944580 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=66 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:31:48.135694 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c31c49-053e-4e3c-9885-7925312a37de None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:31:48.136341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c31c49-053e-4e3c-9885-7925312a37de None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:31:48.136341 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c31c49-053e-4e3c-9885-7925312a37de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:31:48.154823 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-75c31c49-053e-4e3c-9885-7925312a37de None None] MFA Rules not processed for user `e0882b6615f8405b928bbca0f0d7c359`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:31:48.156056 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-75c31c49-053e-4e3c-9885-7925312a37de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:31:48.162836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1438/2886] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:31:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:31:52.448168 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:31:58.149553 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:02.550667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349e347-38a3-4e6c-97ae-9ea8c8636678 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:02.551176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349e347-38a3-4e6c-97ae-9ea8c8636678 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:02.551282 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349e347-38a3-4e6c-97ae-9ea8c8636678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:02.580552 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8349e347-38a3-4e6c-97ae-9ea8c8636678 None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:32:02.581801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8349e347-38a3-4e6c-97ae-9ea8c8636678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:02.643642 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1449/2887] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Sep 27 17:32:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:32:02.690832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c31c49-053e-4e3c-9885-7925312a37de None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:02.692219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-75c31c49-053e-4e3c-9885-7925312a37de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:02.765503 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c31c49-053e-4e3c-9885-7925312a37de None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:02.770794 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffff55e-9304-4762-b6a6-4b82704015d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:02.771402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffff55e-9304-4762-b6a6-4b82704015d4 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:02.771683 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffff55e-9304-4762-b6a6-4b82704015d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:02.771956 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffff55e-9304-4762-b6a6-4b82704015d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:02.780201 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffff55e-9304-4762-b6a6-4b82704015d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:02.782498 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffff55e-9304-4762-b6a6-4b82704015d4 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:02.790407 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1439/2888] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:32:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 17:32:12.637568 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=32 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:12.787460 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=32 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:17.311800 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e9d74-593d-42a5-974e-deedf9849a70 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:17.312265 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e9d74-593d-42a5-974e-deedf9849a70 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:17.312368 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e9d74-593d-42a5-974e-deedf9849a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:17.332105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b12e9d74-593d-42a5-974e-deedf9849a70 None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:32:17.333298 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b12e9d74-593d-42a5-974e-deedf9849a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:17.340370 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1450/2889] 10.222.0.57 () {58 vars in 967 bytes} [Tue Sep 27 17:32:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:32:17.353484 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffff55e-9304-4762-b6a6-4b82704015d4 service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:17.364268 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffff55e-9304-4762-b6a6-4b82704015d4 service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:17.369208 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d23247-1008-4c98-954c-cf92f1510d39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:17.369830 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d23247-1008-4c98-954c-cf92f1510d39 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:17.370112 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d23247-1008-4c98-954c-cf92f1510d39 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:17.370383 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d23247-1008-4c98-954c-cf92f1510d39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:17.378301 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d23247-1008-4c98-954c-cf92f1510d39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:17.379853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d23247-1008-4c98-954c-cf92f1510d39 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:17.387720 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1440/2890] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:32:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 17:32:19.300625 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e9d74-593d-42a5-974e-deedf9849a70 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:19.312072 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e9d74-593d-42a5-974e-deedf9849a70 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:19.317261 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc201cb-8199-46e9-85c8-ed59029feae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:19.318096 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc201cb-8199-46e9-85c8-ed59029feae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:19.318381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc201cb-8199-46e9-85c8-ed59029feae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:19.318655 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc201cb-8199-46e9-85c8-ed59029feae7 admin admin] PATH_INFO: `/v3/users/e0882b6615f8405b928bbca0f0d7c359` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:19.319898 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc201cb-8199-46e9-85c8-ed59029feae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0882b6615f8405b928bbca0f0d7c359)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:19.321671 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc201cb-8199-46e9-85c8-ed59029feae7 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:19.369176 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6bc201cb-8199-46e9-85c8-ed59029feae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0882b6615f8405b928bbca0f0d7c359'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:19.369867 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6bc201cb-8199-46e9-85c8-ed59029feae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0882b6615f8405b928bbca0f0d7c359'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:19.378357 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6bc201cb-8199-46e9-85c8-ed59029feae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0882b6615f8405b928bbca0f0d7c359'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:19.390108 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6bc201cb-8199-46e9-85c8-ed59029feae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0882b6615f8405b928bbca0f0d7c359'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:19.397637 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6bc201cb-8199-46e9-85c8-ed59029feae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0882b6615f8405b928bbca0f0d7c359'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:19.403399 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1451/2891] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:32:19 2022] DELETE /identity/v3/users/e0882b6615f8405b928bbca0f0d7c359 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:32:19.574625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d23247-1008-4c98-954c-cf92f1510d39 service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:19.585661 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d23247-1008-4c98-954c-cf92f1510d39 service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:19.644191 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a4d56-5daf-4915-a51c-1bd372910371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:19.644848 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a4d56-5daf-4915-a51c-1bd372910371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:19.645128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a4d56-5daf-4915-a51c-1bd372910371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:19.645402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a4d56-5daf-4915-a51c-1bd372910371 admin admin] PATH_INFO: `/v3/projects/2951044f8dbe43b1af4ae86233da984c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:19.646693 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a4d56-5daf-4915-a51c-1bd372910371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2951044f8dbe43b1af4ae86233da984c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:19.648649 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a4d56-5daf-4915-a51c-1bd372910371 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:19.694175 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-194a4d56-5daf-4915-a51c-1bd372910371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2951044f8dbe43b1af4ae86233da984c', 'request_id': 'req-194a4d56-5daf-4915-a51c-1bd372910371'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:19.699672 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-194a4d56-5daf-4915-a51c-1bd372910371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2951044f8dbe43b1af4ae86233da984c', 'request_id': 'req-194a4d56-5daf-4915-a51c-1bd372910371'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:19.706227 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-194a4d56-5daf-4915-a51c-1bd372910371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2951044f8dbe43b1af4ae86233da984c', 'request_id': 'req-194a4d56-5daf-4915-a51c-1bd372910371'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:19.718437 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-194a4d56-5daf-4915-a51c-1bd372910371 admin admin] The token cache is being invalidate because project 2951044f8dbe43b1af4ae86233da984c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:32:19.718721 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-194a4d56-5daf-4915-a51c-1bd372910371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:19.719351 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-194a4d56-5daf-4915-a51c-1bd372910371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:19.721403 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1441/2892] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:32:19 2022] DELETE /identity/v3/projects/2951044f8dbe43b1af4ae86233da984c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:32:19.726446 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f002e-e0a0-49d3-8112-095f6f83fd01 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:19.726737 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f002e-e0a0-49d3-8112-095f6f83fd01 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:19.727015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f002e-e0a0-49d3-8112-095f6f83fd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:19.746381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ed5f002e-e0a0-49d3-8112-095f6f83fd01 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:32:19.747578 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ed5f002e-e0a0-49d3-8112-095f6f83fd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:19.806224 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1452/2893] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:32:19.814368 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd70b8b-4d84-482b-9dc9-d1b03e90a16e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:19.814813 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd70b8b-4d84-482b-9dc9-d1b03e90a16e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:19.815088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd70b8b-4d84-482b-9dc9-d1b03e90a16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:19.834993 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8fd70b8b-4d84-482b-9dc9-d1b03e90a16e None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:32:19.836121 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8fd70b8b-4d84-482b-9dc9-d1b03e90a16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:19.844146 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1442/2894] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:32:19.848345 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f002e-e0a0-49d3-8112-095f6f83fd01 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:19.858261 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f002e-e0a0-49d3-8112-095f6f83fd01 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:19.862924 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1792ab3-69e3-4f2f-89dd-16ecf77fb12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:19.863520 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1792ab3-69e3-4f2f-89dd-16ecf77fb12e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:19.863801 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1792ab3-69e3-4f2f-89dd-16ecf77fb12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:19.864071 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1792ab3-69e3-4f2f-89dd-16ecf77fb12e admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:19.864709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1792ab3-69e3-4f2f-89dd-16ecf77fb12e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:32:19.865014 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1792ab3-69e3-4f2f-89dd-16ecf77fb12e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:19.866627 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1792ab3-69e3-4f2f-89dd-16ecf77fb12e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:19.878653 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1453/2895] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:32:19.882836 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd70b8b-4d84-482b-9dc9-d1b03e90a16e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:19.892024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd70b8b-4d84-482b-9dc9-d1b03e90a16e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:19.897186 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d415aa-45de-4511-abaa-3db265fb17f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:19.897812 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d415aa-45de-4511-abaa-3db265fb17f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:19.898093 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d415aa-45de-4511-abaa-3db265fb17f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:19.898365 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d415aa-45de-4511-abaa-3db265fb17f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:19.898988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d415aa-45de-4511-abaa-3db265fb17f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:19.900907 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d415aa-45de-4511-abaa-3db265fb17f6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:19.927512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1443/2896] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:32:19 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:32:19.931827 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1792ab3-69e3-4f2f-89dd-16ecf77fb12e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:19.942448 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1792ab3-69e3-4f2f-89dd-16ecf77fb12e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:19.989922 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:20.000674 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4073f-5bc2-4128-bafc-e32cf5914642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:20.001805 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4073f-5bc2-4128-bafc-e32cf5914642 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:20.002102 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4073f-5bc2-4128-bafc-e32cf5914642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:20.002376 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4073f-5bc2-4128-bafc-e32cf5914642 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:20.003017 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4073f-5bc2-4128-bafc-e32cf5914642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:20.004905 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4073f-5bc2-4128-bafc-e32cf5914642 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:20.025866 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1454/2897] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:32:19 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:32:20.030115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d415aa-45de-4511-abaa-3db265fb17f6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:20.041052 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d415aa-45de-4511-abaa-3db265fb17f6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:20.045677 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0df1a7-4d6b-44d2-a3d9-0a9e2f4e3d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:20.046297 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0df1a7-4d6b-44d2-a3d9-0a9e2f4e3d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:20.046580 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0df1a7-4d6b-44d2-a3d9-0a9e2f4e3d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:20.046855 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0df1a7-4d6b-44d2-a3d9-0a9e2f4e3d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:20.047499 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0df1a7-4d6b-44d2-a3d9-0a9e2f4e3d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:20.049805 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0df1a7-4d6b-44d2-a3d9-0a9e2f4e3d39 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:20.059611 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1444/2898] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:32:20.063610 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4073f-5bc2-4128-bafc-e32cf5914642 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:20.073612 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4073f-5bc2-4128-bafc-e32cf5914642 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:20.079514 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e9eee-aa32-4db4-a2f3-cc4287cbf9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:20.080391 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e9eee-aa32-4db4-a2f3-cc4287cbf9fa admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:20.080673 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e9eee-aa32-4db4-a2f3-cc4287cbf9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:20.080948 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e9eee-aa32-4db4-a2f3-cc4287cbf9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:20.081577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e9eee-aa32-4db4-a2f3-cc4287cbf9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:20.083191 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e9eee-aa32-4db4-a2f3-cc4287cbf9fa admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:20.093921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1455/2899] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:32:20.098776 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0df1a7-4d6b-44d2-a3d9-0a9e2f4e3d39 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:20.108793 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0df1a7-4d6b-44d2-a3d9-0a9e2f4e3d39 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:20.114663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5954f-324c-4f7f-bd25-ddf9624a1880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:20.115309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5954f-324c-4f7f-bd25-ddf9624a1880 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:20.115591 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5954f-324c-4f7f-bd25-ddf9624a1880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:20.115866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5954f-324c-4f7f-bd25-ddf9624a1880 admin admin] PATH_INFO: `/v3/projects/e9ac99aa0a014753b4fb122f15bd9c7a/users/b1739e5f8789489ab519e9798de9b027/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:20.135663 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5954f-324c-4f7f-bd25-ddf9624a1880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ac99aa0a014753b4fb122f15bd9c7a, user_id=b1739e5f8789489ab519e9798de9b027, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:20.138342 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5954f-324c-4f7f-bd25-ddf9624a1880 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:20.152826 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1445/2900] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:32:20 2022] PUT /identity/v3/projects/e9ac99aa0a014753b4fb122f15bd9c7a/users/b1739e5f8789489ab519e9798de9b027/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:32:20.167342 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c67d6-303a-4eca-93ac-00d2d97a5a82 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:20.167630 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c67d6-303a-4eca-93ac-00d2d97a5a82 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:20.167907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c67d6-303a-4eca-93ac-00d2d97a5a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:20.196461 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6b4c67d6-303a-4eca-93ac-00d2d97a5a82 None None] MFA Rules not processed for user `b1739e5f8789489ab519e9798de9b027`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:32:20.197664 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6b4c67d6-303a-4eca-93ac-00d2d97a5a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:20.261237 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1456/2901] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:32:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:32:20.273102 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5954f-324c-4f7f-bd25-ddf9624a1880 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:20.274898 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fff5954f-324c-4f7f-bd25-ddf9624a1880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:20.293207 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:20.355194 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5954f-324c-4f7f-bd25-ddf9624a1880 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:20.358810 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0c1d6-a3fc-4002-b319-8feb98256c75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c57bac4e0f54d2596fe1fda9a7dfc76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:20.359410 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0c1d6-a3fc-4002-b319-8feb98256c75 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:20.359691 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0c1d6-a3fc-4002-b319-8feb98256c75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:20.359961 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0c1d6-a3fc-4002-b319-8feb98256c75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:20.368237 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0c1d6-a3fc-4002-b319-8feb98256c75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:20.369678 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0c1d6-a3fc-4002-b319-8feb98256c75 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:20.378876 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1446/2902] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:32:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:32:20.403811 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c67d6-303a-4eca-93ac-00d2d97a5a82 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:20.474249 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c67d6-303a-4eca-93ac-00d2d97a5a82 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:20.478816 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69239e0-9cfa-4622-aed7-7ab82efeb4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:20.479441 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69239e0-9cfa-4622-aed7-7ab82efeb4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:20.479742 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69239e0-9cfa-4622-aed7-7ab82efeb4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:20.480015 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69239e0-9cfa-4622-aed7-7ab82efeb4d5 admin admin] PATH_INFO: `/v3/users/b1739e5f8789489ab519e9798de9b027` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:20.481137 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69239e0-9cfa-4622-aed7-7ab82efeb4d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1739e5f8789489ab519e9798de9b027)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:20.483080 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69239e0-9cfa-4622-aed7-7ab82efeb4d5 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:20.528707 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a69239e0-9cfa-4622-aed7-7ab82efeb4d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1739e5f8789489ab519e9798de9b027'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:20.529348 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a69239e0-9cfa-4622-aed7-7ab82efeb4d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1739e5f8789489ab519e9798de9b027'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:20.537446 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a69239e0-9cfa-4622-aed7-7ab82efeb4d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1739e5f8789489ab519e9798de9b027'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:20.544895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:20.550924 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a69239e0-9cfa-4622-aed7-7ab82efeb4d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1739e5f8789489ab519e9798de9b027'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:20.558625 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a69239e0-9cfa-4622-aed7-7ab82efeb4d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1739e5f8789489ab519e9798de9b027'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:20.564945 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1457/2903] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:32:20 2022] DELETE /identity/v3/users/b1739e5f8789489ab519e9798de9b027 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:32:20.569440 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5fd3-723f-42d2-b45f-d44768fc2c7c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:20.569759 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5fd3-723f-42d2-b45f-d44768fc2c7c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:20.570035 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b5fd3-723f-42d2-b45f-d44768fc2c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:20.589232 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5a7b5fd3-723f-42d2-b45f-d44768fc2c7c None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:32:20.590454 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5a7b5fd3-723f-42d2-b45f-d44768fc2c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:20.648625 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1447/2904] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:32:20.658555 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69239e0-9cfa-4622-aed7-7ab82efeb4d5 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:20.660016 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a69239e0-9cfa-4622-aed7-7ab82efeb4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:20.737543 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69239e0-9cfa-4622-aed7-7ab82efeb4d5 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:20.741346 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2001e-760a-44e4-a785-ad761980a98e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:20.741983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2001e-760a-44e4-a785-ad761980a98e service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:20.742261 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2001e-760a-44e4-a785-ad761980a98e service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:20.742533 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2001e-760a-44e4-a785-ad761980a98e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:20.751887 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2001e-760a-44e4-a785-ad761980a98e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:20.753454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2001e-760a-44e4-a785-ad761980a98e service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:20.762756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1458/2905] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:32:21.029522 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b5fd3-723f-42d2-b45f-d44768fc2c7c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:21.030998 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5a7b5fd3-723f-42d2-b45f-d44768fc2c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:21.044034 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b5fd3-723f-42d2-b45f-d44768fc2c7c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:21.049824 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af35ba-dd10-4882-b9a5-07caff9696f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:21.050581 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af35ba-dd10-4882-b9a5-07caff9696f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:21.050956 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af35ba-dd10-4882-b9a5-07caff9696f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:21.051235 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af35ba-dd10-4882-b9a5-07caff9696f1 admin admin] PATH_INFO: `/v3/projects/e9ac99aa0a014753b4fb122f15bd9c7a` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:21.052513 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af35ba-dd10-4882-b9a5-07caff9696f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ac99aa0a014753b4fb122f15bd9c7a)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:21.054779 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af35ba-dd10-4882-b9a5-07caff9696f1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:21.103118 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-84af35ba-dd10-4882-b9a5-07caff9696f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ac99aa0a014753b4fb122f15bd9c7a', 'request_id': 'req-84af35ba-dd10-4882-b9a5-07caff9696f1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:21.108515 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-84af35ba-dd10-4882-b9a5-07caff9696f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ac99aa0a014753b4fb122f15bd9c7a', 'request_id': 'req-84af35ba-dd10-4882-b9a5-07caff9696f1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:21.115420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-84af35ba-dd10-4882-b9a5-07caff9696f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ac99aa0a014753b4fb122f15bd9c7a', 'request_id': 'req-84af35ba-dd10-4882-b9a5-07caff9696f1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:21.127567 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-84af35ba-dd10-4882-b9a5-07caff9696f1 admin admin] The token cache is being invalidate because project e9ac99aa0a014753b4fb122f15bd9c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:32:21.127862 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-84af35ba-dd10-4882-b9a5-07caff9696f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:21.128491 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-84af35ba-dd10-4882-b9a5-07caff9696f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:32:21.130095 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1448/2906] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:32:21 2022] DELETE /identity/v3/projects/e9ac99aa0a014753b4fb122f15bd9c7a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:32:21.135757 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075796b-3bc2-4494-aa93-ffe79ab5b4ff None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:21.136039 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075796b-3bc2-4494-aa93-ffe79ab5b4ff None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:21.136309 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075796b-3bc2-4494-aa93-ffe79ab5b4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:21.156419 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e075796b-3bc2-4494-aa93-ffe79ab5b4ff None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:32:21.157601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e075796b-3bc2-4494-aa93-ffe79ab5b4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:21.216604 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1459/2907] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:32:21.226495 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c360a-6f5a-463f-b09d-3752627cf5dc None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:21.226783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c360a-6f5a-463f-b09d-3752627cf5dc None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:21.227060 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c360a-6f5a-463f-b09d-3752627cf5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:21.246500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b49c360a-6f5a-463f-b09d-3752627cf5dc None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:32:21.247719 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b49c360a-6f5a-463f-b09d-3752627cf5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:21.256832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1449/2908] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:32:21.261254 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075796b-3bc2-4494-aa93-ffe79ab5b4ff None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:21.271416 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075796b-3bc2-4494-aa93-ffe79ab5b4ff None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:21.276006 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d44f03-1527-4f2f-a5e4-6c8ff86a5dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:21.276601 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d44f03-1527-4f2f-a5e4-6c8ff86a5dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:21.276883 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d44f03-1527-4f2f-a5e4-6c8ff86a5dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:21.277158 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d44f03-1527-4f2f-a5e4-6c8ff86a5dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:21.277826 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d44f03-1527-4f2f-a5e4-6c8ff86a5dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 17:32:21.278133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d44f03-1527-4f2f-a5e4-6c8ff86a5dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:21.279709 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d44f03-1527-4f2f-a5e4-6c8ff86a5dd9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:21.291295 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1460/2909] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Sep 27 17:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 17:32:21.295402 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c360a-6f5a-463f-b09d-3752627cf5dc None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:21.305013 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c360a-6f5a-463f-b09d-3752627cf5dc None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:21.309538 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09348cc-9d59-4f7c-80a0-78d22a2e6eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:21.310154 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09348cc-9d59-4f7c-80a0-78d22a2e6eac admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:21.310429 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09348cc-9d59-4f7c-80a0-78d22a2e6eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:21.310697 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09348cc-9d59-4f7c-80a0-78d22a2e6eac admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:21.311313 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09348cc-9d59-4f7c-80a0-78d22a2e6eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:21.313173 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09348cc-9d59-4f7c-80a0-78d22a2e6eac admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:21.324772 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:21.342910 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1450/2910] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:32:21 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:32:21.347749 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d44f03-1527-4f2f-a5e4-6c8ff86a5dd9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:21.357603 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d44f03-1527-4f2f-a5e4-6c8ff86a5dd9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:21.403618 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:21.415516 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed2a3f-0d49-4c7d-9ba8-013d1a444b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:21.416159 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed2a3f-0d49-4c7d-9ba8-013d1a444b2d admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:21.416323 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed2a3f-0d49-4c7d-9ba8-013d1a444b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:21.416593 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed2a3f-0d49-4c7d-9ba8-013d1a444b2d admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:21.417247 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed2a3f-0d49-4c7d-9ba8-013d1a444b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:21.419170 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed2a3f-0d49-4c7d-9ba8-013d1a444b2d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:21.440954 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1461/2911] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:32:21 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 17:32:21.445038 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09348cc-9d59-4f7c-80a0-78d22a2e6eac admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:21.455521 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09348cc-9d59-4f7c-80a0-78d22a2e6eac admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:21.460051 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80af8bb-aa12-4bd7-a4d7-d0562a5f7a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:21.460646 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80af8bb-aa12-4bd7-a4d7-d0562a5f7a63 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:21.460923 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80af8bb-aa12-4bd7-a4d7-d0562a5f7a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:21.461195 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80af8bb-aa12-4bd7-a4d7-d0562a5f7a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:21.461866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80af8bb-aa12-4bd7-a4d7-d0562a5f7a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:21.463460 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80af8bb-aa12-4bd7-a4d7-d0562a5f7a63 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:21.474048 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1451/2912] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:32:21.477833 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed2a3f-0d49-4c7d-9ba8-013d1a444b2d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:21.487966 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed2a3f-0d49-4c7d-9ba8-013d1a444b2d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:21.492484 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60facaca-787a-4f84-854a-4f52a36f102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:21.493066 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60facaca-787a-4f84-854a-4f52a36f102e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:21.493341 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60facaca-787a-4f84-854a-4f52a36f102e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:21.493611 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60facaca-787a-4f84-854a-4f52a36f102e admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:21.494268 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60facaca-787a-4f84-854a-4f52a36f102e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:21.495830 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60facaca-787a-4f84-854a-4f52a36f102e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:21.506919 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1462/2913] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:32:21.510866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80af8bb-aa12-4bd7-a4d7-d0562a5f7a63 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:21.521414 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80af8bb-aa12-4bd7-a4d7-d0562a5f7a63 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:21.526016 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9835fbf-c2f7-4520-a5d0-7f434492b6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:21.526647 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9835fbf-c2f7-4520-a5d0-7f434492b6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:21.526928 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9835fbf-c2f7-4520-a5d0-7f434492b6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:21.527200 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9835fbf-c2f7-4520-a5d0-7f434492b6fc admin admin] PATH_INFO: `/v3/projects/45c2605f6e4f4fe383b4ade1a056b98d/users/1835675414e74887b0c9ab715c2c56cf/roles/1c0bdbdf6a98487cac86e3de530b11d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:21.542457 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9835fbf-c2f7-4520-a5d0-7f434492b6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c2605f6e4f4fe383b4ade1a056b98d, user_id=1835675414e74887b0c9ab715c2c56cf, role_id=1c0bdbdf6a98487cac86e3de530b11d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:21.545071 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9835fbf-c2f7-4520-a5d0-7f434492b6fc admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:21.557840 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1452/2914] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:32:21 2022] PUT /identity/v3/projects/45c2605f6e4f4fe383b4ade1a056b98d/users/1835675414e74887b0c9ab715c2c56cf/roles/1c0bdbdf6a98487cac86e3de530b11d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:32:21.563077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed9f60-9e52-4cec-abf2-58f4f3f54843 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:21.563364 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed9f60-9e52-4cec-abf2-58f4f3f54843 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:21.563641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed9f60-9e52-4cec-abf2-58f4f3f54843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:21.584169 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-19ed9f60-9e52-4cec-abf2-58f4f3f54843 None None] MFA Rules not processed for user `100c1706b8bd4a93b5f2764550817d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:32:21.585377 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-19ed9f60-9e52-4cec-abf2-58f4f3f54843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:21.644778 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1463/2915] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:32:21.654430 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9835fbf-c2f7-4520-a5d0-7f434492b6fc admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:21.656159 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a9835fbf-c2f7-4520-a5d0-7f434492b6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:21.833486 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9835fbf-c2f7-4520-a5d0-7f434492b6fc admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:21.837225 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5c5a4-1aa9-420e-9d76-ca42b575114b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:21.837985 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5c5a4-1aa9-420e-9d76-ca42b575114b service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:21.838334 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5c5a4-1aa9-420e-9d76-ca42b575114b service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:21.838601 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5c5a4-1aa9-420e-9d76-ca42b575114b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:21.848306 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5c5a4-1aa9-420e-9d76-ca42b575114b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:21.849713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5c5a4-1aa9-420e-9d76-ca42b575114b service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:21.859984 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1453/2916] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:32:26.103120 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413055b6-ad43-435c-b034-6c4d57c8ca21 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:26.103969 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413055b6-ad43-435c-b034-6c4d57c8ca21 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:26.104248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413055b6-ad43-435c-b034-6c4d57c8ca21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:26.135462 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-413055b6-ad43-435c-b034-6c4d57c8ca21 None None] MFA Rules not processed for user `1835675414e74887b0c9ab715c2c56cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:32:26.136699 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-413055b6-ad43-435c-b034-6c4d57c8ca21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:26.206691 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1464/2917] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:32:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:32:26.211026 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5c5a4-1aa9-420e-9d76-ca42b575114b service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:26.222368 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5c5a4-1aa9-420e-9d76-ca42b575114b service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:26.227415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dbc30-dd29-4fe1-a355-12f3f602d6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:26.228096 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dbc30-dd29-4fe1-a355-12f3f602d6ff admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:26.228446 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dbc30-dd29-4fe1-a355-12f3f602d6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:26.228787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dbc30-dd29-4fe1-a355-12f3f602d6ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:26.229579 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dbc30-dd29-4fe1-a355-12f3f602d6ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:26.231607 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dbc30-dd29-4fe1-a355-12f3f602d6ff admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:26.264834 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1454/2918] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Sep 27 17:32:26 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:32:26.265817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413055b6-ad43-435c-b034-6c4d57c8ca21 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:26.278037 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413055b6-ad43-435c-b034-6c4d57c8ca21 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:26.340953 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b6821-06e8-4c2f-b993-882366374cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:26.341573 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b6821-06e8-4c2f-b993-882366374cdf admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:26.341926 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b6821-06e8-4c2f-b993-882366374cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:26.342202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b6821-06e8-4c2f-b993-882366374cdf admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:26.342835 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b6821-06e8-4c2f-b993-882366374cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:26.345790 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b6821-06e8-4c2f-b993-882366374cdf admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:26.355175 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:26.369912 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1465/2919] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Sep 27 17:32:26 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 17:32:26.373303 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dbc30-dd29-4fe1-a355-12f3f602d6ff admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:26.384250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dbc30-dd29-4fe1-a355-12f3f602d6ff admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:26.388867 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5107f-9d48-41fe-98c4-ad6b58e2eef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:26.389468 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5107f-9d48-41fe-98c4-ad6b58e2eef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:26.389783 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5107f-9d48-41fe-98c4-ad6b58e2eef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:26.390052 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5107f-9d48-41fe-98c4-ad6b58e2eef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:26.390788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5107f-9d48-41fe-98c4-ad6b58e2eef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:26.392906 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5107f-9d48-41fe-98c4-ad6b58e2eef9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:26.405727 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1455/2920] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:32:26.408210 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b6821-06e8-4c2f-b993-882366374cdf admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:26.418989 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b6821-06e8-4c2f-b993-882366374cdf admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:26.424715 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e8142-e98c-49e1-b68f-382b51b684d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:26.425415 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e8142-e98c-49e1-b68f-382b51b684d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:26.425714 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e8142-e98c-49e1-b68f-382b51b684d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:26.425993 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e8142-e98c-49e1-b68f-382b51b684d1 admin admin] PATH_INFO: `/v3/projects/6caa5b17f1f64bb69b90217d9c58c640/users/c1771d9936e44fbabf5cabeca6f1b64b/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:26.442712 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e8142-e98c-49e1-b68f-382b51b684d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6caa5b17f1f64bb69b90217d9c58c640, user_id=c1771d9936e44fbabf5cabeca6f1b64b, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:26.445523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e8142-e98c-49e1-b68f-382b51b684d1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:26.460130 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1466/2921] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:32:26 2022] PUT /identity/v3/projects/6caa5b17f1f64bb69b90217d9c58c640/users/c1771d9936e44fbabf5cabeca6f1b64b/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:32:26.464132 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5107f-9d48-41fe-98c4-ad6b58e2eef9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:26.475500 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5107f-9d48-41fe-98c4-ad6b58e2eef9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:26.538969 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c60bb-6e65-410b-bb15-a1da1b680dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:26.539576 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c60bb-6e65-410b-bb15-a1da1b680dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:26.539851 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c60bb-6e65-410b-bb15-a1da1b680dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:26.540119 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c60bb-6e65-410b-bb15-a1da1b680dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:26.540750 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c60bb-6e65-410b-bb15-a1da1b680dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:26.542394 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c60bb-6e65-410b-bb15-a1da1b680dc0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:26.555825 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1456/2922] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Sep 27 17:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 17:32:26.557142 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e8142-e98c-49e1-b68f-382b51b684d1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:26.570004 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e8142-e98c-49e1-b68f-382b51b684d1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:26.575463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ef288-c2e8-4ab8-81d1-d9290eccf0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:26.576229 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ef288-c2e8-4ab8-81d1-d9290eccf0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:26.576576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ef288-c2e8-4ab8-81d1-d9290eccf0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:26.576915 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ef288-c2e8-4ab8-81d1-d9290eccf0ae admin admin] PATH_INFO: `/v3/projects/6caa5b17f1f64bb69b90217d9c58c640/users/c1771d9936e44fbabf5cabeca6f1b64b/roles/61601bc0091b4afbb0dab99f8aef9d78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:26.579052 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ef288-c2e8-4ab8-81d1-d9290eccf0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6caa5b17f1f64bb69b90217d9c58c640, user_id=c1771d9936e44fbabf5cabeca6f1b64b, role_id=61601bc0091b4afbb0dab99f8aef9d78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:26.582748 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ef288-c2e8-4ab8-81d1-d9290eccf0ae admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:26.595074 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1467/2923] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Sep 27 17:32:26 2022] PUT /identity/v3/projects/6caa5b17f1f64bb69b90217d9c58c640/users/c1771d9936e44fbabf5cabeca6f1b64b/roles/61601bc0091b4afbb0dab99f8aef9d78 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:32:31.148068 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928209e3-9917-464a-aec7-ef685662fde0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:31.148526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928209e3-9917-464a-aec7-ef685662fde0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:31.148627 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928209e3-9917-464a-aec7-ef685662fde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:31.179545 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-928209e3-9917-464a-aec7-ef685662fde0 None None] MFA Rules not processed for user `c1771d9936e44fbabf5cabeca6f1b64b`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:32:31.180875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-928209e3-9917-464a-aec7-ef685662fde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:31.190877 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:31.256250 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1457/2924] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:32:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:32:31.269001 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ef288-c2e8-4ab8-81d1-d9290eccf0ae admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:31.270733 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4b9ef288-c2e8-4ab8-81d1-d9290eccf0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:31.332660 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ef288-c2e8-4ab8-81d1-d9290eccf0ae admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:31.336457 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699baa2-990a-447e-8c95-0530999843bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6c4a886aec4dd290b13118e2528fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:31.337077 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699baa2-990a-447e-8c95-0530999843bb service glance] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:31.337662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699baa2-990a-447e-8c95-0530999843bb service glance] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:31.337662 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699baa2-990a-447e-8c95-0530999843bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:31.397732 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699baa2-990a-447e-8c95-0530999843bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:31.399172 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699baa2-990a-447e-8c95-0530999843bb service glance] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:31.408863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1468/2925] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:32:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:32:31.539219 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80880a64-cb09-49e7-99f2-a2c3a672e48c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:31.539590 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80880a64-cb09-49e7-99f2-a2c3a672e48c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:31.539936 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80880a64-cb09-49e7-99f2-a2c3a672e48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:31.559691 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-80880a64-cb09-49e7-99f2-a2c3a672e48c None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:32:31.560857 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-80880a64-cb09-49e7-99f2-a2c3a672e48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:31.615648 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1458/2926] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Sep 27 17:32:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 17:32:31.629721 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699baa2-990a-447e-8c95-0530999843bb service glance] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:31.631125 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f699baa2-990a-447e-8c95-0530999843bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:31.700135 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699baa2-990a-447e-8c95-0530999843bb service glance] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:31.705068 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a324c-621d-405c-8763-c3e1a3308fa5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:31.705667 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a324c-621d-405c-8763-c3e1a3308fa5 service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:31.705976 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a324c-621d-405c-8763-c3e1a3308fa5 service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:31.706250 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a324c-621d-405c-8763-c3e1a3308fa5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:31.712098 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:31.714656 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a324c-621d-405c-8763-c3e1a3308fa5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:31.717339 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a324c-621d-405c-8763-c3e1a3308fa5 service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:31.726652 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1469/2927] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:32:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 27 17:32:40.370797 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20282c2-17d0-45c6-ae64-309b1139bf8d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:40.371285 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20282c2-17d0-45c6-ae64-309b1139bf8d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:40.371399 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20282c2-17d0-45c6-ae64-309b1139bf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:40.391321 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f20282c2-17d0-45c6-ae64-309b1139bf8d None None] MFA Rules not processed for user `1835675414e74887b0c9ab715c2c56cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:32:40.392530 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f20282c2-17d0-45c6-ae64-309b1139bf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:40.399523 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1459/2928] 10.222.0.57 () {58 vars in 958 bytes} [Tue Sep 27 17:32:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:32:41.723576 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:42.306108 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc42e25-90db-4150-b35a-9bb1cd230d7e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:42.307568 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc42e25-90db-4150-b35a-9bb1cd230d7e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:42.308065 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc42e25-90db-4150-b35a-9bb1cd230d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:42.329046 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2dc42e25-90db-4150-b35a-9bb1cd230d7e None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:32:42.330306 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2dc42e25-90db-4150-b35a-9bb1cd230d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:42.338580 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1470/2929] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Sep 27 17:32:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:32:42.352444 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20282c2-17d0-45c6-ae64-309b1139bf8d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:42.365266 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20282c2-17d0-45c6-ae64-309b1139bf8d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:42.371832 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca09c9-62e6-4676-9f77-ce7f6c600490 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:42.372443 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca09c9-62e6-4676-9f77-ce7f6c600490 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:42.372852 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca09c9-62e6-4676-9f77-ce7f6c600490 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:42.373128 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca09c9-62e6-4676-9f77-ce7f6c600490 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:42.382066 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca09c9-62e6-4676-9f77-ce7f6c600490 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:42.383703 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca09c9-62e6-4676-9f77-ce7f6c600490 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:42.392226 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1460/2930] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:32:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 17:32:52.322815 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:52.388866 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=58 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:52.458056 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc42e25-90db-4150-b35a-9bb1cd230d7e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:32:52.459621 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2dc42e25-90db-4150-b35a-9bb1cd230d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:52.585120 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc42e25-90db-4150-b35a-9bb1cd230d7e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:32:52.592076 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab205c3-05f4-4647-86e5-9776a27f2de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75b03fde75e411bace8d406237a7e50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:32:52.592997 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab205c3-05f4-4647-86e5-9776a27f2de4 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:32:52.593278 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab205c3-05f4-4647-86e5-9776a27f2de4 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:32:52.593590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab205c3-05f4-4647-86e5-9776a27f2de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:32:52.595921 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9ab205c3-05f4-4647-86e5-9776a27f2de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:32:52.610590 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab205c3-05f4-4647-86e5-9776a27f2de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:32:52.612166 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab205c3-05f4-4647-86e5-9776a27f2de4 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:32:52.622986 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1471/2931] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:32:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:33:02.618195 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=43 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:33:06.173480 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca09c9-62e6-4676-9f77-ce7f6c600490 service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:33:06.175036 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-37ca09c9-62e6-4676-9f77-ce7f6c600490 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:33:06.232197 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca09c9-62e6-4676-9f77-ce7f6c600490 service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:33:06.236024 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed558820-1736-40a4-b1f8-048fb4ca6c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:33:06.236621 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed558820-1736-40a4-b1f8-048fb4ca6c07 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:33:06.236897 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed558820-1736-40a4-b1f8-048fb4ca6c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:33:06.237165 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed558820-1736-40a4-b1f8-048fb4ca6c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:33:06.246349 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed558820-1736-40a4-b1f8-048fb4ca6c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:33:06.247760 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed558820-1736-40a4-b1f8-048fb4ca6c07 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:33:06.258072 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1461/2932] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:33:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:33:16.254006 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=26 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:33:35.592215 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab205c3-05f4-4647-86e5-9776a27f2de4 service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:33:35.601951 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab205c3-05f4-4647-86e5-9776a27f2de4 service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:33:35.605502 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450bb10-5d65-4161-a841-75b984cd377b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:33:35.606133 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450bb10-5d65-4161-a841-75b984cd377b service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:33:35.606414 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450bb10-5d65-4161-a841-75b984cd377b service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:33:35.606716 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450bb10-5d65-4161-a841-75b984cd377b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:33:35.609138 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b450bb10-5d65-4161-a841-75b984cd377b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:33:35.623078 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450bb10-5d65-4161-a841-75b984cd377b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:33:35.625163 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450bb10-5d65-4161-a841-75b984cd377b service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:33:35.636622 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1472/2933] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:33:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:33:36.835157 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed558820-1736-40a4-b1f8-048fb4ca6c07 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:33:36.846908 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed558820-1736-40a4-b1f8-048fb4ca6c07 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:33:36.852006 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4f6e9-aa6e-4df7-bbab-149fbba6e604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:33:36.852726 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4f6e9-aa6e-4df7-bbab-149fbba6e604 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:33:36.853005 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4f6e9-aa6e-4df7-bbab-149fbba6e604 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:33:36.853359 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4f6e9-aa6e-4df7-bbab-149fbba6e604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:33:36.855271 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-74c4f6e9-aa6e-4df7-bbab-149fbba6e604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:33:36.871643 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4f6e9-aa6e-4df7-bbab-149fbba6e604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:33:36.873148 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4f6e9-aa6e-4df7-bbab-149fbba6e604 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:33:36.885203 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1462/2934] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:33:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:33:45.631310 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=6 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:33:46.880273 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=6 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:19.972973 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450bb10-5d65-4161-a841-75b984cd377b service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:34:19.985731 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450bb10-5d65-4161-a841-75b984cd377b service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:34:19.990521 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa77b1-45cd-458b-bf8f-095fd9a2b7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '008cfc0b27d7448b9c84f8087c969e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:34:19.991343 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa77b1-45cd-458b-bf8f-095fd9a2b7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:34:19.991623 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa77b1-45cd-458b-bf8f-095fd9a2b7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:34:19.991900 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa77b1-45cd-458b-bf8f-095fd9a2b7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:34:19.993851 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ecfa77b1-45cd-458b-bf8f-095fd9a2b7b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:34:20.008454 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa77b1-45cd-458b-bf8f-095fd9a2b7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:34:20.010812 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa77b1-45cd-458b-bf8f-095fd9a2b7b0 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:34:20.023012 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1473/2935] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:34:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:34:27.443600 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653de44-b7b1-42a2-8c98-2c0fb6c5c9cb None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:34:27.444142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653de44-b7b1-42a2-8c98-2c0fb6c5c9cb None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:34:27.444142 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653de44-b7b1-42a2-8c98-2c0fb6c5c9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:34:27.496285 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a653de44-b7b1-42a2-8c98-2c0fb6c5c9cb None None] MFA Rules not processed for user `fa016315ab6f4175974ed15311341e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 17:34:27.497526 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a653de44-b7b1-42a2-8c98-2c0fb6c5c9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:34:27.514547 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1463/2936] 10.222.0.57 () {58 vars in 967 bytes} [Tue Sep 27 17:34:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 17:34:27.560513 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa77b1-45cd-458b-bf8f-095fd9a2b7b0 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:34:27.590523 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa77b1-45cd-458b-bf8f-095fd9a2b7b0 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:34:27.607463 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51271480-f538-4da8-825f-b105d36cf800 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a74ab0288847a7bb8b63756985e509', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:34:27.608096 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51271480-f538-4da8-825f-b105d36cf800 service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:34:27.608381 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51271480-f538-4da8-825f-b105d36cf800 service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:34:27.608654 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51271480-f538-4da8-825f-b105d36cf800 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:34:27.618127 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51271480-f538-4da8-825f-b105d36cf800 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:34:27.619703 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51271480-f538-4da8-825f-b105d36cf800 service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:34:27.627936 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1474/2937] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Sep 27 17:34:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 17:34:31.269951 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653de44-b7b1-42a2-8c98-2c0fb6c5c9cb None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:34:31.272962 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a653de44-b7b1-42a2-8c98-2c0fb6c5c9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:34:31.292894 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51271480-f538-4da8-825f-b105d36cf800 service swift] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:34:31.294206 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-51271480-f538-4da8-825f-b105d36cf800 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:34:31.445411 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51271480-f538-4da8-825f-b105d36cf800 service swift] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:34:31.459938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ef37d-7c81-446a-bbaa-390d9a2848b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cedb97f3c84faeaeef2b3209356842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:34:31.461756 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ef37d-7c81-446a-bbaa-390d9a2848b8 service placement] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:34:31.462105 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ef37d-7c81-446a-bbaa-390d9a2848b8 service placement] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:34:31.462379 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ef37d-7c81-446a-bbaa-390d9a2848b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:34:31.466543 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f13ef37d-7c81-446a-bbaa-390d9a2848b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:34:31.475107 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653de44-b7b1-42a2-8c98-2c0fb6c5c9cb None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:34:31.492771 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19b73d-4c3f-48fa-8ee9-b040b94e0b78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cedb97f3c84faeaeef2b3209356842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:34:31.493851 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19b73d-4c3f-48fa-8ee9-b040b94e0b78 service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:34:31.494512 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19b73d-4c3f-48fa-8ee9-b040b94e0b78 service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:34:31.494981 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19b73d-4c3f-48fa-8ee9-b040b94e0b78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:34:31.497046 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cc19b73d-4c3f-48fa-8ee9-b040b94e0b78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:34:31.500792 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ef37d-7c81-446a-bbaa-390d9a2848b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:34:31.502449 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ef37d-7c81-446a-bbaa-390d9a2848b8 service placement] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:34:31.512881 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19b73d-4c3f-48fa-8ee9-b040b94e0b78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:34:31.515256 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19b73d-4c3f-48fa-8ee9-b040b94e0b78 service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:34:31.515502 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1475/2938] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:34:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:34:31.528391 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1464/2939] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:34:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 17:34:35.075817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ef37d-7c81-446a-bbaa-390d9a2848b8 service placement] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:34:35.156895 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ef37d-7c81-446a-bbaa-390d9a2848b8 service placement] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:34:35.163502 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad36b99-fd08-41e4-97bb-e28b82f52e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:34:35.164035 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad36b99-fd08-41e4-97bb-e28b82f52e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:34:35.164318 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad36b99-fd08-41e4-97bb-e28b82f52e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:34:35.164643 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad36b99-fd08-41e4-97bb-e28b82f52e18 admin admin] PATH_INFO: `/v3/users/1835675414e74887b0c9ab715c2c56cf` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:34:35.166019 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad36b99-fd08-41e4-97bb-e28b82f52e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1835675414e74887b0c9ab715c2c56cf)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:34:35.168194 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad36b99-fd08-41e4-97bb-e28b82f52e18 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:34:35.250983 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bad36b99-fd08-41e4-97bb-e28b82f52e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1835675414e74887b0c9ab715c2c56cf'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.251938 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bad36b99-fd08-41e4-97bb-e28b82f52e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1835675414e74887b0c9ab715c2c56cf'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.261715 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bad36b99-fd08-41e4-97bb-e28b82f52e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1835675414e74887b0c9ab715c2c56cf'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.264242 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:35.276686 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bad36b99-fd08-41e4-97bb-e28b82f52e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1835675414e74887b0c9ab715c2c56cf'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.283758 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bad36b99-fd08-41e4-97bb-e28b82f52e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1835675414e74887b0c9ab715c2c56cf'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.292346 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1476/2940] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:34:35 2022] DELETE /identity/v3/users/1835675414e74887b0c9ab715c2c56cf => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:34:35.487098 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19b73d-4c3f-48fa-8ee9-b040b94e0b78 service placement] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:34:35.498506 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19b73d-4c3f-48fa-8ee9-b040b94e0b78 service placement] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:34:35.566369 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad36b99-fd08-41e4-97bb-e28b82f52e18 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:34:35.568177 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bad36b99-fd08-41e4-97bb-e28b82f52e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:34:35.588099 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04486ee-5d97-4081-958f-b087b9e9ad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:34:35.588733 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04486ee-5d97-4081-958f-b087b9e9ad47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:34:35.589011 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04486ee-5d97-4081-958f-b087b9e9ad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:34:35.589286 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04486ee-5d97-4081-958f-b087b9e9ad47 admin admin] PATH_INFO: `/v3/projects/45c2605f6e4f4fe383b4ade1a056b98d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:34:35.590433 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04486ee-5d97-4081-958f-b087b9e9ad47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c2605f6e4f4fe383b4ade1a056b98d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:34:35.592309 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04486ee-5d97-4081-958f-b087b9e9ad47 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:34:35.638932 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad36b99-fd08-41e4-97bb-e28b82f52e18 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:34:35.643780 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c04486ee-5d97-4081-958f-b087b9e9ad47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c2605f6e4f4fe383b4ade1a056b98d', 'request_id': 'req-c04486ee-5d97-4081-958f-b087b9e9ad47'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.647017 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:35.651989 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c04486ee-5d97-4081-958f-b087b9e9ad47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c2605f6e4f4fe383b4ade1a056b98d', 'request_id': 'req-c04486ee-5d97-4081-958f-b087b9e9ad47'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.658101 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c04486ee-5d97-4081-958f-b087b9e9ad47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c2605f6e4f4fe383b4ade1a056b98d', 'request_id': 'req-c04486ee-5d97-4081-958f-b087b9e9ad47'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.674201 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c04486ee-5d97-4081-958f-b087b9e9ad47 admin admin] The token cache is being invalidate because project 45c2605f6e4f4fe383b4ade1a056b98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:34:35.674490 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c04486ee-5d97-4081-958f-b087b9e9ad47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.675109 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c04486ee-5d97-4081-958f-b087b9e9ad47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.676700 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1465/2941] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:34:35 2022] DELETE /identity/v3/projects/45c2605f6e4f4fe383b4ade1a056b98d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:34:35.680899 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04486ee-5d97-4081-958f-b087b9e9ad47 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:34:35.682347 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c04486ee-5d97-4081-958f-b087b9e9ad47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:34:35.701217 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63783c8-fc34-48ea-b2e5-4e70450fb839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:34:35.701918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63783c8-fc34-48ea-b2e5-4e70450fb839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:34:35.702202 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63783c8-fc34-48ea-b2e5-4e70450fb839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:34:35.702506 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63783c8-fc34-48ea-b2e5-4e70450fb839 admin admin] PATH_INFO: `/v3/users/73a1153d0982475dbf83c3ab1974c850` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:34:35.703669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63783c8-fc34-48ea-b2e5-4e70450fb839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a1153d0982475dbf83c3ab1974c850)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:34:35.705617 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63783c8-fc34-48ea-b2e5-4e70450fb839 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:34:35.747212 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04486ee-5d97-4081-958f-b087b9e9ad47 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:34:35.752478 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e89287-cff2-40cb-9924-ce3052d926d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:34:35.753134 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e89287-cff2-40cb-9924-ce3052d926d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:34:35.753278 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a63783c8-fc34-48ea-b2e5-4e70450fb839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a1153d0982475dbf83c3ab1974c850'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.753413 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e89287-cff2-40cb-9924-ce3052d926d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:34:35.753709 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e89287-cff2-40cb-9924-ce3052d926d1 admin admin] PATH_INFO: `/v3/users/c1771d9936e44fbabf5cabeca6f1b64b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:34:35.753837 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a63783c8-fc34-48ea-b2e5-4e70450fb839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a1153d0982475dbf83c3ab1974c850'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.755386 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e89287-cff2-40cb-9924-ce3052d926d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1771d9936e44fbabf5cabeca6f1b64b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:34:35.757295 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e89287-cff2-40cb-9924-ce3052d926d1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:34:35.761701 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a63783c8-fc34-48ea-b2e5-4e70450fb839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a1153d0982475dbf83c3ab1974c850'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.774468 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a63783c8-fc34-48ea-b2e5-4e70450fb839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a1153d0982475dbf83c3ab1974c850'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.781413 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a63783c8-fc34-48ea-b2e5-4e70450fb839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a1153d0982475dbf83c3ab1974c850'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.783817 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:35.788522 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1477/2942] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:34:35 2022] DELETE /identity/v3/users/73a1153d0982475dbf83c3ab1974c850 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:34:35.804497 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b2e89287-cff2-40cb-9924-ce3052d926d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1771d9936e44fbabf5cabeca6f1b64b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.812920 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b2e89287-cff2-40cb-9924-ce3052d926d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1771d9936e44fbabf5cabeca6f1b64b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.826367 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b2e89287-cff2-40cb-9924-ce3052d926d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1771d9936e44fbabf5cabeca6f1b64b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.833949 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b2e89287-cff2-40cb-9924-ce3052d926d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1771d9936e44fbabf5cabeca6f1b64b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.834656 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b2e89287-cff2-40cb-9924-ce3052d926d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1771d9936e44fbabf5cabeca6f1b64b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:35.844322 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1466/2943] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:34:35 2022] DELETE /identity/v3/users/c1771d9936e44fbabf5cabeca6f1b64b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:34:35.968248 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63783c8-fc34-48ea-b2e5-4e70450fb839 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:34:35.970557 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a63783c8-fc34-48ea-b2e5-4e70450fb839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:34:36.028328 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e89287-cff2-40cb-9924-ce3052d926d1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:34:36.030158 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b2e89287-cff2-40cb-9924-ce3052d926d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:34:36.059641 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63783c8-fc34-48ea-b2e5-4e70450fb839 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:34:36.105935 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e89287-cff2-40cb-9924-ce3052d926d1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:34:36.110735 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e13ed-7773-4eea-92d7-19581420b7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:34:36.111436 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e13ed-7773-4eea-92d7-19581420b7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:34:36.111717 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e13ed-7773-4eea-92d7-19581420b7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:34:36.111988 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e13ed-7773-4eea-92d7-19581420b7a6 admin admin] PATH_INFO: `/v3/projects/6caa5b17f1f64bb69b90217d9c58c640` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:34:36.113111 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e13ed-7773-4eea-92d7-19581420b7a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6caa5b17f1f64bb69b90217d9c58c640)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:34:36.115623 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e13ed-7773-4eea-92d7-19581420b7a6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:34:36.117104 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:36.119372 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91c620-b52d-4fa9-8daf-2d06520be46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:34:36.120626 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91c620-b52d-4fa9-8daf-2d06520be46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:34:36.120907 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91c620-b52d-4fa9-8daf-2d06520be46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:34:36.121180 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91c620-b52d-4fa9-8daf-2d06520be46a admin admin] PATH_INFO: `/v3/projects/5b89dd4e2a5749d4bae6533bee337c66` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:34:36.122325 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91c620-b52d-4fa9-8daf-2d06520be46a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b89dd4e2a5749d4bae6533bee337c66)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:34:36.124362 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91c620-b52d-4fa9-8daf-2d06520be46a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:34:36.169236 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c39e13ed-7773-4eea-92d7-19581420b7a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6caa5b17f1f64bb69b90217d9c58c640', 'request_id': 'req-c39e13ed-7773-4eea-92d7-19581420b7a6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.171398 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0f91c620-b52d-4fa9-8daf-2d06520be46a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b89dd4e2a5749d4bae6533bee337c66', 'request_id': 'req-0f91c620-b52d-4fa9-8daf-2d06520be46a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.175115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c39e13ed-7773-4eea-92d7-19581420b7a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6caa5b17f1f64bb69b90217d9c58c640', 'request_id': 'req-c39e13ed-7773-4eea-92d7-19581420b7a6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.178474 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0f91c620-b52d-4fa9-8daf-2d06520be46a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b89dd4e2a5749d4bae6533bee337c66', 'request_id': 'req-0f91c620-b52d-4fa9-8daf-2d06520be46a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.182283 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c39e13ed-7773-4eea-92d7-19581420b7a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6caa5b17f1f64bb69b90217d9c58c640', 'request_id': 'req-c39e13ed-7773-4eea-92d7-19581420b7a6'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.184722 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0f91c620-b52d-4fa9-8daf-2d06520be46a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b89dd4e2a5749d4bae6533bee337c66', 'request_id': 'req-0f91c620-b52d-4fa9-8daf-2d06520be46a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.196489 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c39e13ed-7773-4eea-92d7-19581420b7a6 admin admin] The token cache is being invalidate because project 6caa5b17f1f64bb69b90217d9c58c640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:34:36.196788 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c39e13ed-7773-4eea-92d7-19581420b7a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.197415 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c39e13ed-7773-4eea-92d7-19581420b7a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.197839 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0f91c620-b52d-4fa9-8daf-2d06520be46a admin admin] The token cache is being invalidate because project 5b89dd4e2a5749d4bae6533bee337c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:34:36.198132 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0f91c620-b52d-4fa9-8daf-2d06520be46a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.198764 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0f91c620-b52d-4fa9-8daf-2d06520be46a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.210916 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1467/2944] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:34:36 2022] DELETE /identity/v3/projects/6caa5b17f1f64bb69b90217d9c58c640 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 17:34:36.211160 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1478/2945] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:34:35 2022] DELETE /identity/v3/projects/5b89dd4e2a5749d4bae6533bee337c66 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:34:36.211289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e13ed-7773-4eea-92d7-19581420b7a6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:34:36.211289 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c39e13ed-7773-4eea-92d7-19581420b7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:34:36.279787 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e13ed-7773-4eea-92d7-19581420b7a6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:34:36.341174 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50541844-44d6-4fcc-b68f-3eee0f311384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:34:36.341853 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50541844-44d6-4fcc-b68f-3eee0f311384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:34:36.342144 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50541844-44d6-4fcc-b68f-3eee0f311384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:34:36.342420 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50541844-44d6-4fcc-b68f-3eee0f311384 admin admin] PATH_INFO: `/v3/users/cdd7204cb0374a91995abb03f703ed73` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:34:36.343753 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50541844-44d6-4fcc-b68f-3eee0f311384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd7204cb0374a91995abb03f703ed73)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:34:36.346088 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50541844-44d6-4fcc-b68f-3eee0f311384 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:34:36.392517 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:36.399380 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-50541844-44d6-4fcc-b68f-3eee0f311384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd7204cb0374a91995abb03f703ed73'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.407875 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-50541844-44d6-4fcc-b68f-3eee0f311384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd7204cb0374a91995abb03f703ed73'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.421599 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-50541844-44d6-4fcc-b68f-3eee0f311384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd7204cb0374a91995abb03f703ed73'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.430445 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-50541844-44d6-4fcc-b68f-3eee0f311384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd7204cb0374a91995abb03f703ed73'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.431458 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-50541844-44d6-4fcc-b68f-3eee0f311384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd7204cb0374a91995abb03f703ed73'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.440707 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1468/2946] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Sep 27 17:34:36 2022] DELETE /identity/v3/users/cdd7204cb0374a91995abb03f703ed73 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:34:36.618918 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91c620-b52d-4fa9-8daf-2d06520be46a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:34:36.620566 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0f91c620-b52d-4fa9-8daf-2d06520be46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:34:36.634460 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91c620-b52d-4fa9-8daf-2d06520be46a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:34:36.669669 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:36.697632 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef507998-f4e9-49ac-a1d8-ca7e69bab4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100c1706b8bd4a93b5f2764550817d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f246d966d6f4376a724440b0dff9304', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:34:36.698289 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef507998-f4e9-49ac-a1d8-ca7e69bab4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:34:36.698589 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef507998-f4e9-49ac-a1d8-ca7e69bab4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:34:36.698858 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef507998-f4e9-49ac-a1d8-ca7e69bab4fd admin admin] PATH_INFO: `/v3/projects/1bbb42e89a8443ca9a3b9904fda827af` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:34:36.699950 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef507998-f4e9-49ac-a1d8-ca7e69bab4fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bbb42e89a8443ca9a3b9904fda827af)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:34:36.701870 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef507998-f4e9-49ac-a1d8-ca7e69bab4fd admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:34:36.747565 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef507998-f4e9-49ac-a1d8-ca7e69bab4fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bbb42e89a8443ca9a3b9904fda827af', 'request_id': 'req-ef507998-f4e9-49ac-a1d8-ca7e69bab4fd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.753215 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef507998-f4e9-49ac-a1d8-ca7e69bab4fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bbb42e89a8443ca9a3b9904fda827af', 'request_id': 'req-ef507998-f4e9-49ac-a1d8-ca7e69bab4fd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.759433 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef507998-f4e9-49ac-a1d8-ca7e69bab4fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bbb42e89a8443ca9a3b9904fda827af', 'request_id': 'req-ef507998-f4e9-49ac-a1d8-ca7e69bab4fd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.771577 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef507998-f4e9-49ac-a1d8-ca7e69bab4fd admin admin] The token cache is being invalidate because project 1bbb42e89a8443ca9a3b9904fda827af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 17:34:36.771863 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef507998-f4e9-49ac-a1d8-ca7e69bab4fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.772477 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ef507998-f4e9-49ac-a1d8-ca7e69bab4fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 17:34:36.773968 dv-cinder-849143-8-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1479/2947] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Sep 27 17:34:36 2022] DELETE /identity/v3/projects/1bbb42e89a8443ca9a3b9904fda827af => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 17:34:46.439713 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=5,keystone:SELECT=14,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:46.768597 dv-cinder-849143-8-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:36:48.766115 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50541844-44d6-4fcc-b68f-3eee0f311384 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 17:36:48.767479 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-50541844-44d6-4fcc-b68f-3eee0f311384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:36:48.836050 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50541844-44d6-4fcc-b68f-3eee0f311384 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 17:36:48.892894 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df8252-afea-4cb7-84e4-a951cbf96024 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cedb97f3c84faeaeef2b3209356842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20fffa15f44b4f519ac7e29a48a7a596', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 17:36:48.893490 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df8252-afea-4cb7-84e4-a951cbf96024 service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 17:36:48.893792 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df8252-afea-4cb7-84e4-a951cbf96024 service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 17:36:48.894059 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df8252-afea-4cb7-84e4-a951cbf96024 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 17:36:48.895771 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f2df8252-afea-4cb7-84e4-a951cbf96024 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 17:36:48.907177 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df8252-afea-4cb7-84e4-a951cbf96024 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 17:36:48.908733 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df8252-afea-4cb7-84e4-a951cbf96024 service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 17:36:48.918384 dv-cinder-849143-8-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1469/2948] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Sep 27 17:36:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 17:36:58.914195 dv-cinder-849143-8-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=58 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}